Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 8

Displaying posts with tag: Hive (reset)

MySQL Applier For Hadoop: Implementation
Employee +4 Vote Up -0Vote Down
posted by Shubhangi Garg on Tue 23 Apr 2013 13:30 UTC
Tags:
(edit) mysql, Replication, hadoop, big data, sqoop, real time, Hive, big, applier, lab release, Hadoop Applier, MySQL Applier for Hadoop, CDC

This is a follow up post, describing the implementation details of Hadoop Applier, and steps to configure and install it. Hadoop Applier integrates MySQL with Hadoop providing the real-time replication of INSERTs to HDFS, and hence can be consumed by the data stores working on top of Hadoop. You can know more about the design rationale and per-requisites in the previous post.

Design and Implementation:

Hadoop Applier replicates rows inserted into a table in MySQL to the Hadoop Distributed File System(HDFS). It uses an API provided by libhdfs, a C library to manipulate files in HDFS.

The library comes pre-compiled with Hadoop distributions.It






  [Read more...]
MySQL Applier For Hadoop: Real time data export from MySQL to HDFS
Employee +2 Vote Up -0Vote Down
posted by Shubhangi Garg on Mon 22 Apr 2013 17:45 UTC
Tags:
(edit) mysql, Replication, Introduction, hadoop, big data, sqoop, real time, Hive, applier, lab release, Hadoop Applier, MySQL Applier for Hadoop, CDC

MySQL replication enables data to be replicated from one MySQL database server (the master) to one or more MySQL database servers (the slaves). However, imagine the number of use cases being served if the slave (to which data is replicated) isn't restricted to be a MySQL server; but it can be any other database server or platform with replication events applied in real-time! 
This is what the new Hadoop Applier empowers you to do.
An example of such a slave could be a data warehouse system such as Apache Hive, which uses HDFS as a data store. If you have a Hive metastore associated with HDFS(Hadoop Distributed File System), the Hadoop Applier can populate Hive


  [Read more...]
Announcing the MySQL Applier for Apache Hadoop
Employee_Team +5 Vote Up -0Vote Down
posted by Oracle MySQL Group on Mon 22 Apr 2013 15:03 UTC
Tags:
(edit) mysql, data, hadoop, sqoop, Hive, hdfs, big, applier

Enabling Real-Time MySQL to HDFS Integration

Batch processing delivered by Map/Reduce remains central to Apache Hadoop, but as the pressure to gain competitive advantage from “speed of thought” analytics grows, so Hadoop itself is undergoing significant evolution. The development of technologies allowing real time queries, such as Apache Drill, Cloudera Impala and the Stinger Initiative are emerging, supported by new generations of resource management with Apache YARN

To support this growing emphasis on real-time operations, we are releasing a new

  [Read more...]
The Data Day, Two days: January 15/16 2013
+0 Vote Up -0Vote Down
posted by Matt Aslett on Wed 16 Jan 2013 19:38 UTC
Tags:
(edit) mysql, Oracle, Uncategorized, Tokutek, Hive, datastax, HortonWorks, NuoDB, Clustrix, Impala, ObjectRocket, Ayasdi, Lattice Engines, zettaset

Funding for Ayasdi and Zettaset. NuoDB launches cloud database. And more

For 451 Research clients: NuoDB launches distributed ‘cloud data management system’ bit.ly/UO3ssM

— Matt Aslett (@maslett) January 15, 2013

For 451 clients: Armed with $20m series C, Lattice Engines looks to bring sales intelligence inside bit.ly/11z4VdF By Krishna Roy

— Matt Aslett (@maslett) January 16, 2013

Ayasdi Launches with $10 Million from Khosla Ventures and FLOODGATE. bit.ly/X7oemJ

— Matt Aslett (@maslett)

  [Read more...]
Typical “Big” Data Architecture
+1 Vote Up -0Vote Down
posted by Venu Anuganti on Fri 30 Nov 2012 22:15 UTC
Tags:
(edit) mysql, postgresql, sql, database, scalability, hadoop, data warehouse, MapReduce, hbase, cloudera, NoSQL, vertica, Hive, bigdata, Big Data Architecture, Big Data Warehouse, Data Architecture, Impala, NoSQL and BigData
Here is the typical “Big” data architecture, that covers most components involved in the data pipeline. More or less, we have the same architecture in production in number of places[...]
HPCC vs Hadoop at a glance
+0 Vote Up -0Vote Down
posted by Roland Bouman on Sat 18 Jun 2011 08:22 UTC
Tags:
(edit) Open Source, gpl, Pentaho, ETL, hadoop, agpl, business intelligence, big data, sqoop, NoSQL, Pig, Hive, Roxie, Thor, Apache v2 license, ECL, HPCC Systems

Update

Since this article was written, HPCC has undergone a number of significant changes and updates. This addresses some of the critique voiced in this blog post, such as the license (updated from AGPL to Apache 2.0) and integration with other tools. For more information, refer to the comments placed by Flavio Villanustre and Azana Baksh.

The original article can be read unaltered below:

Yesterday I noticed this tweet by Andrei Savu: . This prompted me to read the related GigaOM article and then check out the  [Read more...]
451 CAOS Links 2011.03.25
+0 Vote Up -0Vote Down
posted by The 451 Group on Fri 25 Mar 2011 17:11 UTC
Tags:
(edit) gpl, software, Linux, Google, opensource, symbian, Red Hat, 451 group, 451caostheory, 451group, caostheory, matt aslett, mattaslett, matthew aslett, matthewaslett, open-source, The 451 Group, the451group, hadoop, honeycomb, black duck, continuent, android, Mike Olson, tungsten, Mark Radcliffe, cloudera, Stephen Walli, rackspace, openlogic, hadoopdb, cassandra, mulesoft, Tcat server, tasktop, genuitec, Future of Open Source, North Bridge, Hive, OpenStack, clearstone, datastax, brisk, evident software, hadapt, mapr, myeclipse, rick clark

Red Hat grows revenue 20%+. Google withholding Honeycomb source code. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca, and daily at Paper.li/caostheory
“Tracking the open source news wires, so you don’t have to.”

# Red Hat reported Q4 revenue up 25% to $245m, FY revenue up 22% to $909m

# Google is withholding the source code to Honeycomb for the foreseeable future.

# Rick Clark explained why he left Rackspace amid concerns that the company is exerting too much control over OpenStack.

# DataStax launched Brisk, a Hadoop/Hive


  [Read more...]
MapReduce – DBInputFormat – Serialization on readers
+1 Vote Up -0Vote Down
posted by Venu Anuganti on Tue 20 Jul 2010 05:46 UTC
Tags:
(edit) mysql, database, scalability, MapReduce, cloudera, sqoop, Hadopp, cloudera import tool, DBInputFomat Locking issue, Hive, how to load mysql data to hadoop, mapreduce isolation
Last week I was working on EC2 MySQL server where one of the slave is taking lot of time to catch-up; and only job that is running on that server[...]
Showing entries 1 to 8

Planet MySQL © 1995, 2013, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.