Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 30 of 93 Next 30 Older Entries

Displaying posts with tag: hadoop (reset)

The Data Day, A few days: April 22-26 2013
+0 Vote Up -0Vote Down
posted by Matt Aslett on Fri 26 Apr 2013 14:14 UTC
Tags:
(edit) mysql, sap, Pentaho, VMWare, hadoop, continuent, Tokutek, tungsten, Informatica, Data Management, mariadb, monty program, paraccel, skysql, actian, Clustrix, Guavus, HANA, qliktech, MemSQL, Serengeti, digital infrastructure, geniedb, Pivotal, Qubole, Webdetails

Pivotal launches. SkySQL and Mony Program merge. And much, much more

Our report on the changes in the MySQL ecosystem is now available for 451 clients and non-clients alike at bit.ly/451mysql

— Matt Aslett (@maslett) April 25, 2013

For 451 Research clients: VMware expands Serengeti’s horizons with updated Hadoop virtualization project bit.ly/17muQFI

— Matt Aslett (@maslett) April 26, 2013

For 451 Research clients: SkySQL, Monty Program merge to support MariaDB following formation of MariaDB Foundation bit.ly/10dsdjf

  [Read more...]
Biggest MySQL related news in the last 24 hours, Day 2
+1 Vote Up -2Vote Down
posted by Colin Charles on Wed 24 Apr 2013 12:42 UTC
Tags:
(edit) mysql, Oracle, hadoop, mariadb, monty program, skysql, MySQL Cluster 7.3, MySQL 5.7

Continuing on from yesterday, the biggest news that I’ve noted in the past 24 hours:

  • The commitment from Oracle’s MySQL team to release a new GA about once every 24 months, with a Developer Milestone Release (DMR), with “GA quality” every 4-6 months. Tomas Ulin announced MySQL 5.7 DMR1 (milestone 11) [download, release notes, manual]. He also announced MySQL Cluster 7.3 DMR2 [download,
    •   [Read more...]
    MySQL Applier For Hadoop: Implementation
    Employee +4 Vote Up -0Vote Down
    posted by Shubhangi Garg on Tue 23 Apr 2013 13:30 UTC
    Tags:
    (edit) mysql, Replication, hadoop, big data, sqoop, real time, Hive, big, applier, lab release, Hadoop Applier, MySQL Applier for Hadoop, CDC

    This is a follow up post, describing the implementation details of Hadoop Applier, and steps to configure and install it. Hadoop Applier integrates MySQL with Hadoop providing the real-time replication of INSERTs to HDFS, and hence can be consumed by the data stores working on top of Hadoop. You can know more about the design rationale and per-requisites in the previous post.

    Design and Implementation:

    Hadoop Applier replicates rows inserted into a table in MySQL to the Hadoop Distributed File System(HDFS). It uses an API provided by libhdfs, a C library to manipulate files in HDFS.

    The library comes pre-compiled with Hadoop distributions.It






      [Read more...]
    MySQL Applier For Hadoop: Real time data export from MySQL to HDFS
    Employee +2 Vote Up -0Vote Down
    posted by Shubhangi Garg on Mon 22 Apr 2013 17:45 UTC
    Tags:
    (edit) mysql, Replication, Introduction, hadoop, big data, sqoop, real time, Hive, applier, lab release, Hadoop Applier, MySQL Applier for Hadoop, CDC

    MySQL replication enables data to be replicated from one MySQL database server (the master) to one or more MySQL database servers (the slaves). However, imagine the number of use cases being served if the slave (to which data is replicated) isn't restricted to be a MySQL server; but it can be any other database server or platform with replication events applied in real-time! 
    This is what the new Hadoop Applier empowers you to do.
    An example of such a slave could be a data warehouse system such as Apache Hive, which uses HDFS as a data store. If you have a Hive metastore associated with HDFS(Hadoop Distributed File System), the Hadoop Applier can populate Hive


      [Read more...]
    Announcing the MySQL Applier for Apache Hadoop
    Employee_Team +5 Vote Up -0Vote Down
    posted by Oracle MySQL Group on Mon 22 Apr 2013 15:03 UTC
    Tags:
    (edit) mysql, data, hadoop, sqoop, Hive, hdfs, big, applier

    Enabling Real-Time MySQL to HDFS Integration

    Batch processing delivered by Map/Reduce remains central to Apache Hadoop, but as the pressure to gain competitive advantage from “speed of thought” analytics grows, so Hadoop itself is undergoing significant evolution. The development of technologies allowing real time queries, such as Apache Drill, Cloudera Impala and the Stinger Initiative are emerging, supported by new generations of resource management with Apache YARN

    To support this growing emphasis on real-time operations, we are releasing a new

      [Read more...]
    Deploying Cloudera Impala on EC2 with Example Live Demo
    +0 Vote Up -0Vote Down
    posted by Marco tusa (Pythian) on Wed 03 Apr 2013 16:48 UTC
    Tags:
    (edit) performance, ec2, hadoop, big data, Impala

    A little while ago I blogged about (and open sourced) an Impala-powered soccer visualization demo, designed to demonstrate just how responsive Impala queries can be. Since not everyone has the time or resources to run the project themselves, we’ve decided to host it ourselves on an EC2 instance. You can try the visualization; we’ve also opened up the Impala web interface, where you can see query profiles and performance numbers, and Hue (username and password are both ‘test’), where you can run your own queries on the dataset.

    Deploying  [Read more...]

    The Data Day, Two days: February 11/12 2013
    +0 Vote Up -0Vote Down
    posted by Matt Aslett on Tue 12 Feb 2013 16:38 UTC
    Tags:
    (edit) hadoop, Data Management, NoSQL, ClearStory, dark data, Global IDs, marklogic

    ClearStory sheds light on data analysis service. Illuminating ‘dark data’. More.

    For 451 clients: ClearStory bags $9m in series A funding, sheds light on its data analysis service bit.ly/Y6v8sV By Krishna Roy

    — Matt Aslett (@maslett) February 12, 2013

    For 451 clients: Global IDs makes ‘big data’ MDM play via cloud and Hadoop, touts profitable growth bit.ly/Y6v6kL By Krishna Roy

    — Matt Aslett (@maslett) February 12, 2013

    ScaleBase releases version 2.0 of its MySQL database scalability software bit.ly/WGtEtN

      [Read more...]
    MySQL-State of the Union. Interview with Tomas Ulin.
    +8 Vote Up -0Vote Down
    posted by Roberto V. Zicari on Mon 11 Feb 2013 07:58 UTC
    Tags:
    (edit) mysql, Open Source, Uncategorized, innodb, memcached, scale-out, hadoop, big data, NoSQL, Map-Reduce, scale-up, relational databases, Apache Sqoop, Binlog API, MySQL Cluster 7.3, Playful Play
    “With MySQL 5.6, developers can now commingle the “best of both worlds” with fast key-value look up operations and complex SQL queries to meet user and application specific requirements” –Tomas Ulin. On February 5, 2013, Oracle announced the general availability of MySQL 5.6. I have interviewed Tomas Ulin, Vice President for the MySQL Engineering team [...]
    The Data Day, Two days: February 7/8 2013
    +0 Vote Up -0Vote Down
    posted by Matt Aslett on Fri 08 Feb 2013 17:50 UTC
    Tags:
    (edit) mysql, postgresql, Yahoo!, Oracle, sql, VMWare, hadoop, actuate, birt, Data Management, Teradata, dynamodb, WANdisco, riak, basho, xeround, Data fabric, ANTs, chemistry of data, Datawatch, dataxu, Drawn to Scale, Tokyo Electon Device

    Teradata results. Funding for DataXu. The chemistry of data. And more.

    For 451 Research clients: Oracle launches major update to MySQL open source database bit.ly/TSONAt

    — Matt Aslett (@maslett) February 8, 2013

    For 451 clients: Analyzing the chemistry of data bit.ly/TSOV2R By @451wendy Treating sensitive data like dangerous chemicals

    — Matt Aslett (@maslett) February 8, 2013

    Teradata: Q4 net income $112m on revenue up 10% to $740m, FY net income $419m on revenue up 13% to $2.7bn. bit.ly/14FNS8L

      [Read more...]
    Data Science vs. Data Analytics
    +1 Vote Up -0Vote Down
    posted by Venu Anuganti on Mon 10 Dec 2012 19:33 UTC
    Tags:
    (edit) mysql, database, analytics, hadoop, data warehouse, bigdata, Data Analytics, Data Science, DataAnalytics, DataScience, Difference between data science and data analytics, How to hire data scientist, ROle of data analytics, Role of Data Scientist, What is Data science
    As this topic came up a few times this week for discussion at various places, I thought of composing a post on “Data Scientist vs. Data Analytics Engineer”; even though[...]
    On Big Data, Analytics and Hadoop. Interview with Daniel Abadi.
    +0 Vote Up -0Vote Down
    posted by Roberto V. Zicari on Wed 05 Dec 2012 16:49 UTC
    Tags:
    (edit) mysql, Uncategorized, sql, Google, analytics, hadoop, MapReduce, big data, daniel abadi, NoSQL, hadapt, Google BigTable, nosql databases, relational databases, Yale University
    “Some people even think that “Hadoop” and “Big Data” are synonymous (though this is an over-characterization). Unfortunately, Hadoop was designed based on a paper by Google in 2004 which was focused on use cases involving unstructured data (e.g. extracting words and phrases from Webpages in order to create Google’s Web index). Since it was not [...]
    Distributed Clustering Services
    +0 Vote Up -0Vote Down
    posted by Venu Anuganti on Mon 03 Dec 2012 06:38 UTC
    Tags:
    (edit) mysql, postgresql, database, hadoop, NoSQL, bigdata, Co-orinating systems, Distributed Clustering, Distributed co-ordination, Distributed systems, HA using Zookeeper, MySQL HA using Zookeeer, Spread, Zookeeper
    Apart from my consulting as part of ScaleIn, I also invest to bootstrap companies with really disruptive ideas; and in the process met few database specific companies who are already[...]
    Typical “Big” Data Architecture
    +1 Vote Up -0Vote Down
    posted by Venu Anuganti on Fri 30 Nov 2012 22:15 UTC
    Tags:
    (edit) mysql, postgresql, sql, database, scalability, hadoop, data warehouse, MapReduce, hbase, cloudera, NoSQL, vertica, Hive, bigdata, Big Data Architecture, Big Data Warehouse, Data Architecture, Impala, NoSQL and BigData
    Here is the typical “Big” data architecture, that covers most components involved in the data pipeline. More or less, we have the same architecture in production in number of places[...]
    MySQL and Hadoop Integration - Unlocking New Insight
    Employee_Team +4 Vote Up -0Vote Down
    posted by Oracle MySQL Group on Thu 29 Nov 2012 18:58 UTC
    Tags:
    (edit) mysql, Apache, cluster, data, hadoop, BI, sqoop, NoSQL, big

    “Big Data” offers the potential for organizations to revolutionize their operations. With the volume of business data doubling every 1.2 years, analysts and business users are discovering very real benefits when integrating and analyzing data from multiple sources, enabling deeper insight into their customers, partners, and business processes.

    As the world’s most popular open source database, and the most deployed database in the web and cloud, MySQL is a key component of many big data platforms, with Hadoop vendors estimating 80% of deployments are integrated with MySQL.

    The new Guide to MySQL and Hadoop (http://www.mysql.com/why-mysql/white-papers/mysql_wp_hadoop.php) presents the tools enabling integration between the two data platforms, supporting the data lifecycle from

      [Read more...]
    Two Cons against NoSQL. Part I.
    +1 Vote Up -1Vote Down
    posted by Roberto V. Zicari on Tue 30 Oct 2012 16:57 UTC
    Tags:
    (edit) mysql, postgres, Oracle, Open Source, Uncategorized, sql, ibm, analytics, hadoop, Excel, csv, big data, NoSQL, mongodb, json, riak, voltdb, basho, nosql databases, Cindy Saracco, Clustrix, document stores, Dwight Merriman, InfoSphere BigInsights, John Hugg, New and old Data stores, relational databases, Steve Vinoski
    Two cons against NoSQL data stores read like this: 1. It’s very hard to move data out from one NoSQL to some other system, even other NoSQL. There is a very hard lock in when it comes to NoSQL. If you ever have to move to another database, you have basically to re-implement a lot [...]
    Log Buffer #279, A Carnival of the Vanities for DBAs
    +0 Vote Up -0Vote Down
    posted by The Pythian Group on Fri 27 Jul 2012 07:00 UTC
    Tags:
    (edit) mysql, Oracle, Log Buffer, SQL Server, hadoop, rhel, exadata
    In a typical organization, all work together to bring out a common good for the outside world. It’s interesting to see how all of these entities blog about technology, and there is more and more interest shown by managerial technologists about the database. This Log Buffer Edition appeases their appetites along with the others in [...]
    MySQL and Hadoop
    Employee_Team +2 Vote Up -0Vote Down
    posted by Oracle MySQL Group on Thu 26 Jul 2012 11:50 UTC
    Tags:
    (edit) mysql, hadoop, MapReduce, hdfs

    Introduction

    "Improving MySQL performance using Hadoop" was the talk which I and Manish Kumar gave at Java One & Oracle Develop 2012, India. Based on the response and interest of the audience, we decided to summarize the talk in a blog post. The slides of this talk can be found here. They also include a screen-cast of a live Hadoop system pulling data from MySQL and working on the popular 'word count' problem.



    MySQL and Hadoop have been popularly considered as 'Friends with benefits' and our talk was aimed at showing how!



      [Read more...]
    So now Hadoop's days are numbered?
    +3 Vote Up -0Vote Down
    posted by Doron Levari on Tue 10 Jul 2012 20:28 UTC
    Tags:
    (edit) database, scalability, analytics, hadoop, data warehouse, big data, parallelism, scale out, map reduce, database scalability
    Earlier this week we all read GigaOM's article with this title:
    "Why the days are numbered for Hadoop as we know it"
    I know GigaOM like to provoke scandals sometimes, we all remember some other unforgettable piece, but there is something behind it...

    Hadoop today (after SOA not so long ago) is one of the worst case of an abused buzzword ever known to men. It's everything, everywhere, can cure illnesses and do "big-data" at the same time! Wow! Actually Hadoop is a software framework that supports data-intensive distributed applications, derived from Google's MapReduce and Google File System (GFS) papers.

    My take from the article is




      [Read more...]
    A super-set of MySQL for Big Data. Interview with John Busch, Schooner.
    +0 Vote Up -0Vote Down
    posted by Roberto V. Zicari on Mon 20 Feb 2012 09:28 UTC
    Tags:
    (edit) mysql, Oracle, Uncategorized, sql, innodb, memcached, hadoop, MapReduce, big data, mariadb, schooner, NoSQL, voltdb, nosql databases, Apache Hadoop, SchoonerSQL, John Busch, Schooner Information Technology
    “Legacy MySQL does not scale well on a single node, which forces granular sharding and explicit application code changes to make them sharding-aware and results in low utilization of severs”– Dr. John Busch, Schooner Information Technology A super-set of MySQL suitable for Big Data? On this subject, I have interviewed Dr. John Busch, Founder, Chairman, [...]
    Open APIs are the new open source
    +1 Vote Up -0Vote Down
    posted by The 451 Group on Tue 14 Feb 2012 18:08 UTC
    Tags:
    (edit) PHP, Java, software, Linux, ruby, Python, opensource, amazon, memcached, apis, 451 group, 451caostheory, 451group, caostheory, open-source, The 451 Group, the451group, developers, hadoop, erlang, jay lyman, jaylyman, Amazon Web Services, open apis, cassandra, devops, html5, Scala, node.js, nosql databases, IT operations, system administrators, application programming interfaces, LinuxInsider, MySQL and PostgreSQL databases, open enough

    We’ve seen the rise of open source software in the enterprise and also beyond the IT industry, but the real keys to openness and its advantages in today’s technology world — where efficient use of cloud computing and supporting services are paramount — exist in open application programming interfaces, or APIs.

    Open source software continues to be a critical part of software development, systems administration, IT operations and more, but much of the action in leveraging modern cloud computing and services-based infrastructures centers on APIs. Open APIs are the new open source.

    Read the full story at LinuxInsider.

    OSSCube adds one more Cloudera Certified Developer in its Armor
    +0 Vote Up -0Vote Down
    posted by Sonali Minocha on Fri 06 Jan 2012 09:16 UTC
    Tags:
    (edit) hadoop, cloudera

    OSSCube has now one more Cloudera Certified Developer for Apache Hadoop. Rakesh Kumar has become the Cloudera Certified Developer through the CCDH, the industry's only certification for software developers on Hadoop. He passed the Cloudera Certified Developer for Apache Hadoop exam after going through a rigorous training program.

    Rakesh is also a MySQL certified DBA and Cluster DBA and has trained several engineers for Zend Certification Examinations.

    Tags: ClouderaHadoop
    OSSCube adds one more Cloudera Certified Developer in its Armor
    +0 Vote Up -0Vote Down
    posted by Sonali Minocha on Fri 06 Jan 2012 09:16 UTC
    Tags:
    (edit) hadoop, cloudera

    OSSCube has now one more Cloudera Certified Developer for Apache Hadoop. Rakesh Kumar has become the Cloudera Certified Developer through the CCDH, the industry's only certification for software developers on Hadoop. He passed the Cloudera Certified Developer for Apache Hadoop exam after going through a rigorous training program.

    Rakesh is also a MySQL certified DBA and Cluster DBA and has trained several engineers for Zend Certification Examinations.

    Tags: ClouderaHadoop
    Vote for MySQL[plus] awards 2011 !
    +5 Vote Up -0Vote Down
    posted by Cedric PEINTRE on Thu 05 Jan 2012 12:05 UTC
    Tags:
    (edit) Oracle, lvm, Innotop, memcached, mylvmbackup, drbd, drizzle, MONyog, couchdb, mysqldump, cacti, Percona, Nagios, hadoop, MySQL enterprise monitor, zabbix, scaledb, mysql replication, mysqltuner, mydumper, mariadb, TokuDB, Xtrabackup, mongodb, cassandra, infinidb, mycheckpoint, riak, skysql, percona server, palominodb, cold backup, xtrabackup manager, fromdual, Live !, MHA, MySQL Enterprise Backup, Percona Toolkit, Common schema, Galera Replication, MySQL NDB Cluster, r1soft CDP, ShoonerSQL, Tarantool, Tungsten replicator, ZRM Community, ZRM Enterprise

    First of all, I wish you a happy new year.
    Many things happened last year, it was really exciting to be involved in the MySQL ecosystem.
    I hope this enthusiasm will be increased this year, up to you !

    To start the year, I propose the MySQL[plus] Awards 2011
    It will only take 5 minutes to fill out these polls.
    Answer with your heart first and then with your experience with some of these tools or services.

    Polls will be closed January 31, so, vote now !
    For “other” answers, please,  let me a comment with details.

    Don’t hesitate to submit proposal for tools or services in the comments.






      [Read more...]
    Fake O'Reilly Covers
    +3 Vote Up -1Vote Down
    posted by Zack Urlocker on Mon 19 Dec 2011 11:27 UTC
    Tags:
    (edit) mysql, Books, sql, Misc, Satire, OReilly, cloud, hadoop, kindle, SaaS, mongodb, interactive fiction, screensaver



    Here are some of the fake O'Reilly book covers I mentioned in a prior post.  These have been optimized for use as black & white Kindle screensaver wallpaper images.  If you haven't done so already, you can install a Kindle screensaver hack with a couple of downloads. 

    Update: I've embedded a slideshow from PicasaWeb, but it requires Flash.  If you don't see it you can click on the links below to go directly to



      [Read more...]
    Using MySQL Cluster to Protect & Scale the HDFS Namenode
    Employee_Team +0 Vote Up -0Vote Down
    posted by Oracle MySQL Group on Mon 19 Dec 2011 09:51 UTC
    Tags:
    (edit) mysql, MySQL Cluster, cluster, hadoop, guide, evaluation, hdfs
    0 0 1 566 3230 Homework 26 7 3789 14.0 Normal 0 false false false EN-US JA X-NONE

    The MySQL Cluster (http://mysql.com/products/cluster/) product team is always interested to see new and innovative uses of the database. Last week, a team of students at the KTH Royal Institute

      [Read more...]
    Using MySQL Cluster to Protect & Scale the HDFS Namenode
    Employee_Team +4 Vote Up -0Vote Down
    posted by MySQL Community on Mon 19 Dec 2011 03:51 UTC
    Tags:
    (edit) mysql, MySQL Cluster, cluster, hadoop, guide, evaluation, hdfs
    0 0 1 566 3230 Homework 26 7 3789 14.0 Normal 0 false false false EN-US JA X-NONE

    The MySQL Cluster (http://mysql.com/products/cluster/) product team is always interested to see new and innovative uses of the database. Last week, a team of students at the KTH Royal Institute

      [Read more...]
    451 CAOS Links. 2011.12.02
    +0 Vote Up -0Vote Down
    posted by The 451 Group on Fri 02 Dec 2011 18:01 UTC
    Tags:
    (edit) mysql, software, Linux, Apache, opensource, Nginx, 451 group, 451caostheory, 451group, caostheory, matt aslett, mattaslett, matthew aslett, matthewaslett, open-source, The 451 Group, the451group, hadoop, TCO, talend, git, cloudera, rackspace, sourcesense, Bonitasoft, couchbase, LSE, marco abis, Open Ocean Capital, Wireless Innovation Forum, Zentyal

    Talend delivers v5. Zentyal raises series A. The TCO of OSS. And more.

    # Talend announced version 5 of its data integration suite, adding business process management capabilities via an OEM relationship with BonitaSoft. Yves De Montcheuil explained the name changes in version 5.

    # Zentyal closed a series A venture capital funding of over $1m by Open Ocean Capital.

      [Read more...]
    451 CAOS Links 2011.11.18
    +0 Vote Up -0Vote Down
    posted by The 451 Group on Fri 18 Nov 2011 16:33 UTC
    Tags:
    (edit) mysql, links, Linux, microsoft, eclipse, Google, opensource, amazon, 451 group, 451caostheory, 451group, caostheory, matt aslett, mattaslett, matthew aslett, matthewaslett, open-source, The 451 Group, the451group, hadoop, OpenSUSE, black duck, kindle, mongodb, redis, rapid7, HortonWorks, DotCloud, dryad, Fire

    Rapid7 secures new funding. Microsoft drops Dryad. And more.

    # Rapid7 secured $50m in series C funding.

    # Microsoft confirmed that it is ditching its Dryad project in favour of Apache Hadoop.

    # Arun Murthy provided more details of Apache Hadop 0.23.

    # The Google Plugin for Eclipse and GWT Designer projects are now fully open source.

    # openSUSE released version 12.1.

    # Amazon

      [Read more...]
    VC funding for Hadoop and NoSQL tops $350m
    +0 Vote Up -0Vote Down
    posted by The 451 Group on Tue 15 Nov 2011 16:39 UTC
    Tags:
    (edit) Linux, opensource, index, 451 group, 451caostheory, 451group, caostheory, matt aslett, mattaslett, matthew aslett, matthewaslett, open-source, The 451 Group, the451group, hadoop, Funding, 10gen, Accel, cloudera, big data, NoSQL, mongodb, riak, M&A, basho, datastax, couchbase, mapr, HortonWorks, total data, Neo Technology, opera solutions

    451 Research has today published a report looking at the funding being invested in Apache Hadoop- and NoSQL database-related vendors. The full report is available to clients, but non-clients can find a snapshot of the report, along with a graphic representation of the recent up-tick in funding, over at our Too Much Information blog.

    CAOS Theory Podcast 2011.11.11
    +0 Vote Up -0Vote Down
    posted by The 451 Group on Fri 11 Nov 2011 19:27 UTC
    Tags:
    (edit) Databases, Linux, podcast, opensource, caostheory, matt aslett, open-source, The 451 Group, the451group, data, spring, developers, hadoop, continuent, jay lyman, caos theory, Cfengine, NoSQL, devops, Neo Technology, admins, DBAs, Hadoop World

    Topics for this podcast:

    *Continuent extends MySQL replication to Oracle Database
    *CFEngine updates server automation software
    *Devops moving mainstream
    *Neo Technology integrates with Spring
    *451 CAOS report from Hadoop World

    iTunes or direct download (26:56, 4.6MB)

    Showing entries 1 to 30 of 93 Next 30 Older Entries

    Planet MySQL © 1995, 2013, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.