Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Previous 30 Newer Entries Showing entries 31 to 60 of 126 Next 30 Older Entries

Displaying posts with tag: hadoop (reset)

On Oracle NoSQL Database –Interview with Dave Segleau.
+0 Vote Up -0Vote Down
“We went down the path of building Oracle NoSQL database because of explicit request from some of our largest Oracle Berkeley DB installations that wanted to move away from maintaining home grown sharding implementations and very much wanted an out of box technology that can replicate the robustness of what they had built “out of [...]
What technologies are you running alongside MySQL?
+2 Vote Up -0Vote Down

In many environments MySQL is not the only technology used to store in-process data.

Quite frequently, especially with large-scale or complicated applications, we use MySQL alongside other technologies for certain tasks of reporting, caching as well as main data-store for portions of application.

What technologies for data storage and processing do you use alongside MySQL in your environment? Please feel free to elaborate in the comments about your use case and experiences!

Note: There is a poll embedded within this post, please visit the site to participate in this post's poll.

The post

  [Read more...]
On PostgreSQL. Interview with Tom Kincaid.
+0 Vote Up -1Vote Down
“Application designers need to start by thinking about what level of data integrity they need, rather than what they want, and then design their technology stack around that reality. Everyone would like a database that guarantees perfect availability, perfect consistency, instantaneous response times, and infinite throughput, but it´s not possible to create a product with [...]
MySQL Applier For Hadoop: Implementation
Employee +4 Vote Up -0Vote Down

This is a follow up post, describing the implementation details of Hadoop Applier, and steps to configure and install it. Hadoop Applier integrates MySQL with Hadoop providing the real-time replication of INSERTs to HDFS, and hence can be consumed by the data stores working on top of Hadoop. You can know more about the design rationale and per-requisites in the previous post.

Design and Implementation:

Hadoop Applier replicates rows inserted into a table in MySQL to the Hadoop Distributed File System(HDFS). It uses an API provided by libhdfs, a C library to manipulate files in HDFS.

The library comes pre-compiled with Hadoop distributions.It






  [Read more...]
The Data Day, A few days: April 22-26 2013
+0 Vote Up -0Vote Down

Pivotal launches. SkySQL and Mony Program merge. And much, much more

Our report on the changes in the MySQL ecosystem is now available for 451 clients and non-clients alike at bit.ly/451mysql

— Matt Aslett (@maslett) April 25, 2013

For 451 Research clients: VMware expands Serengeti’s horizons with updated Hadoop virtualization project bit.ly/17muQFI

— Matt Aslett (@maslett) April 26, 2013

For 451 Research clients: SkySQL, Monty Program merge to support MariaDB following formation of MariaDB Foundation bit.ly/10dsdjf

  [Read more...]
Biggest MySQL related news in the last 24 hours, Day 2
+1 Vote Up -2Vote Down

Continuing on from yesterday, the biggest news that I’ve noted in the past 24 hours:

  • The commitment from Oracle’s MySQL team to release a new GA about once every 24 months, with a Developer Milestone Release (DMR), with “GA quality” every 4-6 months. Tomas Ulin announced MySQL 5.7 DMR1 (milestone 11) [download, release notes, manual]. He also announced MySQL Cluster 7.3 DMR2 [download,
  •   [Read more...]
    MySQL Applier For Hadoop: Real time data export from MySQL to HDFS
    Employee +2 Vote Up -0Vote Down

    MySQL replication enables data to be replicated from one MySQL database server (the master) to one or more MySQL database servers (the slaves). However, imagine the number of use cases being served if the slave (to which data is replicated) isn't restricted to be a MySQL server; but it can be any other database server or platform with replication events applied in real-time! 
    This is what the new Hadoop Applier empowers you to do.
    An example of such a slave could be a data warehouse system such as Apache Hive, which uses HDFS as a data store. If you have a Hive metastore associated with HDFS(Hadoop Distributed File System), the Hadoop Applier can populate Hive


      [Read more...]
    Announcing the MySQL Applier for Apache Hadoop
    Employee_Team +5 Vote Up -0Vote Down

    Enabling Real-Time MySQL to HDFS Integration

    Batch processing delivered by Map/Reduce remains central to Apache Hadoop, but as the pressure to gain competitive advantage from “speed of thought” analytics grows, so Hadoop itself is undergoing significant evolution. The development of technologies allowing real time queries, such as Apache Drill, Cloudera Impala and the Stinger Initiative are emerging, supported by new generations of resource management with Apache YARN

    To support this growing emphasis on real-time operations, we are releasing a new

      [Read more...]
    Deploying Cloudera Impala on EC2 with Example Live Demo
    +0 Vote Up -0Vote Down

    A little while ago I blogged about (and open sourced) an Impala-powered soccer visualization demo, designed to demonstrate just how responsive Impala queries can be. Since not everyone has the time or resources to run the project themselves, we’ve decided to host it ourselves on an EC2 instance. You can try the visualization; we’ve also opened up the Impala web interface, where you can see query profiles and performance numbers, and Hue (username and password are both ‘test’), where you can run your own queries on the dataset.

    Deploying  [Read more...]

    The Data Day, Two days: February 11/12 2013
    +0 Vote Up -0Vote Down

    ClearStory sheds light on data analysis service. Illuminating ‘dark data’. More.

    For 451 clients: ClearStory bags $9m in series A funding, sheds light on its data analysis service bit.ly/Y6v8sV By Krishna Roy

    — Matt Aslett (@maslett) February 12, 2013

    For 451 clients: Global IDs makes ‘big data’ MDM play via cloud and Hadoop, touts profitable growth bit.ly/Y6v6kL By Krishna Roy

    — Matt Aslett (@maslett) February 12, 2013

    ScaleBase releases version 2.0 of its MySQL database scalability software bit.ly/WGtEtN

      [Read more...]
    MySQL-State of the Union. Interview with Tomas Ulin.
    +8 Vote Up -0Vote Down
    “With MySQL 5.6, developers can now commingle the “best of both worlds” with fast key-value look up operations and complex SQL queries to meet user and application specific requirements” –Tomas Ulin. On February 5, 2013, Oracle announced the general availability of MySQL 5.6. I have interviewed Tomas Ulin, Vice President for the MySQL Engineering team [...]
    The Data Day, Two days: February 7/8 2013
    +0 Vote Up -0Vote Down

    Teradata results. Funding for DataXu. The chemistry of data. And more.

    For 451 Research clients: Oracle launches major update to MySQL open source database bit.ly/TSONAt

    — Matt Aslett (@maslett) February 8, 2013

    For 451 clients: Analyzing the chemistry of data bit.ly/TSOV2R By @451wendy Treating sensitive data like dangerous chemicals

    — Matt Aslett (@maslett) February 8, 2013

    Teradata: Q4 net income $112m on revenue up 10% to $740m, FY net income $419m on revenue up 13% to $2.7bn. bit.ly/14FNS8L

      [Read more...]
    Data Science vs. Data Analytics
    +1 Vote Up -0Vote Down
    As this topic came up a few times this week for discussion at various places, I thought of composing a post on “Data Scientist vs. Data Analytics Engineer”; even though[...]
    On Big Data, Analytics and Hadoop. Interview with Daniel Abadi.
    +0 Vote Up -0Vote Down
    “Some people even think that “Hadoop” and “Big Data” are synonymous (though this is an over-characterization). Unfortunately, Hadoop was designed based on a paper by Google in 2004 which was focused on use cases involving unstructured data (e.g. extracting words and phrases from Webpages in order to create Google’s Web index). Since it was not [...]
    Distributed Clustering Services
    +0 Vote Up -0Vote Down
    Apart from my consulting as part of ScaleIn, I also invest to bootstrap companies with really disruptive ideas; and in the process met few database specific companies who are already[...]
    Typical “Big” Data Architecture
    +1 Vote Up -0Vote Down
    Here is the typical “Big” data architecture, that covers most components involved in the data pipeline. More or less, we have the same architecture in production in number of places[...]
    MySQL and Hadoop Integration - Unlocking New Insight
    Employee_Team +4 Vote Up -0Vote Down

    “Big Data” offers the potential for organizations to revolutionize their operations. With the volume of business data doubling every 1.2 years, analysts and business users are discovering very real benefits when integrating and analyzing data from multiple sources, enabling deeper insight into their customers, partners, and business processes.

    As the world’s most popular open source database, and the most deployed database in the web and cloud, MySQL is a key component of many big data platforms, with Hadoop vendors estimating 80% of deployments are integrated with MySQL.

    The new Guide to MySQL and Hadoop (http://www.mysql.com/why-mysql/white-papers/mysql_wp_hadoop.php) presents the tools enabling integration between the two data platforms, supporting the data lifecycle from

      [Read more...]
    Two Cons against NoSQL. Part I.
    +1 Vote Up -1Vote Down
    Two cons against NoSQL data stores read like this: 1. It’s very hard to move data out from one NoSQL to some other system, even other NoSQL. There is a very hard lock in when it comes to NoSQL. If you ever have to move to another database, you have basically to re-implement a lot [...]
    Log Buffer #279, A Carnival of the Vanities for DBAs
    +0 Vote Up -0Vote Down
    In a typical organization, all work together to bring out a common good for the outside world. It’s interesting to see how all of these entities blog about technology, and there is more and more interest shown by managerial technologists about the database. This Log Buffer Edition appeases their appetites along with the others in [...]
    MySQL and Hadoop
    Employee_Team +2 Vote Up -0Vote Down

    Introduction

    "Improving MySQL performance using Hadoop" was the talk which I and Manish Kumar gave at Java One & Oracle Develop 2012, India. Based on the response and interest of the audience, we decided to summarize the talk in a blog post. The slides of this talk can be found here. They also include a screen-cast of a live Hadoop system pulling data from MySQL and working on the popular 'word count' problem.



    MySQL and Hadoop have been popularly considered as 'Friends with benefits' and our talk was aimed at showing how!



      [Read more...]
    So now Hadoop's days are numbered?
    +3 Vote Up -0Vote Down
    Earlier this week we all read GigaOM's article with this title:
    "Why the days are numbered for Hadoop as we know it"
    I know GigaOM like to provoke scandals sometimes, we all remember some other unforgettable piece, but there is something behind it...

    Hadoop today (after SOA not so long ago) is one of the worst case of an abused buzzword ever known to men. It's everything, everywhere, can cure illnesses and do "big-data" at the same time! Wow! Actually Hadoop is a software framework that supports data-intensive distributed applications, derived from Google's MapReduce and Google File System (GFS) papers.

    My take from the article is




      [Read more...]
    A super-set of MySQL for Big Data. Interview with John Busch, Schooner.
    +0 Vote Up -0Vote Down
    “Legacy MySQL does not scale well on a single node, which forces granular sharding and explicit application code changes to make them sharding-aware and results in low utilization of severs”– Dr. John Busch, Schooner Information Technology A super-set of MySQL suitable for Big Data? On this subject, I have interviewed Dr. John Busch, Founder, Chairman, [...]
    Open APIs are the new open source
    +1 Vote Up -0Vote Down

    We’ve seen the rise of open source software in the enterprise and also beyond the IT industry, but the real keys to openness and its advantages in today’s technology world — where efficient use of cloud computing and supporting services are paramount — exist in open application programming interfaces, or APIs.

    Open source software continues to be a critical part of software development, systems administration, IT operations and more, but much of the action in leveraging modern cloud computing and services-based infrastructures centers on APIs. Open APIs are the new open source.

    Read the full story at LinuxInsider.

    OSSCube adds one more Cloudera Certified Developer in its Armor
    +0 Vote Up -0Vote Down

    OSSCube has now one more Cloudera Certified Developer for Apache Hadoop. Rakesh Kumar has become the Cloudera Certified Developer through the CCDH, the industry's only certification for software developers on Hadoop. He passed the Cloudera Certified Developer for Apache Hadoop exam after going through a rigorous training program.

    Rakesh is also a MySQL certified DBA and Cluster DBA and has trained several engineers for Zend Certification Examinations.

    Tags: ClouderaHadoop
    OSSCube adds one more Cloudera Certified Developer in its Armor
    +0 Vote Up -0Vote Down

    OSSCube has now one more Cloudera Certified Developer for Apache Hadoop. Rakesh Kumar has become the Cloudera Certified Developer through the CCDH, the industry's only certification for software developers on Hadoop. He passed the Cloudera Certified Developer for Apache Hadoop exam after going through a rigorous training program.

    Rakesh is also a MySQL certified DBA and Cluster DBA and has trained several engineers for Zend Certification Examinations.

    Tags: ClouderaHadoop
    Vote for MySQL[plus] awards 2011 !
    +5 Vote Up -0Vote Down

    First of all, I wish you a happy new year.
    Many things happened last year, it was really exciting to be involved in the MySQL ecosystem.
    I hope this enthusiasm will be increased this year, up to you !

    To start the year, I propose the MySQL[plus] Awards 2011
    It will only take 5 minutes to fill out these polls.
    Answer with your heart first and then with your experience with some of these tools or services.

    Polls will be closed January 31, so, vote now !
    For “other” answers, please,  let me a comment with details.

    Don’t hesitate to submit proposal for tools or services in the comments.






      [Read more...]
    Fake O'Reilly Covers
    +3 Vote Up -1Vote Down



    Here are some of the fake O'Reilly book covers I mentioned in a prior post.  These have been optimized for use as black & white Kindle screensaver wallpaper images.  If you haven't done so already, you can install a Kindle screensaver hack with a couple of downloads. 

    Update: I've embedded a slideshow from PicasaWeb, but it requires Flash.  If you don't see it you can click on the links below to go directly to



      [Read more...]
    Using MySQL Cluster to Protect & Scale the HDFS Namenode
    Employee_Team +0 Vote Up -0Vote Down
    0 0 1 566 3230 Homework 26 7 3789 14.0 Normal 0 false false false EN-US JA X-NONE

    The MySQL Cluster (http://mysql.com/products/cluster/) product team is always interested to see new and innovative uses of the database. Last week, a team of students at the KTH Royal Institute

      [Read more...]
    Using MySQL Cluster to Protect & Scale the HDFS Namenode
    Employee_Team +4 Vote Up -0Vote Down
    0 0 1 566 3230 Homework 26 7 3789 14.0 Normal 0 false false false EN-US JA X-NONE

    The MySQL Cluster (http://mysql.com/products/cluster/) product team is always interested to see new and innovative uses of the database. Last week, a team of students at the KTH Royal Institute

      [Read more...]
    451 CAOS Links. 2011.12.02
    +0 Vote Up -0Vote Down

    Talend delivers v5. Zentyal raises series A. The TCO of OSS. And more.

    # Talend announced version 5 of its data integration suite, adding business process management capabilities via an OEM relationship with BonitaSoft. Yves De Montcheuil explained the name changes in version 5.

    # Zentyal closed a series A venture capital funding of over $1m by Open Ocean Capital.

      [Read more...]
    Previous 30 Newer Entries Showing entries 31 to 60 of 126 Next 30 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.