Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 24

Displaying posts with tag: mysqluc2008 (reset)

Horizontal Scaling with HiveDB
+0 Vote Up -0Vote Down

At the MySQL Conference & Expo 2008, Britt Crawford and Justin McCarthy, both from Cafepress.com, gave us a very interesting talk on scaling with HiveDB. I took a few notes (pasted below), their slides are online (warning: 6.1MB PDF), and if you’re after their abstract its available as well.

I also took a video of them (refer to Slide 12, for the IRC conversation):

The quick notes:

  • OLTP optimised (as it serves cafepress.com)
  • Cannot lock tables, or take it offline
  • Constant response time is more important than low latency (little slower query is ok, just
  [Read more...]
2008 MySQL Conference Videos, Notes, Slides and Photos!
+0 Vote Up -0Vote Down

All of the videos from the 2008 MySQL Conference have been processed and uploaded. Links to the videos, slides, notes, photos for each presentation are all on the mega-conference page at:
http://forge.mysql.com/wiki/MySQLConf2008Notes

This represents many hours of my own toil, but it also reflects plenty of people who have blogged, edited the wiki pages and speakers who wrote and gave tutorials and presentations. I am proud of everyone’s efforts to offer so many learning resources for free….

Enjoy! EDIT: I forgot to thank Jay, the folks at O’Reilly and all the speakers for giving me explicit permission to video and freely offer their presentations.

If you know of any video, audio, notes, slides, photos, etc that are not linked, please link them at the wiki


  [Read more...]
Baron Schwartz on a podcast at MySQL Conference and Expo 2008
+0 Vote Up -0Vote Down

I did an interview with Barton George from Sun while I was at the conference last week. Barton has now posted the interview. If you’re quick, you can listen to it before I do.

Topics: everything and anything, including Maatkit and PostgreSQL.

Baron Schwartz, Barton George, maatkit, mysqluc08, mysqluc2008, Podcast, Sun
MySQL Conference and Expo 2008, Day Three
+0 Vote Up -0Vote Down

Here’s a rundown of Thursday (day 3) of the MySQL Conference and Expo. This day’s sessions were much more interesting to me than Wednesday’s, and in fact I wanted to go to several of them in a single time slot a couple of times.

Inside the PBXT Storage Engine

This session was, as it sounds, a look at the internals of PBXT, a transactional storage engine for MySQL that has some interesting design techniques. I had been looking forward to this session for a while, and Paul McCullagh’s nice explanations with clear diagrams were a welcome aid to understanding how PBXT works. Unlike some of the other storage engines, PBXT is being developed in full daylight, with an emphasis on community involvement and input. (Indeed, I may be contributing to it myself, in order to make its monitoring

  [Read more...]
Notes on scaling heavy concurrent writes in real time
+0 Vote Up -0Vote Down

Here is the quick notes from the session scaling heavy concurrent writes in real time by Dathan Pattishall. Its bad that he left Flickr i.e. Yahoo. Hopefully they will find a replacement, if not contact me I have few people who are interested.

  • Who am I
    • since 1999 working on mysql (http://www.mysql.com)
    • scaled many companies (FriendFinder, Friendster, Flickr, now RockYou)
    • Favorites federation, partitioning, shards, RAID-10
  • Requirements
    • scale better
    • store data forever
    • associate time with the data
    • allow for change
    • keep it cheap
    • and downtime is not an option
  • Spread
  [Read more...]
Notes on InnoDB Scale on servers with many cores
+0 Vote Up -0Vote Down

Here is the quick notes from the session Helping InnoDB scale on servers with many cores by Mark Callaghan from Google (mcallaghan at google dot com).

  • we have a team now, to help scale MySQL (http://www.mysql.com) to do the enhancements (9 people,  I hope yahoo management reads this)
  • Overview
    • describe the problems on big servers
    • work done by InnoDB community
    • ask MySQL/InnoDB to fix the problems by taking the patches
  • Community team
    • InnoDB/Oracle
    • Google MySQL team
    • InnoDB community
    • Percona - Peter and Vadim
  • Goal
    • Fix bottlenecks on big SMP
    • utilize servers with many disks
    • support
  [Read more...]
Future design hurdles to tackle in MySQL Server
+0 Vote Up -0Vote Down

The Future of MySQL (http://www.mysql.com) by Monty Widenius and Jay Pipes.

  • Why this talk
    • MySQL and Sun should become more transparent
    • Easier to discuss and act when you have facts
    • when user know the limitations, they know how to go around
  • Threads
    • one connection/thread doesn’t work well
    • no priority threads
    • no way to ensure we have X threads
  • Symptoms
    • Too many context switches
    • we are not using multi-core efficiently
    • does not scale that well after 4-8 cores
  • Solution
    • –thread-handling=pool-of-threads (6.0)
  • Lots of work
  • Memory as a resource
    • no single memory allocator
  [Read more...]
MySQL Conference and Expo 2008, Day Two
+0 Vote Up -0Vote Down

Day two of the conference was a little disappointing, as far as sessions went. There were several time blocks where I simply wasn’t interested in any of the sessions. Instead, I went to the expo hall and tried to pry straight answers out of sly salespeople. Here’s what I attended.

Paying It Forward: Harnessing the MySQL Contributory Resources

This was a talk focused on how MySQL has made it possible for community members to contribute to MySQL. There was quite a bit of talk about IRC channels, mailing lists, and the like. However, the talk gave short shrift to how MySQL plans to become truly open source (in terms of its development model, not its license). I think there was basically nothing to talk about there. I had a good conversation about some of my concerns with the speaker and some others from MySQL right afterwards.

  [Read more...]
Notes from Social graph and the Database
+0 Vote Up -0Vote Down

From Jeff Rothschild, VP of technology, Facebook

  • The power of connectedness
  • Impact on the database
  • Our challenge 
    • The power of connectedness
      • photo tagging
      • getting an email that someone tagged a photo in Facebook
      • inter tagging between friends and it continues as a network
      • outstanding growth because of the photo tagging
      • 26B photos in archive now
      • Most trafficked photos applications than anybody else
      • events, invites impact on social graph
      • Opening up the social graph to outside and create a platform and API, so other developers can make use of it (28K applications so far)
      • Hypergrowth because of the platform (1M users in four days)
      • 200
      [Read more...]
    Notes on Benchmarking tools
    +0 Vote Up -0Vote Down

    Here is the list of MySQL (http://www.mysql.com) benchmarking tools that were discussed during the "Benchmarking tools" session today.

      [Read more...]
    Notes from Architecture of Maria Storage Engine
    +0 Vote Up -0Vote Down

    Here is the quick notes from the session “Architecture of Maria” from Monty Widenius, one of my all time favorite developer and founder of MySQL (http://www.mysql.com).

    • Goals
      • To create ACID complaint and Multi-version concurrency control (MVCC)  transactional storage engine for MySQL
      • To replace existing replacement for MyISAM and if possible the default transactional database
      • Maria can run in both transactional and non-transactional, so its easy to replace existing transactional and non-transactional engines
      • To create a storage engine which is good for data warehousing (DW) purposes
    • Why Falcon and Maria
      • two different architectures
      • different in feature, compatibility, performance
      • Target is for data warehousing
    • Project plan
      • 5.1
      [Read more...]
    Notes from Falcon from the beginning
    +0 Vote Up -0Vote Down

    Here is the quick notes from the session Falcon from the beginning by Jim Starkey and Ann Harrison

    • Why Falcon
      • Hardware is evolving rapidly, world is changing, so taking advantage
      • Customers need ACID transactions
    • Where hardware is going
      • CPUS breed like rabbits (more sockets, cores, threads/core)
      • Memory is bigger, faster and cheaper
      • Disks are bigger and cheaper but not much faster
      • In general boxes are getting cheaper
    • Where applications are going
      • batch - dead
      • timesharing - dead
      • departmental computing - dead
      • client server - fading fast
      • application servers for most of us
      • web services for the really big buys
    • Database Challenges
        [Read more...]
      Notes from Scaling MySQL - Up or Out
      +0 Vote Up -0Vote Down

      Here is the quick notes from the session Scaling MySQL (http://www.mysql.com) - Up or Out ? moderated by Kaj Arno as part of the todays keynote.

      Here is the list of panelists are ordered by Alexa ranking.

    • Monty Taylor (MySQL (http://www.mysql.com))
    • Matt Ingerenthron (Sun)
    • John Allspaw (Flickr)
    • Farhan Mashraqi (Fotolog)
    • Domas Mituzas (Wkipedia)
    • Jeff Rotheschild (Facebook)
    • Paul Tuckfield (YouTube)
    • Here is the list of questions and answers from panelists:

        How many servers Number of  [Read more...]
      Get a free sample chapter of High Performance MySQL Second Edition
      +0 Vote Up -0Vote Down

      If you’re at the MySQL Conference and Expo, you can get a free sample chapter of the upcoming High Performance MySQL Second Edition. Just go to the exhibition area. As you go through the doors, take an immediate left and look for the sample chapter on O’Reilly’s table. It’s a rough draft and contains typos and my incredibly crude drawings instead of those that will go into the final book, but it should serve to give you an idea of the book’s depth and scope. Kudos to Andy Oram, our editor, who was able to get these done for us on very short notice.

      Andy Oram, mysqluc2008
      MySQL Conference and Expo 2008, Day One
      +0 Vote Up -0Vote Down

      Today is the first day at the conference (aside from the tutorials, which were yesterday). Here’s what I went to:

      New Subquery Optimizations in 6.0

      By Sergey Petrunia. This was a similar session to one I went to last year. MySQL has a few cases where subqueries are badly optimized, and this session went into the details of how this is being addressed in MySQL 6.0. There are several new optimization techniques for all types of subqueries, such as inside-out subqueries, materialization, and converting to joins. The optimizations apply to scalar subqueries and subqueries in the FROM clause. Performance results are very good, depending on which data you choose to illustrate. The overall point is that the worst-case subquery nastiness should be resolved. I’m speaking of WHERE NOT IN(SELECT…) and friends. It remains to be seen how

        [Read more...]
      Notes from InnoDB status, architecture and new features
      +0 Vote Up -0Vote Down

      Here is the notes from “InnoDB status, architecture and new features” by Heikki Tuuri and Ken Jocobs.

      • Introduction
        • fast
          • row-level locking, MVCC -> high concurrency & throughput
          • high performance CPU, memory and I/O architecture
          • efficient indexing (covering)
        • reliable
          • automatic crash recovery
          • integrated referencial integrity and transactions
          • online backup
          • well written, well tested and large user community
      • New in 5.1
        • plugin 1.0 announced
        • can be usable with partitioning, row based replication
        • reduced “next-key”
        [Read more...]
      Notes from Online MySQL Backup in 6.0
      +0 Vote Up -0Vote Down

      Here is the notes from MySQL (http://www.mysql.com) online backup in 6.0 session by Dr. Charles A. Bell, the Author of MySQL Expert book.

      • Introduction
        • SQL Driven, run from any client
        • backup to localhost
        • new security privileges for backup/restore
        • blocking restore
        • non-blocking backup for Innodb, Falcon etc
      • Overview
        • protection and restore
        • basic functionality of backup and restore available now
        • db level -> table, views, sps, functions, … are supported
        • 6.0.5 has it already, try it
        • source code is another way to look into it
      • Design
        • ent level consistency between engines
        • default driver for engines that don’t support backup
        • consistent snapshot
        • storage engine specific
        [Read more...]
      A different angle on the MySQL Conference
      +0 Vote Up -0Vote Down

      There are quite a few business angles you might see only if you’re here at the conference, and you won’t get from blogs. For example, let’s take a look at the contents of the shoulder bags they hand out with your registration. (This is only a partial list.)

      • SnapLogic’s flyer gets it right: their system is compatible with “GNU Linux.” Hooray, a commercial company acknowledging the GNU operating system for what it is!
      • MySQL Enterprise’s flyer has three big bullet points: MySQL Load Balancer, MySQL Connection Manager, and MySQL Enterprise Monitor Query Analyzer. The first two look like they’re probably built on MySQL Proxy. The last has a visual explain plan feature, which according to an elevator conversation is not yet built. I’ll stop by their booth and see. As you may know,
        [Read more...]
      Notes from MySQL Cluster
      +0 Vote Up -0Vote Down

      Here is the quick notes from MySQL (http://www.mysql.com) Cluster by Stewart Smith session that I attended today in the MySQL conference 2008.

      • What it is
        • Clustering of in memory databases in a shared-nothing system
        • Designed for HA, 99.9% Uptime (not really) and sub-second failover
        • Supports Hot (online) consistent backup along with compression
        • No locks are used during the backup as NDB uses a global counters
      • Think as virtual file system
      • Redundancy
        • NoOfReplicas (1,2,3,4), For production use 1 or 2 but don’t use any other as it may have bugs (2 is preferred and well tested mode)
        • 1 means no redundancy (a node fails and cluster fails)
        • 2 means two copies
      • High performance (due to parallelism)
      • In memory only
        [Read more...]
      Sessions I want to see at the MySQL Conference
      +0 Vote Up -0Vote Down

      This year’s conference has a great lineup. As usual, with 8 sessions concurrently, it’s impossible to pick which ones I want to see. However, I did learn a few things from last year’s conference, which I think will help me get more out of it this time.

      Number one rule: not all sessions are created equal. I can’t say for sure, but I’m pretty sure that when you see “How Product X Will Scale Your Databases” presented by a person from Company X, you can reasonably suspect that Company X is paying for this privilege, and it’s not really a session as much as a product demo. These sessions were not reviewed and voted on by the community (I know, because I was one of the community members who were asked to review and vote on proposals. Maybe I’m being a whistle-blower and won’t get this honor next

        [Read more...]
      Kickfire: stream-processing SQL queries
      +0 Vote Up -0Vote Down

      Some of you have noticed Kickfire, a new sponsor at this year’s MySQL Conference and Expo. Like Keith Murphy, I have been involved with them for a while now. This article explains the basics of how their technology is different from the current state of the art in complex queries on large amounts of data.

      Kickfire is developing a MySQL appliance that combines a pluggable storage engine (for MySQL 5.1) with a new kind of chip. On the surface, the storage engine is not that revolutionary: it is a column-store engine with data compression and some other techniques to reduce disk I/O, which is kind of par for the course in data warehousing today. The chip is the really exciting part of the technology.

        [Read more...]
      Remember to sign up for MySQL Conference and Expo!
      +0 Vote Up -0Vote Down

      You have only a few more days to sign up for the MySQL Conference and Expo before the early-bird discount goes away. Check out the schedule of speakers and tutorials, and sign up soon! And just in case you didn't get one from any of the other people blogging about it, you can email me for a code that's good for a 20% discount.

      I'm presenting two sessions: one on the query cache, and one on EXPLAIN. Both are manageable for an hour-or-so talk. I'm not trying to boil the ocean, but rather to help you understand these important topics in ways you'll remember after leaving the conference.

      I was also on the voting committee for the proposals, so I've read them all. I really believe this event is worth every penny. (Of course, as a

        [Read more...]
      My presentations at the 2008 MySQL Conference and Expo
      +0 Vote Up -0Vote Down

      I'll be attending the 2008 MySQL Conference and Expo again this year, and I'm looking forward to hearing some great sessions, meeting new and old friends, and giving sessions myself. As a proposal reviewer, I looked at and voted on 250+ proposals for sessions and tutorials for this conference. There are going to be some great sessions and tutorials.

      How to get your session accepted to MySQL Conference 2008
      +0 Vote Up -0Vote Down

      I'm on the select board of elite people who were duped into reviewing proposals for the upcoming MySQL Conference and Expo 2008, and I'm here to tell you how to get your proposal accepted. Aside from bribing me with chocolate, that is.

      Showing entries 1 to 24

      Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

      Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.