Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 30 of 69 Next 30 Older Entries

Displaying posts with tag: blogging (reset)

5 Reasons Devops Should Blog
+0 Vote Up -0Vote Down

Join 9500 others and follow Sean Hull on twitter @hullsean.

1. Stand up and be heard

Years ago I was sitting on an online forum chatting with an Oracle buddy of mine. This was circa 1998. We were working on an open source tool to interface with Oracle. There were all these libraries, for PHP & Perl, and a lot of developers starting to build tools. We hatched this hair brained idea to write a book about all of this, and pitched it to O’Reilly. They loved it and thus was born the book Oracle & Open Source in 2001.

Writing a book was, is and always will be a lot of work. It was a great learning

  [Read more...]
MySQL community blogging – PlanetMySQL – Part 2
+3 Vote Up -0Vote Down

After last week’s post about bloggin trends, this week I will go through the most active bloggers over the years as well as particularly for 2010.

What is the range of time analysed here?

mysql >  select min(date_time), max(date_time) from blogs;
| min(date_time)      | max(date_time)      |
| 2004-03-04 19:47:00 | 2011-01-07 13:22:00 |
1 row in set (0.04 sec)

How many blog posts in the above period (almost 7years)?

mysql >  select count(*) from blogs;
| count(*) |
|    21698 |
1 row in set (0.00 sec)

How many

  [Read more...]
MySQL community blogging – PlanetMySQL
+4 Vote Up -0Vote Down

Phew, here we go, this blog post has been long time coming! A few months ago I started toying around with the idea of analyzing the PlanetMySQL public blog feed. It doesn’t take long to extract the data and prepare it for analysis but between lots of work and procrastination this blog post was left unfinished.

It was partly out of pure curiosity and partly the fact that it seemed to me there were less posts than previous years that I decided to trend out the number of posts over the past years and here we go.

The blue line shows the blog posts per month over the past six years and the black line is a polynomial

  [Read more...]
Welcome googleCL
+7 Vote Up -0Vote Down
I am writing this blog post with Vim, my favorite editor, instead of using the online editor offered by blogger. And I am uploading this post to my Blogger account using Google CL a tool that lets you use Google services from the command line.
I am a command line geek, and as soon as I saw the announcement, I installed it in my laptop. The mere fact that you are reading this blog post shows that it works.
GoogleCL is an apparently simple application. If you install it on Mac using macports you realize how many dependencies it has and how much complexity it gives under the hood.

  [Read more...]
Four short links: 31 March 2010
+0 Vote Up -0Vote Down

  • ZeroMQ -- bold claim of "Fastest. Messaging. Ever." LGPL, C++ with bindings for many languages, past version 2 already. (via edd on Twitter)
  • Prediction Market News (David Pennock) -- HSX is going to be a real marketplace with real $. The real HSX will of course say goodbye to the virtual specialist and the opening weekend adjust, two facets of the game that make it fun to play, but that create significant amounts of (virtual) wealth out of thin air. The Cantor Gaming group is engaged in other interesting initiatives. They are taking over a sportsbook in Las Vegas and turning it into more of a derivatives exchange with live in-game betting, a step toward my dream of a geek-friendly
  •   [Read more...]
    Announcing TokuDB 2.2.0
    +3 Vote Up -0Vote Down

    Tokutek is pleased to announce the general availability of TokuDB for MySQL, version 2.2.0.  This version offers several improvements:

    • Better multi-core load balancing for concurrent workloads.

    • Faster bulk loading performance.

    • Enhanced diagnostics for easier tuning and troubleshooting.

    • Fixed all known bugs.

    About TokuDB

    TokuDB for MySQL is a storage engine built with Tokutek’s Fractal Tree technology. TokuDB provides near seamless compatibility for MySQL applications. Tables can be individually defined to use TokuDB, MyISAM, InnoDB or other MySQL-compliant storage engines. Data is loaded, inserted, and queried using standard MySQL commands, with no restrictions or special requirements. Our Fractal Tree technology indexes up to 50

      [Read more...]
    Using Gearman for Nightly Build and Test
    +3 Vote Up -0Vote Down

    At Tokutek, Rich Prohaska used
    Gearman to automate our nightly build and
    test process for TokuDB for MySQL.  Rich is busy working on TokuDB, so I’m
    writing up an overview of the build and test architecture on his behalf.

    Build and Test Process

    Rich created a script, nightly.bash, that gets kicked off every night as a cron
    job.  Nightly.bash creates a separate Gearman job for each build target.
    We have a separate build target (unique binary) for each combination of
    operating system (e.g. Linux, Windows, etc.) and HW architecture (e.g.
    i686, x86_64) supported by TokuDB.  As we support more operating
    systems over time, the

      [Read more...]
    +0 Vote Up -0Vote Down

    For those who wonder why my blogging is so low these days (apart from today) .. I`m actually writing more Lines of Code than Blog Entries the last couple of weeks:)

    And when I`m not writing code I`m reading :) Either proofreading an upcoming book on Zabbix or reading some of the other books Packt sent me.

    Next to that I`m busy preparing my T-Dose presentation

    Oh and did I mention a 40 something questions questionnaire about some merger ?

    Technorati Tags:   [Read more...]
    Announcing TokuDB 2.1.0
    +2 Vote Up -0Vote Down

    Tokutek® announces the release the release of the TokuDB storage engine for MySQL®, version 2.1.0.  This release offers the following improvements over our previous release:

    • Faster indexing of sequential keys.
    • Faster bulk loads on tables with auto-increment fields.
    • Faster range queries in some circumstances.
    • Added support for InnoDB.
    • Upgraded from MySQL 5.1.30 to 5.1.36.
    • Fixed all known bugs.

    About TokuDB

    TokuDB for MySQL is a storage engine built with Tokutek’s Fractal Tree™ technology. TokuDB provides near seamless compatibility for MySQL applications. Tables can be individually defined to use TokuDB, MyISAM, InnoDB® or other MySQL-compliant storage engines. Data is loaded, inserted, and queried using standard MySQL commands, with no restrictions or

      [Read more...]
    Fractal Trees May Be Useful for Making Energy-Efficient Databases
    +1 Vote Up -0Vote Down

    On April 9-10 the National Science Foundation hosted the Workshop on the Science of Power Management (SciPM 2009), where I gave an invited talk. Here I give a brief summary of my talk along with a pointer to the slides.

    The talk describes how MySQL with TokuDB can provide a path to more energy-efficient database implementations. It’s a theoretical talk. That is, rather than presenting results from an existing implementation, it provides food for thought about future possibilities.

    Here’s an executive summary of the talk.

    Disks use a substantial fraction of the computing power in a typical database application. Although different workloads and configurations can give very different values, somewhere around 1/3 to 2/3

      [Read more...]
    A Second Rule of Thumb for Choosing Column Order in Indexes
    +0 Vote Up -0Vote Down

    A couple of weeks ago, Baron Schwartz wrote an interesting post describing a rule of thumb he sometimes uses to choose the order of columns in an index. In a nutshell, he recommends putting highly selective columns first. This is a very good rule of thumb.

    I would like to add another rule of thumb: columns that are used for equality comparisons are better than columns that are used for range queries.

    If one has a query “select count(*) from foo where a BETWEEN 10 and 20 and b=5”, an index of (b,a) will always be as good, and likely better, than an index of (a,b), regardless of the selectivity of “a” or “b”.

    This is because of how MySQL performs range queries. For an index of

      [Read more...]
    Search the planetary archives, and tag your blog entries
    Employee +3 Vote Up -0Vote Down

    A particular blog entry usually feels relevant and topical when fresh, at least to the author. So let’s say a blog entry even carries some non-zero long-term value. How do you find it after a while? And more importantly, how will your readers find your blog entry?

    Descriptive subjects go a long way. But your readers may be searching for “development model” when your header says “release plan”. And even if you anticipate the search words used by your readers, you can only pick one wording for your header.

    Full-text search also helps. There’s now a brand new Search field in the top left corner of Planet MySQL. Chances are you’ll

      [Read more...]
    Introducing Multiple Clustering Indexes
    +0 Vote Up -1Vote Down

    In this posting I’ll describe TokuDB’s multiple clustering index feature.  (This posting is by Zardosht.)

    In general (not just for TokuDB) a clustered index or a clustering index is an index that stores the all of the data for the rows.  Quoting the MySQL 5.1 reference manual:

    Accessing a row through the clustered index is fast because the row data is on the same page where the index search leads. If a table is large, the clustered index architecture often saves a disk I/O operation when compared to storage organizations that store row data using a different page from the index record.

    Most storage engines allow at most one clustered index for each table. For example, MyISAM does not support

      [Read more...]
    Publications Related to Fractal Tree Indexing
    +1 Vote Up -0Vote Down

    The TokuDB storage engine for MySQL employs Fractal Tree technology.  We’ve been planning to write a white paper explaining how fractal tree indexing works, but haven’t gotten to it yet.  In the mean time, here are links to some academic papers that relate to our technology.

    • Cache-Oblivious B-Trees by Michael A. Bender, Erik D. Demaine and Martin Farach-Colton in SICOMP 35:2, pp. 341-358, 2005.  An early version of this paper appeared in FOCS in 2000.

    • The Cost of Cache-Oblivious Searching by Michael A. Bender, Gerth Stlting Brodal, Rolf Fagerberg, Dongdong Ge, Simai He, Haodong Hu, John Iacono, and Alejandro López-Ortiz in FOCS 2003 p. 271.

      [Read more...]
    Covering Indexes: Orders-of-Magnitude Improvements
    +1 Vote Up -0Vote Down

    The talk I gave at the Percona Performance Conference at the MySQL
    Users Conference in April 2009 can be found
    at http://tokutek.com/images/blog/mysqluc09/kuszmaul-mysqluc-percona-09-slides.pdf.

    This talk provides some examples where covering indexes help, and
    then describes a performance model that can be used to understand and
    predict query performance.  It covers clustering indexes (which are a
    kind of “universal” covering index), and describes the asymptotic
    performance of Fractal Tree indexing (but sorry, it doesn’t yet
    explain how Fractal Tree indexes work.) We’re working on writing a

      [Read more...]
    Presenting and blogging in Chinese
    Employee +0 Vote Up -0Vote Down

    Travelling to Hongkong and Taipei has made such an impression on me, that I couldn’t help but add two new blogs to my homepage kaj.arno.fi:

    Guanxi means “relations”, as in “Community Relations”. It’s also a very common word describing how to get things done in China. It even has its

      [Read more...]
    The Depth of a B-tree
    +1 Vote Up -0Vote Down

    Schlomi Noach recently wrote a useful primer on the depth of B-trees and how that plays out for point queries—in both clustered indexes, like InnoDB, and in unclustered indexes, like MyISAM.  Here, I’d like to talk about the effect of B-tree depth on insertions and range queries.  And, of course, I’ll talk about alternatives like Fractal Trees, since that’s the basis of Tokutek’s storage engine for MySQL.

    Please see Schlomi’s post for details, but I can summarize a few points, partly because I need some vocabulary for the points I’d like to make below.  Scholmi notes that there are two main features determining the depth of a B-tree (or B+-tree):

  • The number of rows in the database.  We’ll call that N.

  •   [Read more...]
    High Anxiety Whenever You’re Near
    +1 Vote Up -0Vote Down

    Every time I visit the Sun Santa Clara Campus, I’m reminded of Mel
    Brooks’s movie “High Anxiety”.  The campus was known as The Great
    Asylum for the Insane in the 19th century, and even includes a tower. 

    High Anxiety,
    whenever you’re near.
    High Anxiety,
    it’s you that I fear.

    I went to the MySQL Storage Engine (SE) Summit held on the Sun
    campus in Santa Clara.  I thought it was a great meeting, and many
    thanks to Sanjay for inviting us.  Also attending from Tokutek were
    Zardosht and Tom.  We heard interesting points of view from SE
    implementers such as Akiba, ScaleDB, InnoDB, PBXT, and Virident, as
    well as from the Sun/MySQL implementors.  Here are a few highlights:

    Everyone agrees that

      [Read more...]
    TokuDB Storage Engine for MySQL
    +0 Vote Up -0Vote Down

    Tokutek officially announced the TokuDB for MySQL v2.0 Storage Engine, v2.0 on April 16th, 2009.  TokuDB uses Fractal Tree (TM) technology to boost MySQL performance for users challenged with interactive querying in high volume, always-on applications.  As a pure SW storage engine, TokuDB provides drop-in compatibility for existing MySQL code and applications.  Curt Monash posted an introduction to Fractal Tree technology over on Monash Research’s DBMS2 blog.  TokuDB is available for evaluation under our

      [Read more...]
    Improving TPC-H-like Queries - Q2
    +0 Vote Up -0Vote Down
    Posted by: Bradley C. Kuszmaul and David Wells

    Executive Summary: A MySQL straight join can speed up a query that is very similar to TPC-H Q2 by a factor of 159 on MySQL. Posted by Bradley C. Kuszmaul and David Wells

    Executive Summary: A MySQL straight join can speed up a query that is very similar to TPC-H Q2 by a factor of 159 on MySQL.

    Recently, we began looking at TPC-H performance on MySQL. Our early tests yielded unexpectedly poor performance for MyISAM, InnoDB and the Tokutek storage engine. So we decided to take at look at each query individually to see what could be done. This post is about Query 2.

    Before going further, let us be clear - this is NOT "TPC-H" benchmarking. The TPC prescribes methods and procedures for measuring performance, and we didn't follow the rules (which you can read at

      [Read more...]
    MySQL insert performance with iiBench Python client
    +0 Vote Up -0Vote Down

    Mark Callaghan recently developed and released an enhanced Python version of Tokutek’s iiBench benchmark (Thanks Mark!).  We’re happy to see a Python version of the benchmark as it can now more easily be run by a broader group of people in more diverse environments.  Going forward, we will continue building upon Mark’s work on the Python version.  In addition to porting iiBench to Python, Mark added query capabilities to it, functionality that we were also planning to add.  We will test and discuss query performance in a future post.

    Given our focus on overall performance, we tested the insert performance of the Python version (iiBench.py) and found

      [Read more...]
    Consolidating Blogs
    +0 Vote Up -0Vote Down

    I'm consolidating my various blogs to a common blog, the Database Geek. I'm still tweaking the site and I plan to add links to categories (i.e. Oracle, Postgres, MySQL, etc) so that it is easily searchable. I also plan to add an RSS feed for each category so you only read the topics that interest you. Stop by and check it out.

    Any comments or feedback is appreciated.


    Technorati : blogging, database-geek.com

    Wordcraft 0.8 available
    +0 Vote Up -0Vote Down
    I am pleased to announce the release of Wordcraft 0.8.  I have managed to release about once a month since November.  I also have actually gotten some feedback and tickets posted.  Thanks to those that have tried it out.

    I have decided to go back to YUI's Editor.  I tried TinyMCE in the last release.  But, using it full time I found it messed with my HTML too much for my liking.  When I would switch to raw HTML mode and add something like a <code> tag, it would be lost when saving the data back into the WYSIWYG editor.

    I also converted the admin HTML to HTML 4.01 Transitional.  I never use XHTML anymore these days.  So, I was writing invalid XHTML inadvertantly.

    I worked on the session handling some more in this release.  Users should stay logged in to

      [Read more...]
    New MySQL Sandbox tutorial
    +0 Vote Up -0Vote Down

    John Goulah wrote a nice quick tutorial to MySQL Sandbox.
    Thanks, John!
    iiBench with deletes
    +0 Vote Up -0Vote Down

    We modified the iiBench benchmark to perform deletions as well as insertions, and compared InnoDB to Tokutek's Fractal TreeTM storage engine, both running on MySQL 5.1. I'll post the revised iiBench tarball soon.

    Here is what the performance looks like:

    The iiBench-with-deletions benchmark works as follows. The benchmark employs a fact table with an autoincremented primary key. First it inserts 250M rows (1000 rows per INSERT statement). Then it treats the fact table as a FIFO: every time it inserts 1000 rows at the end, it deletes 1000 rows from the beginning. The benchmark maintains three indexes as data is inserted and deleted. As usual for iiBench, the three indexes exhibit a lot of entropy (that is, they are essentially random).

    In the graph above, the X-axis shows the number

      [Read more...]
    Sun Family Feeling: An Australian visa post portem
    Employee +0 Vote Up -0Vote Down

    Time for a dump of some lessons learnt from my blog posting “On Open Source and Open Competition in a not-so-Open World“.

    Let me start by a recap of what the process looked from my point of view:

  • My close colleague gets his visa rejected. He is a seasoned Australia visitor, so I assumed (and still assume) he knew what he was doing.
  • We connect the dots between the rejection and an IM discussion from August 2008 (see comment #29 on my blog), related to
  •   [Read more...]
    iiBench Fractal Tree Results
    +0 Vote Up -0Vote Down
    A few weeks ago I reported InnoDB performance on the iiBench 1-billion row insert test. Today I'm reporting on Tokutek's Fractal TreeTM storage engine performance.

    We ran iiBench on the same hardware (Sun x4150, 8 cores @ 3.16GHz, 16GB memory, 6 SAS disk HW RAID 0) using Tokutek's storage engine for MySQL. The performance looks like

    Our engine consumed 20.2 hours elapsed time, and inserted the last 10M rows at a rate of 11,220 rows/second. In contrast, InnoDB finished the test in 207.5 hours, inserting the last 10M rows at a rate of 876 rows/second. For our engine, the my.cnf file has no special parameters defined - the test was run with default parameters. By  [Read more...]

    iiBench Contest Results
    +0 Vote Up -0Vote Down

    At OpenSQL Camp in November we presented a challenge to insert one billion rows, maintaining indexes, into a MySQL table. The best results we have seen are:

    Who Engine Total Time Terminal Rate Notes Mark Callaghan InnoDB 106.2 hours ~1,800 Google Patches
    Tuned my.cnf parameters
    10 disk SW RAID 0 Fake Amelia MyISAM 31.5 hours avg 8,800 400 Partitions Devananda vdv InnoDB 22 hours 10,000 128GB

      [Read more...]
    Mozilla Foundation Report for 2009 Week 1
    +0 Vote Up -0Vote Down

    This is Zak Greant's weekly report on his activities for the Mozilla Foundation from December 29th, 2008 to January 4th, 2009.


    Another week of the Christmas and New Year holidays with many of my Mozilla colleagues unavailable. As with the previous week, I focused on 2009 program development and engagement.

    The program development work was in the form of brainstorming, planning and research for upcoming 2009 Mozilla activities.

    The engagement work focused on participating in the Mozilla blogorama. I kept up with Planet Mozilla, commented on blog posts I found interesting and continued a series of lightweight blog posts.

    More details on both activities follow:

    Program Development

    I finished drafting a new statement of work and sent this

      [Read more...]
    iiBench Contest Updates
    +0 Vote Up -0Vote Down
    We re-ran iiBench based on Mark Callaghan's excellent work. We used standard InnoDB engine in MySQL 5.1 without the Google or Percona patches. Our hardware is similar to Mark's except we used a 6-disk hardware RAID 0, whereas Mark employed a 10-disk software RAID 0. We ran on the same hardware as we did before, a Sunfire x4150 with 8 cores and 16GB of memory, and we made the following changes compared to our original run:
    • 6 SATA disk HW RAID 0 (original run on 6 disk HW RAID 5)
    • 1,000 rows inserted per SQL INSERT statement
    • Used my.cnf settings based on what Mark did and what Percona suggested.
      [Read more...]
    Showing entries 1 to 30 of 69 Next 30 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.