Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский
Showing entries 1 to 30 of 20813 Next 30 Older Entries
dbbenchmark.com – automated installer now available
+0 Vote Up -0Vote Down

As previously mentioned, Darren Cassar has been working on a new automated installer for the DBbenchmark program. It’s now available for download: click here. All you need to do is save it to the directory that you want to install to and then make sure it’s executable: “chmod 700 installer.sh”, then run it “./installer.sh”.

How long Innodb Shutdown may take
+0 Vote Up -0Vote Down

How long it may take MySQL with Innodb tables to shut down ? It can be quite a while.
In default configuration innodb_fast_shutdown=ON the main job Innodb has to do to complete shutdown is flushing dirty buffers. The number of dirty buffers in the buffer pool varies depending on innodb_max_dirty_pages_pct as well as workload and innodb_log_buffer_size and can be anywhere from 10 to 90% in the real life workloads. Innodb_buffer_pool_pages_dirty status will show you the actual data. Now the flush speed also depends on number of factors. First it is your storage configuration – you may be looking at less than 200 writes/sec for single entry level hard drive to tens of thousands of writes/sec for high end SSD card. Flushing can be done using multiple threads (in XtraDB and

  [Read more...]
dbbenchmark.com – vote on next supported OS now!
+0 Vote Up -0Vote Down

So far the benchmarking script supports Linux, FreeBSD, and OSX. I’m installing virtual machines today to get ready for development on the next OS that the community wants to have supported. Vote today for your choice. Development will begin Friday 2010-09-03.

Note: There is a poll embedded within this post, please visit the site to participate in this post's poll.
LucidDB has a new Logo/Mascot
+2 Vote Up -0Vote Down

At yesterdays Eigenbase Developer Meetup at SQLstream’s offices in San Francisco we arrived at a new logo for LucidDB.  DynamoBI is thrilled to have supported and funded the design contest to arrive at our new mascot.  Over the coming months you’ll see the logo make it’s way out to the existing luciddb.org sites, wiki sites, etc.  I’m really happy to have a logo that matches the nature of our database - BAD ASS!

Loading Tables with TokuDB 4.0
+1 Vote Up -0Vote Down

Often, the first step in evaluating and deploying a database is to load an existing dataset into the database. In the latest version, TokuDB makes use of multi-core parallelism to speed up loading (and new index creation). Using the loader, MySQL tables using TokuDB load 5x-8x faster than with previous versions of TokuDB.

Measuring Load Performance

We generated several different datasets to measure the performance of TokuDB when doing a LOAD DATA INFILE … command. To characterize performance, we vary

  • rows to load
  • keys per row
  • row length (including keys)

All generated keys, including the primary, are random, 8-byte values. The remaining data, needed to pad out the row length to specified length, is text.

Two files files are produced as part of data generation.

  • data file, containing ‘|’
  •   [Read more...]
    Speaking at MySQL Sunday
    +1 Vote Up -1Vote Down
    I am speaking at MySQL Sunday. The title for my talk is Success with MySQL and I will focus on things that  operations and users can do to make a MySQL deployment succeed. There are many interesting talks scheduled for Sunday, including several at the same time as mine. I hope to see you there.
    Cluster - spins/contentions and thread stuck in..
    Employee +5 Vote Up -0Vote Down
    I get a number of question about contentions/"stuck in..". So here comes some explanation to:
    • Contention
    • Thread Stuck in
    • What you can do about it
    In 99% of the cases the contentions written out in the out file of the data nodes (ndb_X_out.log) is nothing to pay attention to.

    sendbufferpool waiting for lock, contentions: 6000 spins: 489200
    sendbufferpool waiting for lock, contentions: 6200 spins: 494721

    Each spin is read from the L1 cache (4 cycles on a Nehalem (3.2GHz), so about a nanosecond).
    1 spin = 1.25E-09 seconds (1.25ns)

    In the above we have:
    (494721-489200)/(6200-6000)= 27 spins/contention
    Time spent on a contention=27 x 1.25E-09=3.375E-08 seconds (0.03375 us)

    So we don't have a problem..

    Another example (here is a lock guarding a job buffer















      [Read more...]
    Oracle's MySQL - What's New? Live event in Milan on Sept, 28
    Employee +5 Vote Up -0Vote Down
    Join us at this live event in Milan to better understand what’s new with MySQL (http://www.mysql.com/). You will learn more about the current and future state of MySQL, now part of the Oracle family of products. We will also cover Oracle’s investment in MySQL aiming to make it even a better MySQL.

    In particular the following topics will be discussed:
    • Oracle’s MySQL Strategy
    • What’s New for:
      • The MySQL Server
      • MySQL Cluster
      • MySQL Enterprise
      • MySQL Workbench
    Stay tuned because we are organizing a similar event in Rome that will be announced soon. Attendance is free, but you’ll need to register in advance. Seats are limited,


      [Read more...]
    İstanbul 2010 Monty Program Ab Firma Toplantısı ve Konferans
    +5 Vote Up -0Vote Down

    (English version) Herhalde bildiğiniz gibi, biz tamamen sanal şirketiz, yani ana merkez gib bir şeyimiz yok. Hepimiz evinden çalışıyor ve biz sadece bir ya da iki kez yılda gerçek hayatta buluşuyorus. Bu sene kararımız İstanbul‘a düştü.  Firmadaki tek Türk ben olduğumdan dolayı toplantının organizesi bana düştü.

    İlk adım olarak böyle bir toplantının

      [Read more...]
    Sphinx & MySQL: facts and misconceptions
    +2 Vote Up -0Vote Down

    Sphinx search is a full text search engine, commonly used with MySQL.

    There are some misconceptions about Sphinx and its usage. Following is a list of some of Sphinx’ properties, hoping to answer some common questions.

    • Sphinx is not part of MySQL/Oracle.
    • It is a standalone server; an external application to MySQL.
    • Actually, it is not MySQL specific. It can work with other RDBMS: PostgreSQL, MS SQL Server.
    • And, although described as “free open-source SQL full-text search engine”, it is not SQL-specific: Sphinx can read documents from XML.
    • It is often described as “full text search for InnoDB”. This description is misleading. Sphinx indexes text; be it from any storage engine or external source. It solves, in a way, the issue of “FULLTEXT is
      [Read more...]
    Open Query turns 3!
    +3 Vote Up -1Vote Down

    Open Query is now three years old! We initially started with consulting and training services, and extended this with our proactive subscriptions that also offers system administration and monitoring.

    So how is it going? Pretty well. We’ve been profitable from the start, without funding (beyond a few hundred $ startup costs paid by Arjen) or any credit – by choice. Our objective has never been to grow ridiculously in terms of revenue or number of customers, we simply charge reasonable prices for real service. Right now we have dozens of clients on an ongoing basis, a neat trickle of new clients, and Open Query sustains the livelyhood and lifestyle of a number of people.

    For me (Arjen), the three year mark is particularly interesting, since most startups do not make it past their first two years. With our different approach to

      [Read more...]
    Workbench called me a dummy!
    Employee_Team +5 Vote Up -0Vote Down

    Seriously, it did.  Sorta.

    I use Workbench for my daily work, and it’s a great tool.  If you haven’t tried the 5.2 release yet, you should.  While performing some maintenance, I happened to issue a DELETE statement against a table which had no indexes (it was 10 rows), and Workbench complained:

    Error Code: 1175
    You are using safe update mode and you tried to update a table without a WHERE that uses a KEY column

    It turns out this is a new feature in 5.2.26 (and is still there in 5.2.27) – Workbench now uses the equivalent of –safe-updates mode for the mysql command-line client (also known as the


      [Read more...]
    Resolve many-to-many relations a bit different with MySQL
    +0 Vote Up -0Vote Down

    In database modeling, a m:n relationship is usually resolved by an additional table. But what if this relation is used only for archiving and the number of links in the resulting table is not too high? In that context, I got the idea to store all referring ID's as CSV string directly into a TEXT column of one of the referring tables. I came to this idea, because otherwise I would have to build complicated foreign keys and this way I also save one additional table. Certainly, this only makes sense if the data is not frequently accessed as foreign key. Nevertheless, I would like to tackle the problem, even if the implementation is very MySQL-oriented.

    Read the rest »

    Pen and paper as a DBA tool
    +1 Vote Up -1Vote Down

    “Hey DBA!  Remember that change you made for my group  four or five months ago? Well, we were waiting for things to get better but they have not. Can you change it back ASAP?!?”

    I know several of you  DBAs after reading the above are reaching for their antacids.  OR something stronger.

    Keeping track of what changes were made to which systems in your head is bound to bite a hard working DBA sooner or later.

    This is one of those oh-so-obvious tips that will be ignored by many but it will come back to haunt like a cheap RAID array.   Get a notebook, a pen, and keep it by you when you work.  Now anytime you make a material change or perform a maintenance function on one of your systems, note what EXACTLY the change you made, the reason for the change,  plus the day and date.  It will take some effort to do this the first two

      [Read more...]
    Translation of Summary of Part 3 of "Methods for searching errors in SQL application" just published
    Employee_Team +1 Vote Up -0Vote Down

    Not much new this time: just summary of part 3 published and fixed mistake in chapter 10 (thanks, Shane!).

    Summary.

    In the third part we discussed methods of application debugging in cases when query plays secondary role in the problem.

    I'd like to bring your attention we only discussed most frequent cases while MySQL server has a lot of parameters which of them can affect application. Analyze parameters which you use. One of the methods is run problematic query using MySQL server running with option --no-defaults and examine if results are different for MySQL server run with parameter which you use. If results are different analyze why parameter affects it and solve the problem.

    ...

    Rest of the chapter is here.

    MySQL: Kill sleeping connections
    +2 Vote Up -0Vote Down
    Platform: MySQL 5.x

    Most of the time it would be handy to have a native MySQL script which would allow one to kill the sleeping connections which are in sleep state for more than 180 sec..  On the other hand DBA's can use  "wait_timeout" etc parameters to control this..

    [code]

     # -- Make sure you are logged as MySQL 'root' user or any user who have got super privileges 



    DELIMITER $$
    DROP PROCEDURE IF EXISTS `uKillSleepingSessions`$$


    CREATE PROCEDURE `uKillSleepingSessions`()
    COMMENT 'This routne is used to kill idle sessions'
    READS SQL DATA


    BEGIN


    DECLARE no_more_rows BOOLEAN;
    DECLARE loop_cntr INT DEFAULT 0;
    DECLARE num_rows INT DEFAULT 0;
    DECLARE uID bigint(4);


























      [Read more...]
    Mårten Mickos strikes back
    Employee +7 Vote Up -1Vote Down
    Mårten Mickos, the CEO of Eucalyptus and former CEO of MySQL AB, will be back on stage as the closing keynoter on September 19th at MySQL Sunday, one of the community events at the start of Oracle Open World 2010.

    The opening keynote will be delivered by Edward Screven, Chief Corporate Architect at Oracle.

    MySQL Sunday has a very rich schedule, and by the registration numbers it looks like

      [Read more...]
    MySQL Workbench 5.2.27 GA Available
    Employee_Team +6 Vote Up -0Vote Down

    We’re proud to announce the next release of MySQL Workbench, version 5.2.27. This is the second maintenance release for 5.2 GA (Generally Available). This maintenance release does not introduce any new features, but focuses on general product improvement and usability.  We hope you will make MySQL Workbench your preferred tool for Design, Development, and Administration of your MySQL database applications.

    As always, we want to thank everyone for the great feedback we have received. This helps us to continuously improve and extend the functionality and stability of MySQL Workbench – please keep up on approaching us with any ideas to develop our product even further.

    MySQL Workbench 5.2 GA

    • Data Modeling
    • Query (replaces the old MySQL Query Browser)
    • Administration (replaces the old MySQL Administrator)

    Please get your copy from our Download site. Sources

      [Read more...]
    Introducing tcprstat, a TCP response time tool
    +3 Vote Up -0Vote Down

    Ignacio Nin and I (mostly Ignacio) have worked together to create tcprstat[1], a new tool that times TCP requests and prints out statistics on them. The output looks somewhat like vmstat or iostat, but we’ve chosen the statistics carefully so you can compute meaningful things about your TCP traffic.

    What is this good for? In a nutshell, it is a lightweight way to measure response times on a server such as a database, memcached, Apache, and so on. You can use this information for historical metrics, capacity planning, troubleshooting, and monitoring to name just a few.

    The tcprstat tool itself is a means of gathering raw statistics, which are suitable for storing and manipulating with other programs and scripts. By default, tcprstat works just like vmstat: it runs once, prints out a line, and exits. You’ll probably want to

      [Read more...]
    Marten Mickos to Keynote at MySQL Sunday
    Employee +6 Vote Up -0Vote Down

    On September 19, 2010, Oracle is hosting MySQL Sunday, a half-day technical conference jam-packed with the latest on MySQL, the world's most popular open source database. The sessions will offer you insights into the latest MySQL technical innovations and community developments. Check out the agenda.

     

    Keynotes

    We are very excited that Marten Mickos, CEO, Eucalyptus Systems, will be joining us to deliver the closing keynote at MySQL Sunday, in addition to Edward Screven, Oracle's Chief Corporate Architect and Head of the MySQL business.

      [Read more...]
    Asterisk attack
    +0 Vote Up -0Vote Down

    There was a lot of talk about this being the next menace after email spam. I’m not actually sure what it’s called for VoIP systems, but my Asterisk setup has started to be attacked over the last few days. Lots of entries like:

    [Aug 27 19:20:30] NOTICE[18826] chan_sip.c: Registration from '"742"<sip:742@a.b.c.d>' failed for '208.109.86.187' - No matching peer found
    ...
    [Aug 31 10:13:10] NOTICE[18826] chan_sip.c: Registration from '"1002" <sip:1002@a.b.c.d>' failed for '41.191.224.2' - Wrong password

    Lots of messages get logged a second and I noticed this as suddenly CPU load on my PC jumped up quite a bit.

    For the moment I’ve routed these addresses via the interface lo0 so they won’t bother me any more, but I need to come up with a better solution.

    First I’m curious if applications like Asterisk or FreeSwitch



      [Read more...]
    dbbenchmark.com – MySQL benchmarking now with FreeBSD support
    +1 Vote Up -2Vote Down

    The development cycle is moving right along for the community’s newest MySQL benchmarking script. I’m pleased to announce that we now officially support FreeBSD (version 8.1 tested) so go ahead and download now and test your FreeBSD, Linux, or OSX MySQL server! Click here for the download.

    Courtesy of Darren Cassar and some generous coding this weekend, we’re going to be releasing a auto-installer / updater for the application which you can use to automate that part of the process. Stay tuned for information on that release.

    Welcome to Oracle's MySQL Blog
    Employee +4 Vote Up -3Vote Down

    Are you thinking...not one more blog, please! We have received a lot of feedback that we at Oracle need to be more vocal about our investment and progress with MySQL. The MySQL team at Oracle is very excited to launch a new blog where we will offer you the latest and greatest updates on product announcements, news, events, customers, activities, and overall progress about MySQL. You can be sure to find a mix of technical and business content.

    As you continue to follow your favorite MySQL bloggers, we also hope that you will add "Oracle's MySQL Blog" to that list over time.

    I manage MySQL product marketing at Oracle. You will meet a number of my colleagues in product marketing, product management, community relations and product development over time as you see them write through this blog.

    Thanks for listening, and we look forward to your feedback.

    Monica

     

    Do you use MySQL replication? Do you use “FLUSH LOGS”? If yes you might want to read this.
    +2 Vote Up -0Vote Down

    Scenario: Master-Master replication
    Description: Master A is the active db server whilst Master B is a read only swappable db server hence both are creating binary logs. During backup I run “FLUSH LOGS” in order to have a simpler point in time recovery procedure if that case arises.
    Problem: Flush logs is mean mean command :) …. it rotates not only my binary logs but my error log too (since I user error-log=blahblahblah in my my.cnf). Well given I flush logs every night my error log is cycled through every night, but unlike binary logs which have an incrimental number attached to the fine, error logs only have a `-log` attached to the filename and a second “FLUSH LOG” would just clear all error logs permanently. That is really not fun believe me!

    So what is the solution?



      [Read more...]
    Cloud Insight: HP, Dell, 3PAR, VMWare & ScaleDB
    +1 Vote Up -0Vote Down
    The bidding war between HP and Dell for 3PAR has created great theater. The rationale is simple, both HP and Dell want a complete set of products to sell into the new cloud space and 3PAR is the only bitsized morsel among EMC, IBM and Hitachi that addresses this space. What is the compelling advantage they offer in storage? Elasticity. 3PAR provides the ability for companies to add/remove storage in thin slices (AKA thin provisioning). How does this relate to ScaleDB? We do the exact same thing for databases in the cloud and we do it for the most popular database in the cloud, MySQL.

    How does VMWare play into this? Their CEO Paul Maritz was on CNBC talking about

      [Read more...]
    Nice BTRFS webinar by Oracle
    Employee +3 Vote Up -0Vote Down
    Last week I followed an very interesting ORACLE webinar delivered by Chris Mason : The State of Btrfs File System for Linux
    BTRFS was initiated by Chris Mason who used to be responsible for Reiserfs at Suse and now works for Oracle. The first release started in 2007. BTRFS has been merged into Linux kernel in 2009. Now there are developers from REDHAT, INTEL SUSE, IBM, HP ... storage vendors. The project is very active. Ubuntu is considering to use it soon as its default filesystem. BTRFS is licensed under the GPL license. An interesting to read short summary of the life of BTRFS : A short history of BTRFS
    ...
    How To: Create a Query in One Shot
    +1 Vote Up -6Vote Down

    To get information from a database it is necessary to execute a query to get this data.

    Usually an ordinary SQL editor is used to create queries. To use such editor, one should remember the syntax of the SELECT operator and the names of tables and columns.

    Let’s use a visual instrument developed specially to design queries, and see that it’s much easier to create queries visually instead of typing them in an editor.

    Task:

    It’s necessary to show the salaries of the employees of departments situated in different cities for the 2008 year in descending order.

    We will do this on a MySQL server database. The process of creating this database was described in the How to: Create MySQL Database in One Shot article. You

      [Read more...]
    dbbenchmark.com – Debian Lenny, MEMORY_ACTIVE bug fix
    +1 Vote Up -3Vote Down

    Quick solution to an issue that the affected Debian Lenny release: the process used to collect the MEMORY_ACTIVE_BYTES variable has been modified to correct a situation where some systems report an array of memory information instead of the expected single integer value. The bug has been fixed in revision 21 and the current download (revision 22) is available for download or svn update. As usual, you can download the MySQL dbbenchmark script here: [downloads].

    Thanks goes to Brian Vowell at Evernote.com for bringing this bug to my attention. The original bug report can be found here: [link]

    Easy Python: multi-threading MySQL queries
    +2 Vote Up -3Vote Down

    There are many times when writing an application that single threaded database operations are simply too slow. In these cases it’s a matter of course that you’ll use multi-threading or forking to spawn secondary processes to handle the database actions. In this simple example for Python multi-threading you’ll see the how simple it is to improve the performance of your python app.

    #!/usr/bin/python
    ## DATE: 2010-08-30
    ## AUTHOR: Matt Reid
    ## WEBSITE: http://themattreid.com
    ## LICENSE: BSD http://www.opensource.org/licenses/bsd-license.php
    ## Copyright 2010-present Matt Reid
    
    from __future__ import division
    from socket import gethostname;
    import threading
    import sys
    import os
    import MySQLdb
    
    class threader(threading.Thread):
        def __init__(self,method):
            threading.Thread.__init__(self)
            self.tx =
            self.method = method
        def run(self):
      [Read more...]
    dbbenchmark.com – MySQL benchmarking now supports multiple threads!
    +1 Vote Up -3Vote Down

    We had a very successful weekend of Planet.mysql users submitting their database statistics so I’ve pushed some code into a new release today so that everyone can benefit from some new features. The biggest change is to the threading logic. Previously the benchmarking script was serializing MySQL operations and only making use of a secondary thread (not the invoking thread) to query the database. Now you have the option of running with “–threads=x” to make use of your multi-core server. A good example of this improvement was on my Macbook Pro; before the threading change it was inserting ~700/sec, after the code change I tried –threads=4 and saw an improvement to ~900/sec. Rather significant.

    Download the new script now and see how your server compares to the ones in the central database!

    Showing entries 1 to 30 of 20813 Next 30 Older Entries

    Planet MySQL © 1995-2008 MySQL AB, 2008-2010 Sun Microsystems, Inc.,
    2010, Oracle Corporation and/or its affiliates.
    Content reproduced on this site is the property of the respective copyright holders.
    It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.