Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Previous 30 Newer Entries Showing entries 31 to 60 of 62 Next 2 Older Entries

Displaying posts with tag: Testing (reset)

Reviewed: Python Testing by Daniel Arbuckle
+0 Vote Up -0Vote Down

I’ve recently had the pleasure of reading “Python Testing: An easy and convenient approach to testing your python projects” from Packt Publishing. It’s been a quick read but a solid set of instructions on the different methods for the subject.

The book starts out very quickly with details about the various methods that are available, the means of automation for testing, and of course the environment you’d want to be in for working on the subjects that the book covers. It then, in the second chapter, moves into the guts of testing by describing the basics of doctest via syntax and some simple examples, and then moves on to a real world example via the AVL tree. It’s all very basic

  [Read more...]
MariaDB Buildbot configuration file published
+2 Vote Up -0Vote Down

I have now published the Buildbot configuration file that we use for our continuous integration tests in our Buildbot setup. Every push into main and development branches of MariaDB is built and tested on a range of platforms to catch and fix any problems early (and we also test MySQL releases before merging to easily see whether any new problems already existed in MySQL or were introduced by something specific to MariaDB).

The configuration is included in the Tools for MariaDB Launchpad project.

Now, the Buildbot configuration file is not something that most MariaDB users will

  [Read more...]
Building MariaDB/MySQL with Buildbot and KVM
+5 Vote Up -1Vote Down

Testing and automation. These two are key to ensuring high quality of software releases.

Ever since I worked briefly in the team at MySQL AB that is responsible for creating the binary (and source) packages of MySQL releases, I have had the vision of a fully automated release procedure. Whenever someone pushes a new commit to the release branch revision control tree, the continuous integration test framework should kick in and do all the steps needed for producing release packages:

  • Checkout the new revision.
  • Build a source tarball, and save it.
  • For each platform, build a binary package from the source tarball. The build should be done in a freshly installed machine without any revision control checkouts, previous build trees, or extra installed software, to ensure that no unwanted

  [Read more...]
Jeremy's article on MySQL Sandbox in Linux Magazine
+6 Vote Up -1Vote Down



Jeremy Zawodny of Craiglist has written a kind article about MySQL Sandbox.
The article, MySQL Sandbox: Treat MySQL Instances like Virtual Machines, is a practical test of MySQL Sandbox with usage examples and warm appreciation.
Thanks, Jeremy!

The article was published in July but I noticed it only today. I guess I should pay more attention to my favorite topics when I travel.
The mysterious Storage Engine Independent Test Suite
+4 Vote Up -0Vote Down
Recently Mark observed that we now all need a storage engine independent test suite, Sun included! Well, as far as I know, there is such a thing at Sun, sort of. Apparently it has been used to test PBXT and other engines, but I've heard it is not in good enough shape to be released.

But my question is, why not release it anyway? We could turn it into an engine community project. I believe there are enough engine developers out there to get this moving forward.

The secret is to start small, and just get a few tests to run with all engines. Then additional tests can be added step by step. Engines need a way to specify that they want to skip a test entirely (e.g. transactional tests), and it should be easy to customize results for various engines.

An example of a simple and





  [Read more...]
MySQL Labs provide server snapshots
Employee_Team +3 Vote Up -0Vote Down

MySQL opens its labs to the community. Users who want to test the early builds, before they are released for general availability can get them from MySQL Labs.

There is a detailed announcement that warns against using these binaries in production, but encourages everyone to test them. A companion tutorial explains how to use the snapshots to test the InnoDB plugin, which was released recently, and it is included in the latest MySQL 5.1 binaries.

MySQL Labs : server snapshots available for download
Employee +9 Vote Up -0Vote Down

Users familiar with the MySQL development process will remember that our developers use a tool called pushbuild, which builds the server code with the latest changes, using several operating systems, and runs the test suite.

This tool produces one binary package for each platform where the test runs, and every day there are a few dozen of such packages, waiting to be deleted and replaced by the ones created with the next build.

For long time, several people suggested publishing these binaries for the community. Each time, there was some minor or major impediment, such as getting together different teams and requesting resources from a third one. But

  [Read more...]
Testing the InnoDB plugin with MySQL snapshots
+9 Vote Up -0Vote Down



The cat is out of the bag.
MySQL 5.1 will include the InnoDB plugin, and thanks to
labs.mysql.com
you can try the new version right away.
Here is a step-by-step guide to testing the InnoDB plugin with MySQL snapshot 5.1.39 and MySQL Sandbox.

1. Install MySQL::SandboxThis is a straightforward part. Please refer to the







  [Read more...]
MySQL Labs : server snapshots available for download
Employee +0 Vote Up -0Vote Down

Users familiar with the MySQL development process will remember that our developers use a tool called pushbuild, which builds the server code with the latest changes, using several operating systems, and runs the test suite.

This tool produces one binary package for each platform where the test runs, and every day there are a few dozen of such packages, waiting to be deleted and replaced by the ones created with the next build.

For long time, several people suggested publishing these binaries for the community. Each time, there was some minor or major impediment, such as getting together different teams and requesting resources from a third one.

  [Read more...]
MySQL Labs : server snapshots available for download
Employee +0 Vote Up -0Vote Down

Users familiar with the MySQL development process will remember that our developers use a tool called pushbuild, which builds the server code with the latest changes, using several operating systems, and runs the test suite.

This tool produces one binary package for each platform where the test runs, and every day there are a few dozen of such packages, waiting to be deleted and replaced by the ones created with the next build.

For long time, several people suggested publishing these binaries for the community. Each time, there was some minor or major impediment, such as getting together different teams and requesting resources from a third

  [Read more...]
Generating data with dbmonster
+1 Vote Up -0Vote Down
In my last post I included some sample data which was useful for playing around with queries (once I published it, I realized it made my post look like some form of keyword stuffing, fortunately I don’t use adsense on my site so I hope I’m free of any suspicion :D). That sample data was […] Related posts:
  • Generating random salts from bash From the ‘just because it can be done’ column, here...
  • Using the ENUM data type to increase performance While going through the DATA TYPES section of the Certification...
  • YARPP powered by AdBistroPowered by
    SQL Bench as a separate project , released
    +0 Vote Up -0Vote Down
    I'm pleased to announce the release of SQL Bench, the benchmark test suite the comes standard with MySQL, now as a separate project targeted for testing any database. I have pulled it out as a separate project so I can modify and improve it faster. With this release, I have successfully used it for testing both Drizzle and MySQL. Other RDBMSs, I have yet to test.

    Modifications

    I modified the connection test, which part of it is to connect, run a single query for one row, disconnect, to iterate only 20,000 times vs. 100,000 times. The reason for this is to allow this test to reasonably test databases that use TCP sockets. When I added Drizzle support to SQL Bench, upon running the connect test it would fail inexplicably. After some serious testing, it was realized that since Drizzle uses TCP sockets, even when connecting to localhost, that the connect test would fail because of the



      [Read more...]
    Failing by choice. Another bug-vs-feature debate ends
    +3 Vote Up -1Vote Down

    A long standing bug

    Among the many outstanding bugs for MySQL, there is one that has sparked a fierce discussion, not only in the bug report itself, but also in blogs, forums, mailing lists.
    Bug #19027: MySQL 5.0 starts even with Fatal InnoDB errors was neglected for long time, until finally it got fixed, and it is available in MySQL 5.1.36.
    First off, what is it about?
    In short, if an engine doesn't initialize correctly, the MySQL server starts anyway, without the offending engine. Depending on how you use the failing engine, this could be either a minor annoyance or a complete disaster.
    Annoyance: ARCHIVE fails to initialize, and you create tables with the default engine (usually MyISAM), and after a while you realize that the disk is filling up faster than you expected. You will find



      [Read more...]
    A quick look at Google Fusion Tables
    +3 Vote Up -1Vote Down
    I was curious about Google Fusion Tables, and gave it a try.
    I uploaded the employees table from the employees test database, 16 MB of data, about 300,000 rows. Since the maximum limit per table is 100 MB, I expected interesting results.
    However, one of my first tests, with aggregation was quite disappointing.
    A simple group by gender was executed in about 30 seconds.

    InnoDB on my laptop did a much better job:

    select gender , count(*) from employees group by gender;






      [Read more...]
    Drizzle, State of Testing
    +1 Vote Up -0Vote Down
    Testing, Testing, Testing...

    I've gotten a number of questions about how we are doing testing, and even how our methodology for accepting code works :)

    A lot of this comes from running open source projects for almost a couple of decades (hell, if I toss in uploading public domain to software to BBS'es for the Commodore 64 it is a bit longer!).

    One of the most important rules I have learned over the years is that anything that is not automated and not required, will get skipped.

    Today Drizzle runs 213 tests, the entire MySQL test suite minus tests that are for features we don't have. We don't allow for any regression, meaning that no one is allowed to disable a test in order to get their code pushed. Our test suite was also modified so that we can run all of the tests against a particular engine. Today we do this with both Innodb and PBXT. So instead of having "engine







      [Read more...]
    Changing Testing Partners from Pearson VUE to Prometric
    Employee +2 Vote Up -0Vote Down
    As part of integration with Sun Learning, MySQL Certification will be moving from using Pearson VUE to Prometric as our testing partner. July 31st, 2009 will be the last day that candidates will be able to take exams or use MySQl exam vouchers at a Pearson VUE test center. Those with outstanding exam vouchers that they can not use by July 31st, 2009 should contact certification@sun.com for an exchange.
    MySQL Sandbox 3.0 release candidate
    +7 Vote Up -0Vote Down



    MySQL Sandbox is now in release candidate status. If no bugs are reported on the latest version (2.0.99f), I will repackage it as 3.0.
    In addition to the list of features previously announced, I managed to implement another feature that has been in the wish list for long time, i.e. creating a sandbox from existing binaries, such as the ones installed by a .rpm or .deb package.

    The new script make_sandbox_from_installed meets the expectations by creating a fake BASEDIR with symbolic links.
    Other important






      [Read more...]
    Test driving the Spider storage engine - sharding for the masses
    +7 Vote Up -0Vote Down


    At the MySQL Conference 2009 I attended a session about the Spider storage engine, an engine with built-in sharding features.
    The talk was notable for the speaker wearing a spiderman costume, and for some language barrier that made the talk less enjoyable than it should be. That's a pity, because the engine is very intriguing, and deserves some exploration.

    What is the Spider engine, then? In short, it's an extension to the partitioning engine with the ability of connecting to remote servers. Basically, partitions + federated, except that Federated is explicitly removed during the compilation. Additionally, the spider




      [Read more...]
    MySQL 5.4 performance with logging
    +8 Vote Up -0Vote Down


    About a month ago, I published the results of MySQL 5.x performance with logging. The results covered several versions, from 5.0.45 to 5.1.33. Among the conclusions of the post was the consideration that MySQL 5.0.x is faster than MySQL 5.1 in read only operations. I hinted that better results may come for MySQL 5.1. When I wrote that post I had, in fact, an ace up my sleeve, because I had already benchmarked the performance of MySQL 5.4, using the same criteria shown in my previous post. The results, as you can

      [Read more...]
    Using MySQL sandbox for testing
    +0 Vote Up -0Vote Down

    MySQL Sandbox is a great tool for quickly deploying test MySQL instances, particularly if your daily work involves diagnosing problems across multiple MySQL versions.

    Once you’ve downloaded it, it needs no installation. Just have a few MySQL binary releases at hand, and begin creating sandboxes in just a few seconds:

    ./make_sandbox mysql-5.0.77-linux-x86_64-glibc23.tar.gz

    or

    ./make_sandbox mysql-5.1.32-linux-x86_64-glibc23.tar.gz

    Pretty simple, huh?

    Suppose you have a parallel build around, say, 5.0.77-percona-highperf. The default syntax won’t work if you’ve already created a 5.0.77 sandbox, since Sandbox will use ‘5.0.77′ as the sandbox dir. In this case, you’ll need to manually specify a directory

      [Read more...]
    New version of employees test DB
    +0 Vote Up -0Vote Down



    The Employees Test database has been updated. There was a subtle bug in the data. One employee was assigned to two departments with the same start and end date. And one of the sample procedures fell into the trap of assuming that the data was clean, thus reporting incorrect statistics.
    Now the bug is fixed, the test suite is updated, and I can wait for the next bug report.
    MySQL 5.x performance with logging
    +0 Vote Up -0Vote Down
    There has been much talking about MySQL performance related to logging. Since MySQL 5.1.21, when Bug #30414 was reported (Slowdown (related to logging) in 5.1.21 vs. 5.1.20) I have been monitoring the performance of the server, both on 5.0 and 5.1.
    Recently, I got a very powerful server, which makes these measurements meaningful.
    Thus, I measured the performance of the server, using all publicly available sources, because I want this benchmark to be repeatable by everyone.
    I will first describe the method used for the benchmarks, and then I report the results.

    The server

    The server is a Linux Red Hat Enterprise 5.2, running on a 8core processor, with 32 GB RAM and 1.5 TB storage.

    $ cat /etc/redhat-release
    Red Hat Enterprise Linux Server release 5.2 (Tikanga)







      [Read more...]
    Slap’em
    +0 Vote Up -0Vote Down

    Giving a bunch of mysql instances something you do everyday and you might think ….. how should I do it? Write a bunch of selects and inserts manually? nahh that takes s**tload of time, should I run binlogs collected from a live system on my test server? nahh thats not practical nor is it real since it doesn’t contain selects, should I gather the general query log and try that out? nahhh  …..

    MySQL has been kind enough to supply us with their mysql_slap which does the job for us and given I needed to do a proof of concept on monitoring a group of 4 circular replicated servers I wrote a small script which does the job of slapping them with a varying level of concurrancy, iterations, number of queries and connections for as long as you like.

    Here it is and I hope some of you might find it useful for slapping their own test servers :).

      [Read more...]
    Seeking volunteer test machines for Monolith
    +0 Vote Up -0Vote Down

    Monolith: MySQL server monitoring. I only have servers that run Redhat/Debian/Ubuntu Linux x86 and x86_64. I don’t have machines to test MySQL monitoring for the following OSes. Perhaps you would like to be a test candidate for the new version of Monolith? If so, let me know and you’ll be on the list, as well as get beta testing credit.

    OSX Server: PPC and Intel

    AIX

    FreeBSD / OpenBSD / NetBSD

    Windows Server

    Solaris: Intel & Sparc

    Linux servers that are NOT Intel based.

    What this involves: testing the client script, perl modules, snmp stats, and other functions that may require a custom client script for that architecture.

    The power of a good SQL naming convention
    +0 Vote Up -0Vote Down
    At my previous employer, one of the early decisions that had huge payoffs later was the SQL naming conventions. A good naming convention is more than just a nicety. It lets you write programs that don’t need to be told about the relationships among tables and columns. There are many ways to do this, [...]
    Don't guess. Test! - A sample database with test suite
    +1 Vote Up -0Vote Down
    Some time ago, with the help of Patrick Crews, I built a sample database for testing.
    Now this database is published as a stand-alone project on Launchpad.

    What's special about it?
    Unlike the previous databases used in MySQL documentation and tutorials, this database has some weight. The total data is over 160 MB, distributed across 6 table, for a total of about 4 million records. It is not huge, but it is large enough to be non-trivial.
    The second important feature is that this database comes with a test suite. This will allow you to make sure that you have loaded the right data.

    Getting started

    Using the sample database is





      [Read more...]
    Even faster online backup!
    +0 Vote Up -0Vote Down

    I discussed my findings with Guilhem Bichot, one of the online backup creators, and he remarks:
    You could also try
    export MYISAM_BACKUP_NO_INDEX=1

    before starting mysqld. It should not backup index (and rebuild them at repair time). Should make a smaller backup and a longer restore.

    I am not really looking for a longer restore, but let's give it a try. I restarted the database with the suggested option, and here is what I got:


    backup database employees to 'emp2.bkp';







      [Read more...]
    Faster online backup with MyISAM driver
    +0 Vote Up -0Vote Down

    Remember the first test of online backup? I tested the new feature, which was performing quite well, compared to mysqldump. OK. Get ready for a surprise.
    I tested the native MyISAM driver from the mysql-6.0-backup tree, and I compared the results with the normal backup.
    versionbackup timerestore timestandard25.5879.11MyISAM driver4.1511.53
    Please be amazed!
    The difference is also visible from the metadata. The standard version says:
    select * from mysql.online_backup\G






      [Read more...]
    Test stressing OpenSolaris with MySQL
    Employee +0 Vote Up -0Vote Down

    Over the last months I have seen some impressive presentations about Open Solaris, and I wanted to give it a try.

    The live CD provided with opensolaris 2008.05 is very easy to install, and so I set it up in a virtual machine.

    The environment looks familiar for a seasoned Linux user, and thus I decided to use it as a test bed for my MySQL Sandbox, which includes a test suite that lets you run a complete test with little effort.

    Well, little effort for you, maybe, but not for the operating system. The test puts a lot of stress on the operating system, as you can see from this picture.

    Running a complete test for a single

      [Read more...]
    Tools to generate large synthetic data sets for testing?
    +0 Vote Up -0Vote Down
    I need to generate large (1TB-3TB) synthetic MySQL datasets for testing, with a number of requirements:

    a) custom output formatting (SQL, CSV, fixed-len row, etc)
    b) referential integrity support (ie, child tables should reference PK values, no orphans,etc)
    c) able to generate multiple tables in parallel
    d) preferably able to operate without a GUI and/or manual intervention
    e) uses a well defined templating construct for data generation
    f) preferably open source

    Does anyone out there know of a product that meets at least most of these requirements?

    *edit*
    I found a PHP based data generation script (www.generatedata.com) that is extensible in its output formatting, so it should do everything I need it to do.
    Previous 30 Newer Entries Showing entries 31 to 60 of 62 Next 2 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.