Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 23

Displaying posts with tag: Cloud and NoSQL (reset)

Introducing Percona Cloud Tools for MySQL
+0 Vote Up -0Vote Down

I am proud to announce Percona Cloud Tools, the next generation of tools for MySQL.  I have been developing tools for MySQL for 10 years.  For the last 5 years, I have been developing Percona Toolkit (formerly “Maatkit”).  Almost 1 year ago, we began developing Percona Cloud Tools (PCT), first in-house, then in private beta, and now in public beta.

Here is the TL;DR:

Percona Cloud Tools is a web service, hosted by Percona.  There is a single cloud tool (a web app) called ”Query Analytics”, based on pt-query-digest, so one could say it’s “continuous slow log analysis through the web, as a service”.  Of course, the web

  [Read more...]
How can we bring query to the data?
+2 Vote Up -0Vote Down

Baron recently wrote about sending the query to the data looking at distributed systems like Cassandra. I want to take a look at more simple systems like MySQL and see how we’re doing in this space.

It is obvious getting computations as closer to the data as possible is the most efficient as we will likely have less data to work with on the higher level in this case. Internally MySQL starts add optimizations which help in this regard, such as Index Condition Pushdown which allow storage engine to do most rudimentary data filtering improving efficiency.

The more important case though is the Application – Database interaction. Modern applications often have quite complicated logic which might not map to SQL very well. Framework and the practices developers follow

  [Read more...]
Amazon RDS with MySQL 5.6 – Configuration Variables
+3 Vote Up -0Vote Down

One longstanding complaint I have heard for the past several years, and still hear today, is that Amazon’s Relational Database Service (RDS) does not allow the configuration flexibility as running MySQL in an ec2 instance. While true, this ignores the consistent work that Amazon has done to provide access to the most important configuration variables needed to tune a MySQL instance (after all, how relevant is it for a customer to set bind_address in an RDS instance).

Let’s take a look visually:

  [Read more...]
TokuMX is MongoDB on steroids
+3 Vote Up -0Vote Down

I am actually quite excited about Tokutek’s release of TokuMX. I think it is going to change the landscape of database systems and it is finally something that made me looking into NoSQL.

Why is TokuMX interesting? A few reasons:

  • It comes with transactions, and all that good stuff that transactions provide: a concurrent access to documents (no more global write-lock in MongoDB); crash recovery; atomicity
  • Performance in IO-bound operations
  • A good compression rate, which is a money-saver if you use SSD/Flash
  • But it is
  [Read more...]
Why use encrypted backup with Percona XtraBackup 2.1 for MySQL?
+0 Vote Up -0Vote Down

We just released our first alpha of Percona XtraBackup 2.1 for MySQL and with it we included the ability to encrypt backups on the fly (full documentation here). This feature is different than simply piping the backup stream through the openssl or gpg binaries, which is what some people have used in the past. A big benefit of using the built-in encryption is that multiple CPU cores can be used for encryption

  [Read more...]
Facebook at Percona Live MySQL Conference and Expo and Advanced Registration Ending Soon
+1 Vote Up -0Vote Down

Facebook is a major user of MySQL and has pushed the performance limits of the technology. Their MySQL experts have deep, hands on knowledge of the technology. I’m pleased to welcome Mark Callaghan, Software Engineer for Database Infrastructure at Facebook, back again this year to the Percona Live MySQL Conference & Expo to share his expertise. Mark was a keynote speaker at last

  [Read more...]
MySQL Backup tools used by Percona Remote DBA for MySQL
+0 Vote Up -1Vote Down

As part of Percona Remote DBA for MySQL service we recognize that reliable backups are one of the most important things we can bring to the table. In my experience handling emergencies, the single worst thing that can happen is finding out you don’t have backups available when some sort of data loss or catastrophic event occurs.

With our Remote DBA service we can take care of backups for you, what follows are some of the internals of our implementation.

What kind of outages can happen?

  • Someone runs UPDATE or DELETE and forgets the
  [Read more...]
Oracle Technical Experts at the Percona Live MySQL Conference and Expo
+12 Vote Up -0Vote Down

I’m pleased to announce that Oracle is sending some of their top technical people to speak at the Percona Live MySQL Conference and Expo. The conference takes place April 22-25, 2013 at the Santa Clara Convention Center and Hyatt Santa Clara.

Tomas Ulin, VP, MySQL Engineering for Oracle, will present an invited keynote talk on “Driving MySQL Innovation” during the Tuesday morning opening keynotes. With the recent release of MySQL 5.6, conference attendees will hear about the latest developments of this

  [Read more...]
Minimizing Downtime from Lengthy AWS Outages
+2 Vote Up -0Vote Down

Well, it happened again…  Another lengthy EBS outage in the US-East region impacted several sites across the net.  While failures like this are rare, they can be quite costly and translate into headaches for the operations team when impact production systems for any length of time.  At Percona, we routinely help clients architect and deploy highly available systems designed with disaster recovery in the cloud.  Here are a few high level best practices that I’ve seen when helping clients with AWS deployments:

  • Plan for failure
  • Plan for failure
  • Plan for … you get the idea
  • Plan for Failure

    The single most critical piece is to plan for and expect failure.  The ease of

      [Read more...]
    Diamond Keynote Panel, BOFs, Lightning Talks, and McAfee and AOL Sponsorships
    +0 Vote Up -0Vote Down

    I’m excited by all of the recent developments surrounding the Percona Live MySQL Conference and Expo! Our own Baron Schwartz will moderate the Diamond Keynote Panel entitled “Future Perfect: The Road Ahead for MySQL” which will feature a panel of MySQL industry leaders, including: Sundar Raghavan, director product management at Amazon; Paul Mikesell, CEO of Clustrix; a representative from HP; and, a representative from McAfee. The Diamond Sponsor Keynote Panel will take place at 9:30 a.m. on Thursday, April 12th and provide insight into the future of MySQL technology, adoption, and the ecosystem landscape. I am also very pleased to

      [Read more...]
    BOFs and Lightning Talks Announced for Percona Live MySQL Conference & Expo
    +1 Vote Up -0Vote Down

    The Percona Live MySQL Conference & Expo is going to be awesome! Great speakers, an A-list of sponsors, countless opportunities to engage with the community, and an enthusiastic crowd of MySQL users ensure this is going to be a great event. The conference features 72 breakout sessions, keynotes by leading industry luminaries, an optional day of 16 tutorial sessions, a bustling exhibit hall, and numerous opportunities to connect with other community members.

    I am pleased to announce the conference Birds of a Feather sessions and Lightning Talks.

      [Read more...]
    Sphinx 2.0.2 Beta is released, Sphinx Users Conference in December
    +0 Vote Up -0Vote Down

    My friends at Sphinx Technologies have finally released new beta of Sphinx – Sphinx 2.0.2. It includes about 6 months of development and includes over 30 new features and tons of bug fixes. I’m happy to see how Sphinx 2.0 is shaping up a lot of rough corners are being polished and I’m hopeful we will see very solid Stable Sphinx 2.0 within next 3 to 6 months. In fact Sphinx 2.0.3-rc is promised within 1 month.

    What MySQL Users will find interesting in this release is a lot of work on SphinxQL the Sphinx’s language similar to SQL. Now it support number of functions such as SET NAMES which make it possible to connect to Sphinx as if it were MySQL Server with more

      [Read more...]
    MySQL performance on EC2/EBS versus RDS
    +2 Vote Up -0Vote Down

    A while ago I started a series of posts showing benchmark results on Amazon EC2 servers with RAID’ed EBS volumes and MySQL, versus RDS machines. For reasons that won’t add anything to this discussion, I got sidetracked, and then time passed, and I no longer think it’s a good idea to publish those blog posts in the format I was planning. Instead, I want to write an overview of these two approaches to hosting MySQL in the Amazon cloud.

    In general, MySQL performance overall on EC2 and EBS isn’t always great in comparison to what you can get on physical hardware, even low-to-medium sized servers. It’s not that it’s terrible (in most cases), but it’s not always great. There are specific use cases in which

      [Read more...]
    Product to try: MySQL/MariaDB-Galera 0.8
    +1 Vote Up -0Vote Down

    I wrote about Galera about 1.5 years ago: State of the art: Galera – synchronous replication for InnoDB. It was about the 0.7 release, which was more like a proof-of-concept release (though Galera’s developers may not agree with that ) with some serious limitations (like using mysqldump for node propagation). The Galera team heard my suggestions and the new 0.8 release looks very promising. Well, it took 1.5 years to fix the limitations and come up with new features, but there is nothing to complain about it – a synchronous distributed transactional system is not an easy problem to solve, trust me.

    So Galera 0.8 comes with many nice

      [Read more...]
    Shard-Query EC2 images available
    +1 Vote Up -0Vote Down

    Infobright and InnoDB AMI images are now available

    There are now demonstration AMI images for Shard-Query. Each image comes pre-loaded with the data used in the previous Shard-Query blog post. The data in the each image is split into 20 “shards”. This blog post will refer to an EC2 instances as a node from here on out. Shard-Query is very flexible in it’s configuration, so you can use this sample database to spread processing over up to 20 nodes.

    The Infobright Community Edition (ICE) images are available in 32 and 64 bit varieties. Due to memory requirements, the InnoDB versions are only available on 64 bit instances. MySQL will fail to start on a micro instance, simply decrease the values in the /etc/my.cnf file if you really want to try micro instances.

      [Read more...]
    Percona Live gets bigger: two more speaker tracks!
    +2 Vote Up -0Vote Down

    We’ve just rented more rooms, and published an additional two tracks of speakers for Percona Live in New York on May 26th. The schedule is here. There is a long queue of speaker submissions we’re finalizing and will be adding to the schedule, to fill the few empty slots in those new rooms.

    My favorite not-yet-confirmed session is from a company who has built their business in the Amazon cloud, and has seen just about every angle of running a large database in the cloud. This isn’t an extraordinary database, all things considered — as they told me, “it’s not a science fiction use case. It’s just science fiction to run it in the cloud.” That is precisely why this is such an interesting story to hear. There is a lot of

      [Read more...]
    MySQL caching methods and tips
    +2 Vote Up -0Vote Down
    “The least expensive query is the query you never run.”

    Data access is expensive for your application. It often requires CPU, network and disk access, all of which can take a lot of time. Using less computing resources, particularly in the cloud, results in decreased overall operational costs, so caches provide real value by avoiding using those resources. You need an efficient and reliable cache in order to achieve the desired result. Your end users also care about response times because this affects their work productivity or their enjoyment of your service. This post describes some of the most common cache methods for MySQL.

    Popular cache methods

    The MySQL query cache

    When the query cache is enabled, MySQL examines each query to see if the contents have been stored in the query cache. If the results have been cached they are


      [Read more...]
    MySQL on Amazon RDS part 2: Determining Peak Throughput
    +2 Vote Up -0Vote Down

    This is a continuation of my series of benchmark posts comparing Amazon RDS to a server running on Amazon EC2. Upcoming posts (probably 6 or 8 in total) will extend the scope of the benchmark to include data on our Dell r900 with traditional hard drives in RAID10, and a server in the Joyent cloud. As a reminder, my goal was to run a long-term benchmark and see how the instance performed over time. Can it sustain performance over a several-day period of intense workload? The first step was to determine the number of threads that should be used for the benchmark.

    To gauge this, I ran a series of 60-second benchmarks on the RDS server, and extracted the transactions per second from them, then used the peak throughput as my target configuration. The benchmark was sysbench oltp complex, with 400 million rows (88GB of data and indexes, which

      [Read more...]
    What’s up with HandlerSocket?
    +5 Vote Up -0Vote Down

    I’ve presented at two different venues about HandlerSocket recently and the number one question that always arises is:

    Why hasn’t HandlerSocket become more popular than it is?

    Considering how fast and awesome HandlerSocket is, it’s not seeing as rapid adoption as some might expect. I theorize that there are five reasons for this:

    Bugs, Bugs, Bugs

    Up until the beginning of the year, HandlerSocket had a couple of bugs that a lot of people considered deal-breakers, and it’s not widely known that these issues have been fixed.


      [Read more...]
    MySQL on Amazon RDS part 1: insert performance
    +2 Vote Up -0Vote Down

    Amazon’s Relational Database Service (RDS) is a cloud-hosted MySQL solution. I’ve had some clients hitting performance limitations on standard EC2 servers with EBS volumes (see SSD versus EBS death match), and one of them wanted to evaluate RDS as a replacement. It is built on the same technologies, but the hardware and networking are supposed to be dedicated to RDS, not shared with the general usage of AWS as you get on normal EC2 servers with EBS.

    I benchmarked the largest available RDS instance, which is listed as “High-Memory Quadruple Extra Large DB Instance: 68 GB of memory, 26 ECUs (8 virtual cores with 3.25 ECUs each), 64-bit platform, High I/O Capacity.” I used sysbench’s oltp benchmark, with

      [Read more...]
    Upcoming Webinar on HandlerSocket
    +0 Vote Up -0Vote Down

    On March 29th, I’ll be giving a webinar whose title is “Understanding HandlerSocket – A NoSQL PlugIn For MySQL”. This is a continuation and extension of the talk I gave during the Percona Live Event in San Francisco back in February. We’ll ask, and answer, the following questions:

    • What is HandlerSocket?
    • Where does HandlerSocket fit in my application stack?
    • Why would I want to use HandlerSocket?
    • How do I use Handlersocket?

    Description:

    http://www.percona.com/webinars/2011-03-29-understanding-handlersocket-a-nosql-plugIn-for-mysql/

    To register:

    https://percona-events.webex.com/percona-events/onstage/g.php?t=a&d=666931904

    Death match! EBS versus SSD price, performance, and QoS
    +3 Vote Up -0Vote Down

    Is it a good idea to deploy your database into the cloud? It depends. I have seen it work well many times, and cause trouble at other times. In this blog post I want to examine cloud-based I/O. I/O matters a lot when a) the database’s working set is bigger than the server’s memory, or b) the workload is write-heavy. If this is the case, how expensive is it to get good performance, relative to what you get with physical hardware? Specifically, how does it compare to commodity solid-state drives? Let’s put them in the ring and let them duke it out.

    I could do benchmarks, but that would not be interesting — we already know that benchmarks are unrealistic, and we know that SSDs would win. I’d rather look at real systems and see how they behave. Are the theoretical advantages of SSDs really a big advantage

      [Read more...]
    High availability for MySQL on Amazon EC2 – Part 5 – The instance monitoring script
    +1 Vote Up -0Vote Down

    This post is the fifth of a series that started here.

    From the previous posts of this series, we now have nearly everything setup, only a few pieces are missing. One of the missing pieces is the Pacemaker script that run on the MySQL instance.

    First, this script is optional, Pacemaker will accept a noop bash script but since we have the opportunity to run a script on the MySQL host, let’s take it. At minimum, let’s use mysqladmin to ping the database to see if it is available. If not, the recommended action is to stop the heartbeat service (pacemaker). Stopping Pacemaker will trigger a resource transfer to the monitoring instance which will

      [Read more...]
    Showing entries 1 to 23

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.