Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 30 of 184 Next 30 Older Entries

Displaying posts with tag: scalability (reset)

Howto automate MySQL slow query analysis with amazon RDS
+0 Vote Up -0Vote Down
If you’ve used relational databases for more than ten minutes, I hope you’ve heard of slow queries. Those are those pesky little gremlins that are slowing down your startup, and preventing scalability you so desperately need. Luckily there’s a solution. What I’ve found is if I send a report to developers every week, it keeps […]
If you use MySQL in the Amazon cloud, you need to ask yourself this question
+0 Vote Up -0Vote Down
Join 25,000 others and follow Sean Hull on twitter @hullsean. Are you serious about backups? If you’re just using Amazon EBS snapshots, that may not be sufficient. There’s a good chance it won’t protect you against your next data loss. That’s why I like to have a few different types of backups Also: 5 more […]
Using Apache Hadoop and Impala together with MySQL for data analysis
+0 Vote Up -0Vote Down

Apache Hadoop is commonly used for data analysis. It is fast for data loads and scalable. In a previous post I showed how to integrate MySQL with Hadoop. In this post I will show how to export a table from  MySQL to Hadoop, load the data to Cloudera Impala (columnar format) and run a reporting on top of that. For the examples below I will use the “ontime flight performance” data from my previous post (Increasing MySQL performance with parallel query execution). I’ve used the

  [Read more...]
MaxScale has now its own public irc channel
+1 Vote Up -0Vote Down

MaxScale is a Proxy for the MySQL protocol built with a modular architecture. The underlying concept of modules allows to extend the MaxScale proxy services. The current version implements Read Write splitting and Connection Load Balancing. Internally MySQL queries go through a SQL parsing phase. This gives MaxScale great capabilities regarding queries routing.

So if [...]

MaxScale, ProxySQL and MySQL Proxy
+2 Vote Up -0Vote Down

At FOSDEM 2014 ProxySQL and MaxScale were both presented. Both are proxy that can help build sophisticated MariaDB/MySQL architectures. But currently what is the most used proxy with MySQL? It is HAproxy. HAproxy is a level 4 proxy that has no knowledge of the MySQL protocol. Being low level makes it very fast but it [...]

Multiple masters : attraction to the stars
+0 Vote Up -0Vote Down

In the last 10 years I have worked a lot with replication systems, and I have developed a keen interest in the topic of multiple masters in a single cluster. My interest has a two distinct origins:

  • On one hand, I have interacted countless times with users who want to use a replication system as a drop-in replacement for a single server. In many cases, especially when users are dealing with applications that are not much flexible or modular, this means that the replication system must have several points of data entry, and such points must work independently and in symbiosis with the rest of the nodes.
  • On the other hand, I am a technology lover (look it up in the dictionary: it is spelled geek), and as such I get my curiosity stirred whenever I discover a new possibility of implementing multi-master systems.

The double nature of

  [Read more...]
Are SQL Databases Dead?
+1 Vote Up -0Vote Down
I like the image of this city of Mesa Verde. It’s fascinating to see how ancient cities were built, especially as an inhabitant of one of the worlds largest cities today, New York. I’m a long time relational database guy. I worked at scores of dot-coms in the 90′s as an old-guard Oracle DBA, and […]
5 great things about Markus Winand’s book SQL Performance Explained
+0 Vote Up -0Vote Down
Join 12,100 others and follow Sean Hull on twitter @hullsean. 1. Covers databases broadly You may not have noticed, but there’s a whole spectrum of relational databases on offer. Of course in the database world, most get infatuated with one, and that becomes their bread & butter before long. Their life, their passion, their devotion. […]
MariaDB CONNECT Storage Engine replay & slides available
+1 Vote Up -1Vote Down

The slides and replay of yesterday’s webinar on the MariaDB CONNECT storage engine have just been posted. First I want to thank the numerous attendees. You have shown great interest on the parallel execution of query on distributed MySQL Servers. I agree this is cool. The ODBC capabilities seems also to generate interest. This make [...]

MariaDB CONNECT Storage Engine and parallelism
+1 Vote Up -1Vote Down

The CONNECT Storage engine implement the concept of a table made of multiple tables. These underlying tables can be distributed remotely. For example the underlying remote tables can be of ODBC or MySQL table type. this allows to execute distributed queries. What is nice is that we can execute this distributed query with parallelism.

How [...]

MySQL Fabric with MariaDB Galera Cluster ?
+2 Vote Up -0Vote Down

MySQL Fabric is a very promising sharding framework. If I take Ulf Wendel definition of MySQL Fabric :

MySQL Fabric is an administration tool to build large “farms” of MySQL servers. In its most basic form, a farm is a collection of MySQL Replication clusters. In its most advanced form, a farm is a collection of [...]

InfiniDB column store moves to open source ! Congrats !
+2 Vote Up -0Vote Down

Like TokuDB, InfiniDB is now a fully open source server product. In the past infiniDB was “almost open source”. The open source version was an old release with no access to the advance functions like MPP multi-server execution. This is no more the case. With InfiniDB 4 the open source version is the latest release [...]

A new kid in the MySQL sharding world
+3 Vote Up -0Vote Down

MySQL Connect 2013 has been a great edition. There was of course a lot of nice announcements of improvements in the the core MySQL server technology. One of the major announcement that received a lot of buzz was MySQL Fabric. MySQL Fabric is an infrastructure component aimed at simplifying construction of a highly available, sharded, [...]

This Week in Website Performance
+0 Vote Up -0Vote Down

This Week in Website Performance is a weekly feature of the Monitis.com blog. It summarizes recent articles about website performance. Why? Because your friends at Monitis.com care.


HOW TO SCALE: A SEVEN-BULLET CHECKLIST

Author: Jeroen Remmerswaal.

As your site gains users and load increases, performance can suffer. Scaling to meet demand with expected performance is not always a simple task. This simple and straightforward article covers

  [Read more...]
Scalability Tips & Greatest Hits
+0 Vote Up -0Vote Down

Join 8000 others and follow Sean Hull on twitter @hullsean. In the past two years we’ve written a ton of material on scalability. Here’s the greatest hits… Why Generalists Are Better at Scaling the Web The internet stack is a complex infrastructure of interlocking components. An scalability engineer must be adept at Linux, plus webservers, […]

The post Scalability Tips & Greatest Hits appeared first on Scalable Startups.

3 Simple Patterns for Tighter MySQL Code
+0 Vote Up -0Vote Down

Join 8000 others and follow Sean Hull on twitter @hullsean. SQL is derided by many and for good reason. It’s key to scalability yet terribly difficult to write good code. Here’s a few quick tips to write tighter queries in MySQL 1. Get rid of those Subqueries! Subqueries are a standard part of SQL, unfortunately […]

The post 3 Simple Patterns for Tighter MySQL Code appeared first on Scalable Startups.

Scalability Happiness – A Quiet Query Log
+0 Vote Up -0Vote Down

Join 7500 others and follow Sean Hull on twitter @hullsean.

There’s a lot of talk on the web about scalability. Making web applications scale is not easy. The modern web architecture has so many moving parts. How can we grapple with the underlying problem?

Also: Why Are MySQL DBAs So Hard to Find?

The LAMP stack scales well

The truth that is half right. True there are a lot of moving parts, and a lot to setup. The internet stack made up of Linux, Apache, MySQL & PHP. LAMP as it’s called, was built to be resilient, dynamic, and scalable.

  [Read more...]
MySQL Subquery Optimization
+0 Vote Up -0Vote Down
Join 7000 others and follow Sean Hull on twitter @hullsean. MySQL’s optimizer can do a lot of things, but subqueries are not always handled well. Take a look at the IN subquery below. If you see the DEPENDENT SUBQUERY in your explain plan, you may want to take a second look. This will run slow [...]
How to Optimize MySQL UNION For High Speed
+0 Vote Up -1Vote Down
Join 6100 others and follow Sean Hull on twitter @hullsean. There are two ways to speedup UNIONs in a MySQL database. First use UNION ALL if at all possible, and second try to push down your conditions. [mytweetlinks] 1. UNION ALL is much faster than UNION How does a UNION work? Imagine you have two [...]
The Most Important AWS Feature for Performance and Scalability
+0 Vote Up -3Vote Down
Join 6100 others and follow Sean Hull on twitter @hullsean. The Foundation of Speed All servers use disk to store files. Operating system libraries, webserver & application code, and most importantly databases all use disk constantly. So disk speed is crucial to server speed. [mytweetlinks] [quote] Disk speed is crucial for MySQL databases. It has [...]
Five More Things Deadly to Scalability
+0 Vote Up -0Vote Down

Read the original article at Five More Things Deadly to Scalability

Join 6000 others and follow Sean Hull on twitter @hullsean. 1. Slow Disk I/O – RAID 5 – Multi-tenant EBS Disk is the grounding of all your servers, and the base of their performance. True with larger and larger main memory, much is available in cache, a server still needs to constantly read from disk [...]

For more articles like these go to Sean Hull's Scalable Startups

Related posts:
  • Mobile Scalability – What is it and why is it important?
  • 3 Ways to Boost Cloud
  •   [Read more...]
    Make MySQL clustering work for you
    +0 Vote Up -1Vote Down
    We’ve told you all about MySQL mult-master replication’s limitations. If you write to two masters it is bound to fail for myriad reasons. Now what? Do what the pros do that’s what. A. Don’t write to both masters Using multi-master replication works great as long as you do so in active-passive mode. Never write to [...]
    Scaling Drupal on Multiple Servers with Galera Cluster for MySQL
    +0 Vote Up -0Vote Down
    April 26, 2013 By Severalnines

    This post shows you how to move from a single instance Drupal/MySQL to a multi-server environment. A well designed multi-server deployment not only allows Drupal to scale, but will also enhance redundancy by removing single points of failure. Components used are Apache, PHP, csync2, lsyncd, Keepalived, HAproxy, MySQL Galera Cluster and ClusterControl.

    read more

    No tools to reconcile MySQL with two masters
    +0 Vote Up -0Vote Down
    Here’s the last nail in the coffin. We hope this convinces you not to write to multiple masters with MySQL replication. Reason 10 – No tools to reconcile inconsistent masters For all the endless reasons we’ve already outlined MySQL replication is prone to failure. We know it’s going to happen, you now know too. When [...]
    Temp tables can break replication
    +0 Vote Up -0Vote Down
    If you’re not convinced yet that writing to dual masters is a bad idea, we have a couple more reasons. 9. Temp tables break replication after restart MySQL’s replication is sensitive to temporary tables. You shouldn’t use them. If your queries create them to work against, and a node crashes, the temp tables will be [...]
    Crashed nodes corrupt your MySQL cluster
    +0 Vote Up -0Vote Down

    Read the original article at Crashed nodes corrupt your MySQL cluster

    Writing to two masters is like walking around with a loaded shotgun. Eventually one of your instances will fail and when it does, replications position & synchronization information could easily become corrupt! Reason 8 – Crashed nodes cause big problems MySQL instances, unfortunately can crash. When that happens, they don’t always sync the replication position [...]

    For more articles like these go to Sean Hull's Scalable Startups

    Related posts:
  • MySQL Cluster In The Cloud – Managers Guide
  •   [Read more...]
    Transaction isolation breaks when writing two masters
    +0 Vote Up -0Vote Down

    Read the original article at Transaction isolation breaks when writing two masters

    Continuing our discussion of multi-master replication, we hit on five more reasons why writing to two masters aka active-active replication is very dangerous. Click through to the end for multi-master solutions that work with MySQL. Reason 6 – You lose transaction isolation This may sound like a theoretical point to some. But hopefully we can [...]

    For more articles like these go to Sean Hull's Scalable Startups

    Related posts:
  • MySQL needs single master to check data integrity
  •   [Read more...]
    Active-active replication reduces operational flexibility
    +0 Vote Up -0Vote Down

    Read the original article at Active-active replication reduces operational flexibility

    Among the myriad data integrity and corruption risks associated with active-active replication, you also lose out on configurability and operational flexibility. Reason 7 – Can’t add nodes easily The often touted solution to use auto_increment_increment and auto_increment_offset fixes you to a given setup forever. You can set it up with a discrete two nodes, all [...]

    For more articles like these go to Sean Hull's Scalable Startups

    Related posts:
  • 10 reaons active-active is hard and how to solve it
  •   [Read more...]
    How to make MySQL multi-master work for you
    +0 Vote Up -0Vote Down

    Read the original article at How to make MySQL multi-master work for you

    Coming soon! Want more? Grab our Scalable Startups monthly for more tips and special content. Here’s a sample Related posts:Transaction isolation breaks when writing two masters MySQL requires an authoritative master to build slaves MySQL needs single master to check data integrity A master isn’t born but made Why does MySQL replication fail?

    For more articles like these go to Sean Hull's Scalable Startups

    Related posts:
  • Transaction isolation breaks when writing two masters
  •   [Read more...]
    MySQL needs single master to check data integrity
    +0 Vote Up -0Vote Down

    Read the original article at MySQL needs single master to check data integrity

    MySQL slaves can drift out of sync. Many of our clients are surprised to find some data differences in their replication topology, once we do some checking and sniffing around. Such checks require a single reliable or authoritative master to compare against. Click through to the end for multi-master solutions that work with MySQL. Reason [...]

    For more articles like these go to Sean Hull's Scalable Startups

    Related posts:
  • MySQL requires an authoritative master to build slaves
  •   [Read more...]
    Showing entries 1 to 30 of 184 Next 30 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.