Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 30 of 46 Next 16 Older Entries

Displaying posts with tag: Clustering (reset)

Multiple masters : attraction to the stars
+0 Vote Up -0Vote Down

In the last 10 years I have worked a lot with replication systems, and I have developed a keen interest in the topic of multiple masters in a single cluster. My interest has a two distinct origins:

  • On one hand, I have interacted countless times with users who want to use a replication system as a drop-in replacement for a single server. In many cases, especially when users are dealing with applications that are not much flexible or modular, this means that the replication system must have several points of data entry, and such points must work independently and in symbiosis with the rest of the nodes.
  • On the other hand, I am a technology lover (look it up in the dictionary: it is spelled geek), and as such I get my curiosity stirred whenever I discover a new possibility of implementing multi-master systems.

The double nature of

  [Read more...]
Must-see webinars for SaaS and business-critical MySQL users
+0 Vote Up -0Vote Down
Join Continuent and our customers Modernizing Medicine and Marketo to learn how to run business-critical MySQL applications in the cloud or on-premises. Modernizing Medicine is a fast-growing SaaS company, offering electronic medical records management solution. Matthew Lang, Sr. Site Reliability Engineer at Modernizing Medicine, describes how Modernizing Medicine serves thousands of customers
Scaling Drupal on Multiple Servers with Galera Cluster for MySQL
+0 Vote Up -0Vote Down
April 26, 2013 By Severalnines

This post shows you how to move from a single instance Drupal/MySQL to a multi-server environment. A well designed multi-server deployment not only allows Drupal to scale, but will also enhance redundancy by removing single points of failure. Components used are Apache, PHP, csync2, lsyncd, Keepalived, HAproxy, MySQL Galera Cluster and ClusterControl.

read more

Multi-master data conflicts - Part 1: understanding the problem
+3 Vote Up -0Vote Down

What is a conflict?

Readers of this blog know that one of my favorite tools, Tungsten Replicator, can easily create multi-master replication topologies, such as all-masters, star, fan-in. While this is good news for system designers and ambitious DBAs, it also brings some inconvenience. When you allow updates to happen in more than one master, you risk having conflicts. You may have heard this term before. For the sake of clarity, let's define what conflicts are, before analyzing each case in detail.

You have a conflict when several sources (masters) update concurrently the same data in asynchronous replication.

It's important to stress that this happens with asynchronous replication. In a truly synchronous cluster, where all data is kept consistent through

  [Read more...]
Building a MySQL Private Cloud: Step 1
+1 Vote Up -0Vote Down

Building clusters is usually a fun time. Here’s one of my setups at the Equinix LAX1 facility that is being used for VPN services, OpenVZ clustering, and general RADIUS and MySQL clustering integration. Once the clustering design is finalized, it’s still in flux state while I try out different setups, I’ll post some physical+logical architecture diagrams to show “How to Build a Fault Tolerant Infrastructure for Virtualized MySQL NDB Cluster + Python-based VPN systems.” Stay tuned for more.

Tungsten University: Configure & provision Continuent Tungsten clusters
+1 Vote Up -0Vote Down
Are you unsure of the steps needed to get your Continuent Tungsten cluster up-and-running? In this virtual course, we will teach you how to get from a single database server to a scalable cluster, or from a brittle MySQL replication system to a transparent, manageable Tungsten cluster.  We will discuss the benefits of leveraging Continuent Tungsten clustering with MySQL, and walk you through the
Database Virtualization, What it Really Means
+0 Vote Up -0Vote Down

This is a response to a blog postby analyst and marketing consultant Curt Monash.
Originally virtualization meant running one operating system in a window inside of another operating system, e.g. running a Linux on a Windows machine using Microsoft Virtual PC or VMWare. Then virtualization evolved to mean slicing a single server into many for more granular resource allocation (Curt’s ex uno plures, translated: out of one, many). It has since expanded to include e pluribus unum (from many, one) and e pluribus ad pluribus (from many to many). This is evidenced in the use of the term “virtualization” to create the compound words: server virtualization, storage virtualization, network virtualization and now database virtualization.

  [Read more...]
Meet you in London - Percona Live MySQL Conference
+0 Vote Up -0Vote Down
Continuent is proud to sponsor Percona Live MySQL Conference: London 2012!  Don't miss these five (5) talks by our database replication and clustering stars: Keynote: Future-Proofing MySQL for the World-Wide Data Revolution, by Robert Hodges Why, What, and How of Data Warehouses for MySQL, by Robert Hodges Multi-master, Multi-site MySQL Databases Made Easy with Continuent Tungsten, by Robert
Webinar 12/6 - Multi-master, star, and fan-in replication made easy with Tungsten
+0 Vote Up -0Vote Down
December 6th @ 10 am PT/1pm ET Learn more at http://bit.ly/U51cM5   Tungsten Replicator is a popular replacement for MySQL replication. With new 2.0.6 release, it has now become a mature and robust product, with an easy-to-use installer. While installing a simple master/slave topology was made as easy as it could possibly be, installing complex topologies was still a matter for advanced users
Haute disponibilité MySQL, par Continuent
+0 Vote Up -1Vote Down
Real-time Replication Between Oracle and Oracle, and Oracle and MySQL
+0 Vote Up -0Vote Down
Re Oracle is the most powerful database system in the world. However, Oracle's expensive and complex replication makes it difficult to build highly available applications or move data in real-time to data warehouses and popular databases like MySQL.  In this video (recording of our live webcast on 10/18/12) you will learn how Continuent Tungsten solves problems with Oracle replication at a
MySQL Cluster 7.2 GA Released, Delivers 1 BILLION Queries per Minute
Employee_Team +0 Vote Up -0Vote Down
0 0 1 14 83 Homework 1 1 96 14.0 Normal 0 false false false EN-GB JA X-NONE

70x Higher JOIN Performance, NoSQL Key-Value API & Cross Data Center Sharding with Synchronous Replication 

0 0 1 535 3052 Homework 25 7 3580 14.0 Normal 0 false  [Read more...]
Synchronously Replicating Databases Across Data Centers – Are you Insane?
Employee_Team +0 Vote Up -0Vote Down

Well actually….no. The second Development Milestone Release of MySQL Cluster 7.2 introduces support for what we call “Multi-Site Clustering”. In this post, I’ll provide an overview of this new capability, and considerations you need to make when considering it as a deployment option to scale geographically dispersed database services.

You can read more about MySQL Cluster 7.2.1 in the article posted on the MySQL Developer Zone

MySQL Cluster has long offered Geographic Replication, distributing clusters to remote data centers to reduce the affects of geographic latency by pushing data closer to the user, as well as providing a capability for

  [Read more...]
Synchronously Replicating Databases Across Data Centers – Are you Insane?
Employee_Team +4 Vote Up -0Vote Down

Well actually….no. The second Development Milestone Release of MySQL Cluster 7.2 introduces support for what we call “Multi-Site Clustering”. In this post, I’ll provide an overview of this new capability, and considerations you need to make when considering it as a deployment option to scale geographically dispersed database services.

You can read more about MySQL Cluster 7.2.1 in the article posted on the MySQL Developer Zone

MySQL Cluster has long offered Geographic Replication, distributing clusters to remote data centers to reduce the affects of geographic latency by pushing data closer to the user, as well as providing a capability for disaster

  [Read more...]
Simpler and Safer Clustering: MySQL Cluster Manager Update
Employee_Team +5 Vote Up -0Vote Down
0 0 1 710 4053 Homework 33 9 4754 14.0 Normal 0 false false false EN-US JA X-NONE

Clustered computing brings with it many benefits: high performance, high availability, scalable infrastructure, etc. But it also brings with it more complexity.


Well, by its very nature, there

  [Read more...]
Memory tuning fast paced ETL
+3 Vote Up -0Vote Down

Dear Kettle friends,

on occasion we need to support environments where not only a lot of data needs to be processed but also in frequent batches.  For example, a new data file with hundreds of thousands of rows arrives in a folder every few seconds.

In this setting we want to use clustering to use “commodity” computing resources in parallel.  In this blog post I’ll detail how the general architecture would look like and how to tune memory usage in this environment.

Clustering was first created around the end of 2006.  Back then it looked like this.

The master

This is the most important part of our cluster.  It takes care of administrating network configuration and topology.  It also keeps track of the state of dynamically added slave servers.

The master is started

  [Read more...]
A few notes on InnoDB PRIMARY KEY
+0 Vote Up -1Vote Down
InnoDB uses an index-organized data storage technique, wherein the primary key acts as the clustered index and this clustered index holds the data. Its for this reason that understanding the basics of InnoDB primary key is very important, and hence the need for these notes.
Advanced replication for the masses - Part II - Parallel replication
+4 Vote Up -1Vote Down
I hope you liked the first part of this series of lessons. And I really hope that you have followed the instructions and got your little replication cluster up and working.
If you haven't done that, thinking that you would spare your energies for more juicy matters, I have news for you. What I explained in the previous part is exactly what you need to do to set up parallel replication. With just a tiny additional detail.
For the sake of the diligent readers who have followed the instructions with the first lessons, I won't repeat them, but I'll invite you

  [Read more...]
Advanced replication for the masses - Part I - Getting started with Tungsten Replicator
+11 Vote Up -1Vote Down
MySQL DBAs and developers: oil your fingers and get ready to experience a new dimension of data replication. I am pleased to announce that Continuent has just released Tungsten Replicator 2.0, an open source data replication engine that can replace MySQL native replication with a set of advanced features.
A note about the source code. The current version of Tungsten Replicator available in the web site is free to use, but it is not yet the open source version. We need a few weeks more to extract the code from the enterprise tree and make a new build. But we
  [Read more...]
Understanding InnoDB clustered indexes
+3 Vote Up -0Vote Down
Some people don't probably know, but there is a difference between how indexes work in MyISAM and how they work in InnoDB, particularly when talking from the point of view of performance enhancement. Now since, InnoDB is starting to be widely used, it is important we understand how indexing works in InnoDB. Hence, the reason for this post!
Josh Berkus helps clarify clustering
+1 Vote Up -1Vote Down

If you haven’t seen it, Josh Berkus has a very concise way to look at the confusing mess that is database “clustering” from the point of view of three distinct types of users: transactional, analytic, and online. I think that using this kind of distinction could help keep discussions clear — I’ve seen a lot of conversations around clustering run off the rails due to disagreements about what clustering means. MySQL Cluster, for example, is a huge red herring for a lot of people, but it seems to be a difficult process to learn it well enough to decide. If we called it a clustering solution for transactional users, but not for analytic or online users, it might help a lot.

Related posts:

  •   [Read more...]
    Video: The ScaleDB shared-disk clustering Storage Engine for MySQL
    +4 Vote Up -0Vote Down

    Mike Hogan, CEO of ScaleDB spoke at the Boston MySQL User Group in September 2009:

    ScaleDB is a storage engine for MySQL that delivers shared-disk clustering. It has been described as the Oracle RAC of MySQL. Using ScaleDB, you can scale your cluster by simply adding nodes, without partitioning your data. Each node has full read/write capability, eliminating the need for slaves, while delivering cluster-level load balancing. ScaleDB is looking for additional beta testers, there is a sign up at http://www.scaledb.com.

    Slides are online (and downloadable) at http://www.slideshare.net/Sheeri/scale-db-preso-for-boston-my-sql-meetup-92009

    Watch the video online at http://www.youtube.com/watch?v=emu2WfNx4KA or directly embedded here:

    Failure scenarios and solutions in master-master replication
    +2 Vote Up -0Vote Down

    I’ve been thinking recently about the failure scenarios of MySQL replication clusters, such as master-master pairs or master-master-with-slaves. There are a few tools that are designed to help manage failover and load balancing in such clusters, by moving virtual IP addresses around. The ones I’m familiar with don’t always do the right thing when an irregularity is detected. I’ve been debating what the best way to do replication clustering with automatic failover really is.

    I’d like to hear your thoughts on the following question: what types of scenarios require what kind of response from such a tool?

    I can think of a number of failures. Let me give just a few simple examples in a master-master pair:

    Problem: Query overload on the writable master makes mysqld unresponsive Do nothing.  [Read more...]
    MySQL Query Analyzer Review
    +0 Vote Up -0Vote Down
    Updated: Monolith Toolkit - MySQL DBA tools 0.4.2
    +0 Vote Up -0Vote Down

    Updated the release, sure it’s only been a matter of hours but I added the standard cnf files for 2,4,8 and 16GB server installations. Also added the rhcluster-wrapper script that can be used to run just about anything on the active database node when using mysql in an active/passive setup.

    Download here:  http://code.google.com/p/monolith-toolkit/

    Monolith Toolkit - MySQL DBA tools released!
    +0 Vote Up -0Vote Down

    Today I decided to package all of my various scripts together into a useful toolkit. Some are perl, some are shell script. These scripts are, in general, one off scripts that I wrote in order to get things done that weren’t available at the time. Now they’re nicely organized and will receive updates at the google code repo.

    So far the toolkit includes the following scripts:

    • mt-backup-parallel -> the parallel backup script I wrote about in my last post
    • mt-check-replication -> script to report on replication status for slave servers
    • mt-check-rhcluster-filesystems -> reports on redhat cluster filesystems (for mysql active/passive clustering)
    • mt-connections-log -> logs connections to mysql to disk, reports on threshold overages
    • mt-flush-tables-sequence -> runs
      [Read more...]
    Continuent launches Tungsten project for database scale-out
    +0 Vote Up -0Vote Down

    Continuent is probably best known for its database clustering technology for MySQL, as well as PostgreSQL, but the company has for some time had its sights set on expanding beyond open source databases and enabling horizontal database scalability.

    It has just taken a major step towards delivering on both counts with the launch of Tungsten, its new stack of open source middleware technologies designed to enable low-cost databases to scale horizontally for database failover and continuity.

    Tungsten includes includes Sequoia, the existing synchronous

      [Read more...]
    Spinn3r Hiring Senior Systems Administrator
    +0 Vote Up -0Vote Down

    Spinn3r is hiring for an experienced Senior Systems Administrator with solid Linux and MySQL skills and a passion for building scalable and high performance infrastructure.

    About Spinn3r:

    Spinn3r is a licensed weblog crawler used by search engines, weblog analytic companies, and generally anyone who needs access to high quality weblog data.

    We crawl the entire blogosphere in realtime, remove spam, rank, and classifying blogs, and provide this information to our customers.

    Spinn3r is rare in the startup world in that we’re actually profitable. We’ve proven our business model which gives us a significant advantage in future

      [Read more...]
    Using ZooKeeper to configure External Monitoring Systems
    +0 Vote Up -0Vote Down

    I’m going to be migrating to using ZooKeeper within Spinn3r for a myriad of reasons but this one is especially powerful.

    One could use ZooKeeper to configure external monitoring systems like Munin and Ganglia.

    ZooKeeper enables this with its support for ephemeral files.

    If you have an external process like a webserver, database, robot, etc you can have it create a ephemeral file which registers its services and presence in the cluster.

    For example:


    Would represent a machine named www32.mydomain.com.

    You can then have munin connect to ZooKeeper and enumerate files in /services/www and have a

      [Read more...]
    RAM vs SSD Based Databases
    +0 Vote Up -0Vote Down
    Showing entries 1 to 30 of 46 Next 16 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.