Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 30 of 33 Next 3 Older Entries

Displaying posts with tag: mysql fabric (reset)

Q&A: Putting MySQL Fabric to use
+1 Vote Up -0Vote Down

Martin Arrieta and I gave an online presentation last week on “Putting MySQL Fabric To Use.” If you missed it, you can find a recording and the slides here, and the vagrant environment we used plus a transcript of the commands we ran here (be sure to check out the ‘sharding’ branch, as that’s what we used during the webinar).

Thank you all for attending and asking interesting questions. We were unable to answer all of them in the scheduled time, so here are our replies

  [Read more...]
MySQL Fabric/MySQL Utilities 1.4.4 released
Employee +2 Vote Up -0Vote Down

The binary and source versions of MySQL Utilities/MySQL Fabric have now been made available at http://dev.mysql.com/downloads/utilities/.

This release contains bug fixes and minor enhancements – full details can be found in the MySQL Fabric/MySQL Utilities release notes.

Putting MySQL Fabric to Use: July 30 webinar
+1 Vote Up -0Vote Down

Martin and I have recently been blogging together about MySQL Fabric (http://www.mysql.com/products/enterprise/fabric.html) (in case you’ve missed this, you can find the first post of the series here), and on July 30th, we’re going to be presenting a webinar on this topic titled “Putting MySQL Fabric to Use.”

The focus of the webinar is to help you get started quickly on this technology, so

  [Read more...]
Managing shards of MySQL databases with MySQL Fabric
+1 Vote Up -1Vote Down

This is the fourth post in our MySQL Fabric series. In case you’re joining us now, we started with an introductory post, and then discussed High Availability (HA) using MySQL Fabric here (Part 1) and here (Part 2). Today we will talk about how MySQL Fabric can help you scale out MySQL databases with sharding.

Introduction

At the time of writing, MySQL Fabric includes support for range- and hash-based sharding. As with HA, the functionality is split between client, through a MySQL Fabric-aware connector; and server, through the

  [Read more...]
Sharding & HA – MySQL Fabric Webinar Replay + Q&A
Employee +2 Vote Up -0Vote Down

On 19th June 2014, Mats Kindahl and I presented a free webinar on why and how you should be using MySQL Fabric to add Sharding (scaling out reads & writes) and High Availability to MySQL. The webinar replay is available here (http://www.mysql.com/news-and-events/web-seminars/mysql-fabric-high-availability-automated-sharding-for-mysql/" target="_blank). This blog post includes a transcript of the questions raised during the live webinar together with the responses given – if you’re questions aren’t answered already then please feel free to post them

  [Read more...]
MySQL Fabric a big hit at Texas Linuxfest
Employee +2 Vote Up -1Vote Down

MySQL was proud to return as a sponsor of the Texas Linuxfest last weekend. Over 700 tickets sold and I probably talked to all bu two or three. Luckily I had help from Quality Assurance Guru Jeb Miller and Software Release Manager Hema Sridharan as things got very busy. The crowd was really supportive of us, MySQL, and extremely friendly.

MySQL Fabric was a popular topic of discussion. Evidently playing ‘who has the virtual IP address’ is a big problem for DevOps staffs and Fabric solves that issue. Many in attendance were on the verge of needing to shard their data and liked having a tool to manage the work for them.

And Workbench 6.1 is extremely popular. Me, “Have you seen the latest MySQL Workbench in

  [Read more...]
Fabric Webinar with Andrew Morgan June 19th.
Employee +2 Vote Up -1Vote Down

MySQL Fabric – High Availability & Automated Sharding for MySQL

MySQL Fabric is built around an extensible and open source framework for managing farms of MySQL Servers. Currently two features have been implemented – High Availability (built on top of MySQL Replication) and scaling out using data sharding. These features can be used in isolation or in combination. MySQL Fabric aware connectors allow transactions and queries to be routed to the correct servers without the need for a proxy node, so operations run as quickly as ever. In this webinar you will learn what MySQL Fabric is, what it can achieve and how it is used – by DBAs, Dev-Ops and developers. You’ll also be exposed to what is happening under the covers.

  [Read more...]
Sharding & HA – MySQL Fabric Webinar
Employee +4 Vote Up -1Vote Down

On Thursday (19th June), Mats Kindahl and I will be presenting a free webinar on why and how you should be using MySQL Fabric to add Sharding (scaling out reads & writes) and High Availability to MySQL. This product has only recently gone GA and so this is a good chance to discover it’s for you and to get your questions answered by the people who wrote the software! All you need to do is register for the MySQL Fabric webinar here (http://www.mysql.com/news-and-events/web-seminars/mysql-fabric-high-availability-automated-sharding-for-mysql/" target="_blank).

Abstract

  [Read more...]
Build a MySQL Fabric Farm in one step using AWS CloudFormation
Employee +1 Vote Up -0Vote Down

I have been building a CloudFormation template for MySQL Fabric as an experiment to kick the tyres and further my understanding of how it all works.

For those not familiar, CloudFormation is a way of representing a collection of Amazon Cloud resources (a "stack") into a static json file (a "template"). In my previous company, we managed our AWS account almost exclusively via CloudFormation, and there are two key advantages I see with managing resources via templates:

  • It allows for all environments to be synchronized (dev/qa/production).
  • It allows for very fast disaster recovery (you can very quickly pick up and restore in another region).

CloudFormation is also a great-fit for MySQL Fabric, since it can remove many of the essential bootstrap steps that come

  [Read more...]
High Availability with MySQL Fabric: Part II
+1 Vote Up -0Vote Down

This is the third post in our MySQL Fabric series. If you missed the previous two, we started with an overall introduction, and then a discussion of MySQL Fabric’s high-availability (HA) features. MySQL Fabric was RC when we started this series, but it went GA recently. You can read the press release here, and see this blog post from Oracle’s Mats Kindahl for more details. In our previous post, we showed a simple HA setup managed with MySQL Fabric, including some basic failure

  [Read more...]
MySQL Fabric: The --update_only option because one size does not fit all
Employee +1 Vote Up -0Vote Down
MySQL Fabric is a distributed framework that has high availability and sharding as targets. It organizes the servers in groups which use the standard MySQL Replication to providing fault-tolerance. Shards are assigned to different groups thus allowing applications to distribute both reads and writes and exploit resilience to failures as well.

Information on groups, servers and shards are stored in a MySQL Instance called state store or backing store. This instance is a repository for all this information and the engine used might be any supported by MySQL, although a transactional engine must be picked to truly provide fault-tolerance. Note though that we have been testing MySQL Fabric with Innodb and currently this the only official engine supported.

Built upon the repository there are several functions that, besides being used to retrieve



  [Read more...]
MySQL Fabric: Musings on Release 1.4.3
Employee +2 Vote Up -0Vote Down
As you might have noticed in the press release, we just released MySQL Utilities 1.4.3, containing MySQL Fabric, as a General Availability (GA) release. This concludes the first chapter of the MySQL Fabric story.

It all started with the idea that it should be as easy to manage and setup a distributed deployments with MySQL servers as it is to manage the MySQL servers themselves. We also noted that some of the features that were most interesting were sharding and high-availability. Since we also recognized that every user had different needs and needed to customize the solution, we set of to create a framework that would support sharding and high-availability, but also other solutions.

With the release of 1.4.3, we have a range of features that are now available to the community, and all under

  [Read more...]
MySQL Fabric now Generally Available – Automating High Availability and Sharding for MySQL
Employee +5 Vote Up -0Vote Down


MySQL Fabric is a new framework that automates High Availability (HA) and/or sharding (scaling-out) for MySQL and it has just been declared Generally Available.

This post focuses on MySQL Fabric as a whole – both High Availability and scaling out (sharding). It starts with an introductions to HA and scaling out (by partitioning/sharding data) and how MySQL Fabric achieves it before going on to work through a full example of deploying HA with MySQL Fabric and then adding sharding on top.


  [Read more...]
MySQL Fabric: Server Properties & Scaling out reads
Employee +0 Vote Up -0Vote Down
MySQL Replication is a well-known approach to providing high-availability and scaling out read-only operations (i.e. transactions) as well. In order to make it easy to exploit this scalability axis, we have extended both Fabric and the connectors' interface so that an application can express its willingness to execute a read-only operation and have its request redirected to the server that is most capable of handling it.

In this post, we are going to describe how we can use Fabric and the connector python to scale out read-only operations. We need to introduce some concepts first though.

Fabric organizes the servers in high-availability groups, uses the standard MySQL Replication to synchronize the servers which can be classified according to its status, mode and weight. The blog post



  [Read more...]
MySQL 5.7 & Fabric in Sunnyvale May 22nd
Employee +1 Vote Up -0Vote Down

MySQL Fabric and 5.7 will be the topics of presentations this Thursday (5/22) at the Plug and Play Tech Center in Sunnyvale, California. Lee Stigile is presenting: What’s new in MySQL 5.7, and Sastry Vendantam is presenting MySQL Fabric.

Agenda is as follows:

5:00-5:30 Networking/Socialize over food and drinks
5:30-6:00 Lee will present MySQL 5.7
6:00-6:30 Sastry will present Fabric
6:30-7:00 Q&A and Socialize over food and drinks

Here is the link to register/RSVP

Plug and Play Tech Center
Thursday, May 22, 2014 from 5:00 PM to 7:00 PM (PDT)
440 N Wolfe Rd
Sunnyvale, CA 94085









  [Read more...]
High Availability with MySQL Fabric: Part I
+2 Vote Up -0Vote Down

In our previous post, we introduced the MySQL Fabric utility and said we would dig deeper into it. This post is the first part of our test of MySQL Fabric’s High Availability (HA) functionality.

Today, we’ll review MySQL Fabric’s HA concepts, and then walk you through the setup of a 3-node cluster with one Primary and two Secondaries, doing a few basic tests with it. In a second post, we will spend more time generating failure scenarios and documenting how Fabric handles them. (MySQL Fabric is an extensible framework to manage large farms of MySQL servers, with support for high-availability and sharding.)

Before we begin, we recommend you read 

  [Read more...]
MySQL Fabric: Tales and Tails from Percona Live
Employee +2 Vote Up -0Vote Down
Going to Percona Live and presenting MySQL Fabric gave me the opportunity to meet a lot of people and get a lot of good feedback. I talked to developers from many different companies and got a lot of great feedback that will affect the priorities we make, so to all I spoke to I would like to say a great "Thank you!" for the interesting discussions that we had. Your feedback is very valuable. It was very interesting to read the comments on MySQL Fabric on MySQL Performance Blog. The article discuss the current version of MySQL Fabric distributed with MySQL Utilities  [Read more...]
Managing farms of MySQL servers with MySQL Fabric
+2 Vote Up -0Vote Down

While built-in replication has been a major cause for MySQL’s wide adoption, official tools to help DBAs manage replication topologies have typically been missing from the picture. The community has produced many good products to fill in this gap, but recently, Oracle has been filling it too with the addition of MySQL Utilities to the mix.

One part of the Utilities that has been generating interest recently is MySQL Fabric, and we will be discussing this project in an upcoming series of blog

  [Read more...]
Writing a Fault-tolerant Database Application using MySQL Fabric - MySQL Fabric 1.4.2 Release Candidate
Employee +2 Vote Up -0Vote Down
If we want to run the application presented in "Writing a Fault-tolerant Database Application using MySQL Fabric" with MySQL Fabric 1.4.2 Release Candidate, some changes to the application are required. In the previous post, we used MySQL Fabric 1.4.0 Alpha and many changes have been made since this version. We can find an updated version of the application here:
Recall that the application creates a simple database, a high availability group, registers the MySQL Servers into Fabric and runs a thread that mimics a client and another one that
  [Read more...]
Configuring and running MySQL Fabric 1.4.2
Employee +1 Vote Up -0Vote Down
To install and run MySQL Fabric, we need:
  • Python 2.6 or 2.7
  • Connector Python (MySQL Fabric-aware Version 1.2.1 or later)
  • One or more MySQL servers installed and running (5.6.10 or later):
    • Backing Store
    • Managed Servers
  • MySQL Utilities 1.4.2 or later

Python 2.6 or 2.7

We can use the following command to check whether python is installed in our machine or not:

$ python --version

If you don't have the appropriate version installed, please, read through the following web page and find out how to download and install python 2.6 or 2.7:


MySQL 5.6












  [Read more...]
MySQL Fabric 1.4.2 Release Candidate is out
Employee +1 Vote Up -0Vote Down
MySQL Utilities 1.4.2 Release Candidate is out and it includes MySQL Fabric as well. We have made MySQL Fabric more solid and worked on stabilizing the connector "interfaces" for load-balancing and scale-out. MySQL Utilities 1.4.2 is available for download from:

http://dev.mysql.com/downloads/tools/utilities/1.4.html

Use the following forum to provide us suggestions, comments or any feedback:

http://forums.mysql.com/list.php?144

If you come across any bug or have any feature request, please, report it through our public bug system category "MySQL Fabric".

Help us make this an awesome shard solution.
MySQL Fabric – adding Scaling to MySQL
Employee +3 Vote Up -0Vote Down

MySQL Fabric is a new framework that adds High Availability (HA) and/or scaling-out for MySQL. This is the second in a series of posts on the new MySQL Fabric framework; the first article (MySQL Fabric – adding High Availability to MySQL) explained how MySQL Fabric can deliver HA and then stepped through all of the steps to configure and use it.

This post focuses on using MySQL Fabric to scale out both reads and writes across multiple MySQL Servers. It starts with an introduction to scaling out (by partitioning/sharding data)

  [Read more...]
MySQL Fabric – adding High Availability to MySQL
Employee +5 Vote Up -0Vote Down

MySQL Fabric is a new framework that adds High Availability (HA) and/or scaling-out for MySQL. MySQL Fabric achieves scale-out by managing the sharding of table data between multiple MySQL Servers and then having Fabric-aware connectors route queries and transactions to the correct locations – scaling-out will be the subject of a future post and the rest of this article is focused on using MySQL Fabric for HA. It starts with an introduction to HA and how MySQL Fabric delivers it before going on to work through a full example of configuring a HA farm of MySQL Servers together with the code that the

  [Read more...]
Oracle’s Mats Kindahl to weave MySQL Fabric into Percona Live session
+2 Vote Up -0Vote Down

Mats Kindahl of Oracle is lead developer of MySQL Fabric

MySQL Fabric is an integrated framework for managing farms of MySQL servers with support for both high-availability and sharding. Its development has been spearheaded by Mats Kindahl, senior principal software developer in MySQL at Oracle.

Mats is leading the MySQL Scaling and High-Availability effort covering the newly released MySQL Fabric and the MySQL Applier for Hadoop. He is also the architect and implementer of several features (mostly replication features), including the row-based replication available in 5.1 and the binary log group commit available in MySQL 5.6. Before starting MySQL he earned a doctoral degree in the area of automated

  [Read more...]
Weaving with Fabric
Employee +0 Vote Up -0Vote Down
Interview with Mats Kindahl, a MySQL Senior Software Engineer, on MySQL Fabric.
MySQL Connect presentations on MySQL Fabric
Employee +1 Vote Up -0Vote Down
MySQL Connect Conference was a great success and I am really happy for being
able to attend it this year. Oracle showed interesting improvements and
exciting features in the upcoming MySQL 5.7 and released a very early alpha
version of MySQL Fabric which is a framework for managing farms of MySQL
servers.

You can find the presentations about MySQL Fabric on SlideShare:

  . MySQL Sharding: Tools and Best Practices for Horizontal Scaling
  . MySQL High Availability: Managing Farms of Distributed Servers

If you haven't watched yet Edward Screven and Tomas Ulin keynote on “The State
of the Dolphin”,











  [Read more...]
Sharding PHP with MySQL Fabric
Employee +0 Vote Up -0Vote Down

PHP users who attended any of my recent PHP&MySQL related talks or read Ulf's blog will know our mysqlnd_ms plugin. This plugin hooks into PHP's mysqlnd library and provides transparent support for replication and load-balancing features. Without changing your application you get transparent load-balancing and read-writ splitting so all your reading queries will be sent to a slave while the writes go to a master server. The exact strategies for that can be defined in mysqlnd_ms's configuration so quite often no, or only few application changes are needed. But we have one limitation: The MySQL servers have to be configured in each configuration on all your PHP servers, this can be annoying when you're changing your environment like adding a new slave or promoting a machine to master in case

  [Read more...]
MySQL Connect presentations on MySQL Fabric available on SlideShare
Employee +1 Vote Up -0Vote Down
Going to MySQL Connect was truly a blast. We got a lot of good questions and feedback in the sessions and there were a lot of interest in both MySQL Fabric and the MySQL Applier for Hadoop.

A big thank you to all that attended the talks, I got a lot of good questions and comments that will help us build good solutions.

The talks are available on SlideShare:





  [Read more...]
Installing MySQL Fabric on Windows
Employee +3 Vote Up -0Vote Down

One of the major announcements made at the MySQL Connect conference just over a week ago was the labs release of MySQL Fabric, which supports management of MySQL Server farms in a sharded deployment.  It’s available on labs.mysql.com, which means it is just an early release with some rough edges.  One of those rough edges that I’d like to see resolved soon is that it’s difficult to install on Windows, as there is no installer package provided.  There is some documentation on how to install Fabric (you’ll find it in section 15.8.2 of the PDF that makes up the downloadable

  [Read more...]
OL 4 MySQL: Extending my VM’s root f/s online
Employee +0 Vote Up -0Vote Down

Ok, so after all the things that have been announced @MySQLConnect, I’ve got to play around with them. First stop: space (no.. not ‘the final frontier’).

I need more space on my f/s to get installing. I was a bit of a scrooge when I created my Oracle Linux virtual machine, so now I’m paying the price.

Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_ol63uek01-LogVol01
                      7.1G  5.7G  1.1G  85% /

As I’m using Virtual Box, I’ve added a new SATA Controller vmdk of 10G, SATA Port 1 and then start it up.

fdisk -l

Will be able to identify the new & unused partition:

[root@ol63uek01 ~]# fdisk -l
Disk /dev/sda: 8589 MB, 8589934592 bytes
 255 heads, 63 sectors/track, 1044 cylinders
 Units = cylinders of
  [Read more...]
Showing entries 1 to 30 of 33 Next 3 Older Entries

Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.