Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Previous 30 Newer Entries Showing entries 61 to 90 of 114 Next 24 Older Entries

Displaying posts with tag: ha (reset)

MySQL Semi-Synchronous Replication. See the Magic. Try the Magic.
Employee +7 Vote Up -0Vote Down
Overview MySQL Replication is one of the most used and valued features of the MySQL Server. Unlike some other products on the market, it’s out-of-the-box, easy to configure, non-paid and smart features. Most of our medium/large/super-large installation base are using replication to achieve “scale-out” scaling. Some will use it for backup purposes (not as HA [...]
High Availability MySQL Cookbook , the review
+1 Vote Up -0Vote Down

When I read on the internetz that Alex Davies was about the publish a Packt book on MySQL HA I pinged my contacts at Packt and suggested that I'd review the book .

I've ran into Alex at some UKUUG conferences before and he's got a solid background on MySQL Cluster and other HA alternatives so I was looking forward to reading the book.

Alex starts of with a couple of indepth chapters on MySQL Cluster, he does mention that it's not a fit for all problems, but I'd hoped he did it a bit more prominently ... an upfront chapter outlining the different approaches and when which approach is a match could have been better. The avid reader now might be 80 pages into MySQL cluster before he realizes it's not going to be a match

  [Read more...]
MySQL HA with DRDB and Heartbeat on CentOS 5.5
+1 Vote Up -1Vote Down

This is one of a few MySQL High Availability strategies.  I have used this for years and found it work great.  If you don’t know about DRBD and MySQL you should read Peter’s comments.

These are step by step instructions for Redhat 5 or CentOS.

If you need more details please refer to:
http://www.drbd.org/users-guide/

Configuring MySQL for DRBD
http://dev.mysql.com/doc/refman/5.1/en/ha-drbd-install-mysql.html

Getting started:

The OS in this example is CentOS 5.5.  I added a new disk (/dev/sde) to the four disk RAID-5 and RAID-1 I was already using.   I’m only



  [Read more...]
MySQL HA , an alternative approach
+0 Vote Up -0Vote Down

For those who've seen my presentation on MySQL HA, you already know that I often use a multimaster setup with a meta OCF resource that groups my favoured MySQL instance with the service ip , using a meta resource means that pacemaker monitors mysql, but it doesn't actually manage it. It's an approach that works for us.

One of the other approaches I will be looking at soon is the freshly released OCF resource that Florian announced last week.

Back in the days our approach meant we didn't have to use clone resources, which you might remember being pretty buggy in the v2 era, not wanting to use clons resources isn't really a valid reason anymore these days . I've also frequently mentioned the combination of using DRBD and MultiMaster replication, using this set of OCF

  [Read more...]
Linux Open Administration Days 2010
+0 Vote Up -0Vote Down

So about 4 monts ago there was the crazy idea to start a new FOSS event in Belgium targeted at sysadmins.

What started out as an event for local people to meet local people with some local speakers actually ended up being a small local event with some top international speakers on onfiguration mananagement and system administration mixed with a bunch of good local ones !

I had the honour to open the conference with an extremely short version of the Devops talk I gave earlier last year.. extremely short as I knew that over the course of the weekend the topic would reoccur a lot.

We had the first european talk on Chef, by Joshua Timberman, and we had Puppet talks amongst by Dan Bode from Puppetlabs and CFengine talks , devops was a frequently dropped word,

  [Read more...]
UKUUG Spring Conference 2010
+0 Vote Up -0Vote Down

Last week I was in Manchester for the 2010 UKUUG Spring Conference, right .. make that 2 weeks ago , :)

The UKUUG usually hosts the more interesting conferences around ... , it's not just the schedule that attrackts me , yes there's the strong focus towards Larger Scale Unix (and mostly Linux) deployments and how to manage them, but there's also the opportunity to chat in real life with the Devops from across the chunnel.

Spending time with R.I.Pienaar, Julian Simpson, Simon Wilkinson , Alex Davies , Simon Riggs , Josette, and many others is always fun .

As I was in town early I went to

  [Read more...]
Solutions Linux / Open Source 2010
+0 Vote Up -0Vote Down
Last week Solutions Linux / Open Source event was held in Paris.

Kuassi MENSAH (Head of Product Management Database Technologies, Oracle Corporation) presented the open source Oracle strategy. Linux, MySQL, virtualization, GlassFish, Eclipse, dynamic scripting languages ,... etc . It was well received by the audience. Knowing that MySQL organization will be kept safe in Oracle is perceived as a nice move.

Florian Haas(LINBIT) gave a tutorial on DRBD and did some demos with NFS and video streaming. And of course he reminded people that now since Linux 2.6.33, DRBD is officially integrated into the Linux kernel source. DRBD making the push for mainline Linux kernel is going to make HA easier.

...

[...]
PBXT Engine Level replication, works!
+7 Vote Up -1Vote Down
I have been talking about this for a while, now at last I have found the time to get started! Below is a picture from my 2008 MySQL User Conference presentation. It illustrates how engine level replication works, and also shows how this can be ramped up to provide a multi-master HA setup.


What I now have running is the first phase: asynchronous replication, in a master/slave configuration. The way it works is simple. For every slave in the configuration the master PBXT engine starts a thread which reads the transaction log, and transfers modifications to a thread which applies the changes to PBXT tables on the slave.

Where to get it

I have pushed the changes that do this trick to PBXT 2.0 on






  [Read more...]
Got Interviewed
+0 Vote Up -0Vote Down

by @botchagalupe
on Virtualization, Open Source tools and DNS Problems

Technorati Tags: dnsproblem drupal ha heartbeat linux-ha mysql pacemaker puppet virtualization xen
  [Read more...]
MySQL Cluster: Geographic Replication Deep-Dive webinar
Employee +3 Vote Up -0Vote Down
I will be presenting a free Webinar on Geographic Replication for MySQL Cluster at 9:00 am (UK time) on Tuesday 24 November.

Multi-Master Replication for HA with MySQL Cluster

MySQL Cluster has been deployed into some of the most demanding web, telecoms and enterprise /
government workloads, supporting 99.999% availability with real time performance and linear write scalability.

You can register on-line here (http://www.mysql.com/news-and-events/web-seminars/display-463.html" target="_blank).

Tune into this webinar where you can hear from the MySQL Cluster product management team provide a detailed “deep dive”


  [Read more...]
MySQL Cluster fault tolerance – impact of deployment decisions
Employee +7 Vote Up -0Vote Down

Fig 1. Typical management configuration

MySQL Cluster is designed to be a High Availability, Fault Tolerant database where no single failure results in any loss of service.

This is however dependent on how the user chooses to architect the configuration – in terms of which nodes are placed on which physical hosts, and which physical resources each physical host is dependent on (for example if the two blades containing the data nodes making up a particular node group are cooled by the same fan then the failure of that fan could result in the loss of the whole database).

Of course, there’s always the possibility of an entire data center being lost due to earthquake,

  [Read more...]
How to install MySQL Enterprise Monitor agents in a failover environment
Employee +0 Vote Up -0Vote Down
MySQL Enterprise Monitor is a tool to watch and analyze multiple MySQL environments from a single web based dashboard. More information is available on the MySQL homepage (http://www.mysql.com/products/enterprise/monitor.html). Each MySQL instance is monitored by a small agent that connects to the MySQL instance and reads statistics that is sent to the MySQL Enterprise Monitor (MEM) Server.That setup is very easy. But if the MySQL server is in a cluster failover configuration, there are some things to consider when installing the MEM agent:

What do you want?

Do you want to have two entries in the MEM dashboard for both physical servers?This is good because:



  [Read more...]
Installing MEM agent on a cluster on the logical host
Employee +0 Vote Up -0Vote Down
The goal is to have only one entry in the Enterprise Monitor Dashboard that shows the status of the MySQL instance, no matter on which physical server in runs. There are two ways to achieve this:
  • You can install the agent on both physical nodes
  • You can install the agent on a shared storage.
In either case you have to make sure, that only one agent runs at a time. You have to integrate the agent into your cluster framework. I will not describe how this works, as it is highly dependant on your cluster framework.
The following description assumes, that you will install the agent on both physical nodes.
  • Install the agent but DO NOT START the agent yet.

  • Edit the [agent-installdir]/etc/mysql-monitor-agent.ini
    In the [mysql-proxy] section add the following line:
    agent-host-id=[logical





  •   [Read more...]
    Installing MEM agent in a cluster on the physical hosts
    Employee +0 Vote Up -0Vote Down
    To install the MEM agent in a way that both physical servers are listed in the MEM dashboard, you have to install the agent on both physical nodes. But: Do not start the agent after the installation!There are three different IDs in MEM: agent-uuid, mysql-uuid and host-id. Usually they are generated automatically and you will never notice these IDs. For more information about the meaning of the different IDs look at this very good explanation from Jonathon Coombes.The agent stores the uuid and the hostid in a MySQL table called mysql.inventory. After a failover the other agent on the new node will notice "wrong" hostid and uuid entries in the inventory table. The agent will stop and ask you to TRUNCATE mysql.inventory. But with this procedure MEM creates a new instance, so all old data is  [Read more...]
    Nines , Damn Nines and More Nines
    +4 Vote Up -1Vote Down

    Funny how different experiences lead to different evaluations of tools. The MySQL HA solutions the MySQL Performanceblog list, are almost listed in the complete opposited order of what my impressions are.

    Ok agreed, I should probably not put my MySQL NDB experiences from 2-3 years ago with multiple Query of deaths and more problems than you into account anymore , but back then went in the list Less stable than a single node. I've had NDB POC setups going down for much more than 05:16 minutes
    Ndb comes with a lot of restrictions, there are

    As for MySQL on DRBD, I've said this before , I love DRBD, but having to wait for a long InnoDB recovery after a failover


      [Read more...]
    Spider and vertical partition engines with new goodies
    +4 Vote Up -0Vote Down



    The Spider storage engine should be already known to the community. Its version 2.5 has recently been released, with new features, the most important of which is that you can execute remote SQL statements in the backend servers. The method is quite simple. Together with Spider, you also get an UDF that executes SQL code in a remote server. You send a query with parameters saying how to connect to the server, and check the result (1 for success, 0 for failure). If the SQL involves a SELECT, the result can be sent to a temporary table. Simple and effective.

    In addition to the Spider engine, Kentoku




      [Read more...]
    Monitoring MySQL
    +1 Vote Up -0Vote Down

    Ronald Bradford wants to know what kind of Monitoring you use..
    He specifically wants to know about Alerting tools

    There's different cases , looking at it from a full infrastructure point my current favourite is Zabbix or good old Nagios,

    But when looking at it from a debugging perspective you have MySQLAR or Hyperic, but those aren't in the alerting list.

    However, when you are building HA clusters, you have custom scripts running either from mon or from pacemaker ..

    Still .. Ronald probably wants more input :)

    Technorati Tags: ha monitoring
      [Read more...]
    MySQL related bookmark collection
    +2 Vote Up -0Vote Down

    I am publishing my MySQL related bookmark collection http://www.mysqlpreacher.com/bookmarks/.

    Feel free to send me links you think might be good to add in order to help others.

    Remember, SHARING IS CARING!!! …. we get so much for free, why shouldn’t we give some back?

    Cheers,
    Darren

    Discussing High Availability with a Puppet
    Employee +1 Vote Up -0Vote Down

    Last month at OSCON I had the pleasure of discussing High Availability and Open HA Cluster with "Jack Adams." Here's the video for your viewing pleasure:

    Nick Solter
    Solaris Cluster / Open HA Cluster developer and author of OpenSolaris Bible

    Discussing High Availability with a Puppet
    Employee +0 Vote Up -0Vote Down

    Last month at OSCON I had the pleasure of discussing High Availability and Open HA Cluster with "Jack Adams." Here's the video for your viewing pleasure:

    Nick Solter
    Solaris Cluster / Open HA Cluster developer and author of OpenSolaris Bible

    Discussing High Availability with a Puppet
    Employee +0 Vote Up -0Vote Down

    Last month at OSCON I had the pleasure of discussing High Availability and Open HA Cluster with "Jack Adams." Here's the video for your viewing pleasure:

    Nick Solter
    Solaris Cluster / Open HA Cluster developer and author of OpenSolaris Bible

    MySQL Cluster - flexibility of replication
    Employee +1 Vote Up -0Vote Down

    One of the better kept secrets about MySQL Cluster appears to be the flexibility available when setting up replication. Rather than being constrained to implementing a single replication scheme, you can mix and match approaches.

    Just about every Cluster deployment will use synchronous replication between the data nodes within a node group to implement High Availability (HA) by making sure that at the point a transaction is committed, the new data is stored in at least 2 physical hosts. Given that MySQL Cluster is usually used to store the data in main memory rather than on disk, this is pretty much mandatory (note that the data changes are still written to disk but that’s done asynchronously to avoid slowing down the database).

      [Read more...]
    MySQL Proxy - what if it crashes?
    Employee +2 Vote Up -0Vote Down

    While I hope the MySQL Proxy never crashes, it will happen, there will be some strange (or maybe not so strange) usage or workload and it will die.

    To avoid this, you could decide not to use it, or maybe you could use something like Linux HA to have more than one MySQL Proxy running at all times. Or you could use one of the new features that comes with the version 0.7.0.

    What is it?
    We now have a --keepalive option. As the name indicates, if the mysql proxy process dies/crashes, it will come back up in a few seconds (less than 5 seconds).

    How does







      [Read more...]
    Solaris Cluster + MySQL Demo at a Exhibition Hall near you
    Employee +0 Vote Up -1Vote Down

    Hi,

    If by any chance you are at the MySQL user conference in Santa Clara conference center, there are some great possibilities to see MySQL and Solaris Cluster in action. We have a demo at the exhibition hall, where you can see MySQL with zone cluster and MySQL with SC Geographic Edition.

    I will host a birds of a feather at Wednesday 4/22/09 evening in meeting room 205 at 7 pm. The Title is "Configuring MySQL in Open HA Cluster, an Easy Exercise" check out the details here.  I will give a presentation at Thursday 4/23/09 morning 10:50 in Ballroom G, the title is "Solutions for High Availability and

      [Read more...]
    Solaris Cluster + MySQL Demo at a Exhibition Hall near you
    Employee +0 Vote Up -0Vote Down

    Hi,

    If by any chance you are at the MySQL user conference in Santa Clara conference center, there are some great possibilities to see MySQL and Solaris Cluster in action. We have a demo at the exhibition hall, where you can see MySQL with zone cluster and MySQL with SC Geographic Edition.

    I will host a birds of a feather at Wednesday 4/22/09 evening in meeting room 205 at 7 pm. The Title is "Configuring MySQL in Open HA Cluster, an Easy Exercise" check out the details here.  I will give a presentation at Thursday 4/23/09 morning 10:50 in Ballroom G, the title is "Solutions for High

      [Read more...]
    Solaris Cluster + MySQL Demo at a Exhibition Hall near you
    Employee +0 Vote Up -0Vote Down

    Hi,

    If by any chance you are at the MySQL user conference in Santa Clara conference center, there are some great possibilities to see MySQL and Solaris Cluster in action. We have a demo at the exhibition hall, where you can see MySQL with zone cluster and MySQL with SC Geographic Edition.

    I will host a birds of a feather at Wednesday 4/22/09 evening in meeting room 205 at 7 pm. The Title is "Configuring MySQL in Open HA Cluster, an Easy Exercise" check out the details here.  I will give a presentation at Thursday 4/23/09 morning 10:50 in Ballroom G, the title is "Solutions for High

      [Read more...]
    MySQL High availability with VCS cluster
    +0 Vote Up -0Vote Down

    At MySQL/Sun we do a lot of high availability setup using Heartbeat but recently I was involved, along with Harold Mayfield (a VCS expert), in project using Symantec VCS on Solaris. Of course, MySQL works perfectly well with VCS, here are a few highlights of the installation.

    Apart from the share store resources and the IP resources, MySQL is configured as the following:

    	Application insiderDB-app (
    		StartProgram = "/san/mysql/bin/mysqld --defaults-file=/etc/my.cnf &"
    		StopProgram = "/san/mysql/bin/mysqladmin -u root shutdown"
    		MonitorProgram = "/san/vcs_scripts/mysql_monitor"
    		)
    

    and the mysql_monitor script is the following:

    #!/bin/ksh
    
    STATUS=$(/usr/bin/echo status | /san/mysql/bin/mysql -u root 2>/dev/null |/usr/bin/grep -c Uptime) 
    
    if [ "$STATUS" -eq "1" ]
    then
    	exit 110
    else
    	exit 100
    fi
    Social networking type queries with NDB (part 3)
    +0 Vote Up -0Vote Down

    In the previous 2 posts of this series, we basically talked about how to execute social networking type queries using SQL IN clause and how handle multiple columns IN clause. In this last post on the topic, I will introduce the notion of NDB API filters, although I don’t consider myself as an NDB API expert. Filters are to NDB API the equivalent WHERE clause in SQL. The point is that the filters can be nested and they are sent to the storage nodes only when the transaction is executed.

    As an example, let’s consider the following table:

    Create Table: CREATE TABLE `MultiColPK` (
      `region_id` int(11) NOT NULL DEFAULT '0',
      `application_id` int(11) NOT NULL DEFAULT '0',
      `first_name` varchar(30) NOT NULL DEFAULT '',
      `payload` varchar(30) DEFAULT NULL,
      PRIMARY KEY
      [Read more...]
    NDB Cluster one step closer to become a DB killer app!
    +0 Vote Up -0Vote Down

    If you have been following the development of the NDB Cluster storage engine lately, you are probably as excited as I am. NDB Cluster is becoming a kind of large database killer app. Look at all the nice features that have been added:

    • Replication, if you know MySQL you know what I am talking about
    • Distribution awareness, optimize query execution based on the distribution, a strong scaling factor
    • Disk based data, the possibility of pushing some columns to disk
    • Online add index, among the only online DDL I know of in MySQL
    • Multi-threading, no more need to configure many data nodes per server
    • Realtime, when query execution times matter

    and I probably miss some. And now, with version 7 (renamed from 6.4) it is possible to extend a NDB cluster

      [Read more...]
    Social networking type queries with NDB (part 2)
    +0 Vote Up -0Vote Down

    Recently, I talked about how to optimize social networking type queries for the NDB storage engine using IN clause statements. In clauses are great but they have one fundamental limitation, they work only on one column (Actually, this is not true, I discovered, thanks to Roland’s comment, that MySQL supports multiple columns IN clause). What if the primary key is a composite of let’s say “region_id”, “application_id” and “user_id”? Recently, while on site with a client, Brian Morin showed me a very clever way of dealing these type of primary keys in an IN clause. The main problem is that you cannot return a binary or varbinary from a function. So the idea was to used the return values of a stored proc. First we need to compose the varbinary from the actual values with this stored proc:
    .

    delimiter

      [Read more...]
    Previous 30 Newer Entries Showing entries 61 to 90 of 114 Next 24 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.