PinLater is an asynchronous job execution system we built as a replacement for our original solution based on Pyres. We’ve been using PinLater in production for over two years, and it’s one of our most mission critical systems. Usage of PinLater spans from core actions like Pinning, image thumbnail generation and when Pinners follow other Pinners, boards or topics, to larger batch operations like email delivery, push notifications and visual discovery workflows. We now operate more than 10 different clusters all on Amazon EC2. In aggregate, there are more than 500 job queues processing north of six million jobs per minute. Today we’re excited to announce PinLater as our latest …
[Read more]I am always fascinated about the cleanliness of UNIX . One tool only should do one thing, but it has to be the best in that way. The operating system itself will glue all the modules together and give you a complex feel of a system, you don’t have to take care of huge, bloated software, don’t […]
Choosing your HA topology
There are various ways to retain high availability with databases. You can use Virtual IPs (VRRP) to manage host availability, you can use resource managers like Zookeeper and Etcd to (re)configure your applications or use load balancers/proxies to distribute the workload over all available hosts.
The Virtual IPs need either an application to manage them (MHA, Orchestrator), some scripting (KeepaliveD, Pacemaker/Corosync) or an engineer to manually fail over and the decision making in the process can become complex. The Virtual IP failover is a straightforward and simple process by removing the IP address from one host, assigning it to another and use arping to send a gratuitous ARP response. In theory a Virtual IP can be moved in a second but it will take a few seconds before the failover management application is sure the host has failed and acts accordingly. In reality this should be …
[Read more]The client library — libmysqlclient — is part of the same source code repository as the server. It comes both as a dynamic link library (.so), also called a shared library, and as a static link library (.a). During the 5.7 development cycle, we’ve made several improvements to the library, which has resulted in a bump from ABI version 18 to version 20.…
On Wednesday, December 9 at 11 AM ET, please join us and INetU for a special webinar about Best Practices for a High-Performing MySQL Database with VividCortex & INetU.
Baron Schwartz (VividCortex founder and CEO), Michele Corvino (INetU Product Manager), and Jim DeHart (INetU Systems Engineer) will be discussing best practices for keeping MySQL databases at peak performance. INetU – the best customer-rated cloud hosting company in the industry – knows the importance of keeping databases running without hitch. Complexity within systems increases as applications grow, which means that as complications arise, there are more risks for end users. Leveraging a database performance tool like VividCortex allows users to take care of …
[Read more]In this blog article we will show you how to install AutoMySQLBackup on a Linux VPS. AutoMySQLBackup is very useful utility for creating daily, weekly or monthly backups of one or more MySQL databases from one of more MySQL servers. It dumps the databases and compress them in to archives.it comes with many features such as: Email notification of backups Backup Compression and Encryption Configurable backup rotation Incremental database backups As usual, log in to your server as user root ssh root@IP and execute the following command to make sure that all services ar up to […]
It goes without saying that crash recovery of busy MySQL servers
(and many other RDBMS for that matter) is not an extremely quick
process. In MySQL context, one of the worst case scenarios is
when the server is used for multi-tenant application hosting i.e.
when the MySQL instance contains hundreds or thousands of schemas
and (tens/hundreds of) thousands of tablespaces. In such
scenario, the server may spend a considerable amount of time in
the tablespace discovery phase, during which MySQL
builds a mapping between tablespace IDs and names of actual
tablespace files on disk.
MySQL 5.7 promises to put an end to tablespace discovery. The
documentation lists the following improvements introduced in
versions 5.7.5 and up:
- Elimination of file system scans prior to redo log application. The MLOG_FILE_NAME redo log …
MySQL 5.7 is GA and has over than 150 new features. One of them is a Native JSON Data Type and JSON Functions: "Allows for efficient and flexible storage, search and manipulation of schema-less data. Enhancements include a new internal binary format, support for easy integration within SQL, and index management on the JSON Documents using generated columns".
Today i want to share experience with latest Percona Server where
TokuDB and TokuBakcup plugins have been added in main
source.
So there is no other steps needed here to get and started.
But in recent discussion in our local community, there was a
question: “How about installing MySQL on CentOS minimal”.
The reason was clear, because somebody got too many errors in
fresh CentOS 7 minimal.
I want to share here full steps.
Please follow numbers:
1. Getting Source package:
[root@testing-host1 ~]# wget
https://www.percona.com/downloads/Percona-Server-5.6/Percona-Server-5.6.27-75.0/source/tarball/percona-server-5.6.27-75.0.tar.gz
Unpacking:
tar -xvf percona-server-5.6.27-75.0.tar.gz
2. Compiling using CMAKE:
If you have read the documentation:
…
[Read more]Codership is pleased to announce the release of Galera Cluster 5.5.46 and 5.6.27 with Galera Replication library 3.13, implementing wsrep API version 25.
Galera Cluster is now available as targeted packages and package repositories for a number of Linux distributions, including Ubuntu, Red Hat, Debian, Fedora, CentOS, OpenSUSE and SLES. Obtaining packages using a package repository removes the need to download individual files and facilitates the deployment and upgrade of Galera nodes.
This and future releases will be available from http://www.galeracluster.com, while previous releases remain available on LaunchPad. The source repositories and bug tracking are now on http://www.github.com/codership.
New features and notable changes in Galera Cluster and the Galera library:
- security fix for the LogJam issue. The key length used for creating Diffie-Hellman keys has been increased to 2,048 bits.
- a …