Next November I'll once again take the ferry to my neighbour city of Buenos Aires to enjoy two days of learning, networking, and presenting, at DataOps LA 2015, the first incarnation of what used to be the MySQL, NoSQL, Cloud Conference organized by BinLogic in Buenos Aires.
Currently we have one database cluster with 15 different schemas – these schemas could be either schemas which contain “real” data, or just schemas with metadata.
I guess the next evolutionary step of our database stack would be to split up the database cluster vertically along these schemas. All the data schemas should be moved to standalone mysql instances, and put the metadata schemas next to them. This also could be a good project for prepare to move a certain part of database for example to a cloud provider while other parts are still kept on bare metal.
I started wondering what could be the best way to split MySQL instances in a single hardware. I have the following ideas:
- Hack init scripts to start different instances on different ports (and log directories, data directories, config files too)
- Use mysqld_multi
- Use MySQL Sandbox
- Use docker
The first …
[Read more]Data plays a big role at Pinterest, in both enabling new product experiences for Pinners and providing insights into Pinner behavior. We’re always thinking of ways to reduce the friction of converting our data into actionable insight. A question often asked by our data users (primarily analysts, product managers, engineers and data scientists) is, “How can I build a reporting dashboard to track xyz metrics daily?”. As the number of employees accessing data, the volume of data and the number of queries increased, scaling and supporting emerging requirements became a big challenge. In order to tackle this, we built a new data platform called Skyline.
Before the birth of Skyline, data users were dependent on data engineers to:
- Find the right tables to query
- Productionize the query as an Extract, Transform and Load ( …
AWS CloudFormation now supports Amazon Aurora!
Announcement: https://forums.aws.amazon.com/ann.jspa?annID=3286
Documentation:
http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-rds-dbcluster.html
Amazon Aurora is a MySQL-compatible, relational database engine that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. https://aws.amazon.com/rds/aurora/
AWS CloudFormation gives developers and systems administrators an easy way to create and manage a collection of related AWS resources, provisioning and updating them in an orderly and …
[Read more]This Log Buffer Edition finds and publishes blog posts from Oracle, SQL Server and MySQL.
Oracle:
- SCRIPT execution errors when creating a DBaaS instance with local and cloud backups.
- Designing Surrogate vs Natural Keys with Oracle SQL Developer.
- EBS General Ledger – Accounting Hub Reporting Cloud Service.
- Oracle Database Standard Edition 2 is available.
- Disable “Build After Save at …
Percona recently open sourced TokuBackup, a library that may be used to take a
snapshot of a set of files while these files are being changed by
a running application like MySQL or MongoDB. Making
TokuBackup open source allows a larger set of users to improve
and extend the software. This blog describes how the
Address Sanitizer and Thread Sanitizer found bugs in the TokuBackup
library.
The TokuBackup library is used by Percona Server for MySQL and …
Is it possible to make my non secured installation to secure installation? As system already in production.
Percona Live Europe is now more than a week away. l left
Amsterdam with a positive thought: it has been the best European
event for MySQL so far. Maybe the reason is that I saw the
attendance increasing, or maybe it was the quality of the talks,
or because I heard others making the same comment, and I also saw
a reinvigorated MySQL ecosystem.
There are three main aspects I want to highlight.
1. MySQL 5.7 and the strong presence of the Oracle/MySQL
team
There have been good talks and keynotes on MySQL 5.7. It is a
sign of the strong commitment of Oracle towards MySQL. I think
there is an even more important point. The most interesting
features in 5.7 and the projects still in MySQL Labs derive or
are in some way inspired by features available from other
vendors. Some examples:
- The JSON datatype from …
MySQL Group Replication plugin is in labs.mysql.com and is available for EL6 x86_64 version Linux. But most of us have Ubuntu desktops where it should be easier to test this new thing, especially with MySQL Sandbox. After getting source code we should have compile this plugin with MySQL from source. So let’s begin. Extract both mysql group replication archive and mysql source archive:
sh@shrzayev:~/Sandboxes$ ls -l
total 650732
drwxr-xr-x 34 sh sh 4096 İyl 20 17:25 mysql-5.7.8-rc
-rw-rw-r-- 1 sh sh 49762480 Avq 20 16:19 mysql-5.7.8-rc.tar.gz
drwxrwxr-x 3 sh sh 4096 Sen 28 12:08 mysql-group-replication-0.5.0-dmr
-rw-rw-r-- 1 sh sh 251687 Sen 28 11:57 mysql-group-replication-0.5.0-labs.tar.gz
You will have 2 directories as above. Then, go to mysql-group-replication folder:
sh@shrzayev:~/Sandboxes$ cd mysql-group-replication-0.5.0-dmr/
sh@shrzayev:~/Sandboxes/mysql-group-replication-0.5.0-dmr$ …
[Read more]
see below.