Showing entries 1 to 7
Displaying posts with tag: MySQL on Cloud (reset)
MySQL to Amazon Redshift Replication.

In our work, We used to get a lot of requirements for replicating data from one data source to another. Our team provided solutions to replicate data from MySQL to Vertica, Amazon Redshift, Hadoop. Out of which Amazon Redshift replication is a bit complicated as Amazon Redshift is a Database as a service (DBaaS) and the process is not straightforward.

So, I take this opportunity to guide on how to replicate the specific set of tables from MySQL to AWS Redshift using Tungsten replicator.

1.0. Tungsten Replicator:

Tungsten Replicator is an open source replication engine supports data extract from MySQL, MySQL Variants such as RDS, Percona Server, MariaDB and Oracle and allows the data extracted to be applied on other data sources such as Vertica, Cassandra, …

[Read more]
Reading Amazon RDS MySQL/Aurora log file from terminal.

Introduction:

At Mydbops we support a good number of clients on AWS cloud (Aurora and RDS).

Amazon Relational Database Service (RDS) is providing the cloud based database service. It is the cost-efficient, resize able & ease to manage. As in any other DBaaS, If you need to analyse the log files (Error log / Slow log), you need to login the console and manually download the files.

Logging into the console seems simple, But this is a bit complex operation when it comes to incorporate that in a day to day operation and automation. In this blog i would like to share my experience in making this into a straightforward process for downloading the log files directly from command line without console GUI.

Prerequisites:

Following tools are to be installed for this operation.

[Read more]
Presentation: Ansible is our Wishbone

This presentation was made at LSPE event in Bangalore (India) held at Walmart labs on 10-03-2018. This presentation focuses how we have harnessed the power of Ansible at Mydbops.

 

 

Scale with Maxscale part-4 (Amazon Aurora)

This is part-4 of the Maxscale Blog series

  1. Maxscale and Galera
  2. Maxscale Basic Administration
  3. Maxscale for Replication

Maxscale started supporting Amazon Aurora lately from its version 2.1 which comes with a BSL license, we are good until we use only 3 nodes, …

[Read more]
Maxscale Data Archiving with filters Mq & Tee ( Mirror)

Introduction –

          Maxscale is an excellent Proxy from Mariadb Corporation, which providing the High Availability, Realtime RW split with replication Glaera cluster Amazon RDS Amazon Aurora, binlog streaming and many more advanced features, here in this blog we will discuss one such feature, 

In this blog post, i am going to share my recent activity with Maxscale. We had to help one of our client to archive only the DML ( CREATE & INSERT ) data into archive server from specific table.

Problem Statement –

Our client is having only one standalone ( Master ) setup and a Archive server , they need to archive one …

[Read more]
Replication Will not Start On AWS RDS for MariaDB 10.2

AWS recently announced the release of MariaDB 10.2 for RDS. One of customer needs this release for GIS indexing .The recent encounter on a Replication issue with RDS MariaDB 10.2 is briefed here .

Problem Statement:

After the upgrade of replicas to MariaDB 10.2 on RDS, Once replication is stopped manually through “call mysql.rds_stop_replication;” or replication failed due to some error. Replication cannot be started back using “call mysql.rds_start_replication;” and there is no straightforward way or documented process to start the replication back. Also, most of the replication related RDS commands like skip errors etc will not work. This is due to the implementation of replication handling in RDS.

Summary:

On Jan 5, 2018, RDS announced support for MariaDB 10.2.  …

[Read more]
Aurora – The MySQL to be explored

“The MySQL to be explored ” this is what i felt when i worked with it, and just going to share my experience with Aurora .

Recently we had an call for MySQL Consulting from one of the famous fantasy gaming site in India, stating that “Database (MySQL) is our bottleneck”, they want it to be stabilised before the major league match of this year (2017).

As a fast growing startup they have hosted their Infra on cloud (AWS).  On further discussion it was revealed that they were using AWS AURORA MySQL for their production DB. Next question from our consulting team was

“why Aurora?”,

  •  Synchronous data across nodes within a lag of 100ms ( mostly ).
  •  Auto Scaling and Performance .
  • High Availability of database. …
[Read more]
Showing entries 1 to 7