Mydbops team has presented at 15th edition Open source India Conference happened at Bangalore on 12-10-2018. Manosh malai ( Senior Devops/ DB Consultant ) and Kabilesh P R ( Co-Founder Mydbops ) has made presentation on “Evolution of DBA in the Cloud Era“. They have shared the value addition that DBA’s can bring into any organisation who have adopted to cloud ( DBaaS ). They have shared a case study of their consulting experience too.
This log buffer edition covers Cloud, Oracle and MySQL.
Cloud
Cloud Directory is a neglected serverless data store that deserves much more attention.
Many of our large enterprise customers have this worry hanging over their heads … what are they going to do about that mainframe when they migrate?
Miners Extract More Value from the Cloud When They Transform Their Cultures
7 steps to keep your …
[Read more]In our earlier stage of Ansible, we just wrote simple playbook and ad-hoc command with very long ansible hosts file. When we plan to use Ansible extensively in our daily production use case, we understand that simple playbooks don’t help to scale up to our expectation.
Even though we had options for separate variables, handlers and template files according to our requirements, this un-organized way didn’t help. It looked very messy and made me unhappy when I saw the code too. That’s the place we decided to use Ansible Role.
My understanding of Ansible Roles?
The role is the primary mechanism for breaking a playbook into multiple files, we can simply refer to the Python Package. Roles help to group multiple tasks, Jinja2 template file, variable file and handlers into a clean directory structure. This will help us to reduce the syntax error while developing and also …
[Read more]The world of application and its related services are migrating more towards cloud, because of availability, Elasticity, Manageability etc. While moving the entire stack we need to be very cautious while migrating the database part.
Migration of DB servers is not a simple lift and shift operation, Rather it would require a proper planning and more cautious in maintaining data consistency with existing DB server and cloud server by means of native replication or by using any third party tools.
The best way to migrate the existing MySQL database to RDS, in my opinion, is by using “logical backup“. Some of the logical backup tools as below,
Mysqldump — single threaded (widely
used)
…
In our work, We used to get a lot of requirements for replicating data from one data source to another. Our team provided solutions to replicate data from MySQL to Vertica, Amazon Redshift, Hadoop. Out of which Amazon Redshift replication is a bit complicated as Amazon Redshift is a Database as a service (DBaaS) and the process is not straightforward.
So, I take this opportunity to guide on how to replicate the specific set of tables from MySQL to AWS Redshift using Tungsten replicator.
1.0. Tungsten Replicator:
Tungsten Replicator is an open source replication engine supports data extract from MySQL, MySQL Variants such as RDS, Percona Server, MariaDB and Oracle and allows the data extracted to be applied on other data sources such as Vertica, Cassandra, …
[Read more]This Log Buffer Edition covers blog posts from Cloud, Oracle, and MySQL.
Cloud:
Google Stackdriver lets you track your cloud-powered applications with monitoring, logging and diagnostics. Using Stackdriver to monitor Google Cloud Platform (GCP) or Amazon Web Services (AWS) projects has many advantages—you can get detailed performance data and can set up tailored alerts.
This post is courtesy of Sam Dengler, AWS Solutions Architect. Message brokers can be used to solve a number of needs in enterprise architectures, including managing workload queues and broadcasting messages to a number of subscribers.
New Cloud …
[Read more]
This Log Buffer edition covers Oracle, SQL Server and
MySQL.
Cloud:
What DBAs need to know about Cloud Spanner, Part 1: Keys and indexes
Introducing sole-tenant nodes for Google Compute Engine — when sharing isn’t an option
A serverless solution for invoking AWS Lambda at a sub-minute frequency
Amazon Aurora MySQL DBA Handbook – …
[Read more]
In this series of blogs I will do my best to demonstrate how to
set up and run Cluster in Cloud environment by hand and by
utilizing MCC. For detailed configuration, I
will use MCC (Auto-installer). Some of the
information regarding this setup is provided in post by Mikael. Information regarding
Auto-installer is available in our documentation, HTML help files
in share/MCC distribution directory and in my blog post.
Cloud setup It might come as surprise but for initial testing any
instance should do. I started with 1CPU/1GB RAM ones. The target
topology was:
- Host #1: Management node and Cluster client tools.
- Host #2: Multi-threaded DATA node. …
MySQL 8.0.11 seems to be around the corner and the new MySQL Shell will take advantage of all the new improvements made in MySQL 8.0 like SET PERSIST, RESTART, … see this previous post.
In the video below, I show you how easy it’s to deploy a MySQL InnoDB Cluster using the Shell that connects remotely to all the instances:
…
[Read more]Introduction
In this article we will explore one approach for deploying ProxySQL behind a load balancer in Google Cloud.
While considering the deployment of ProxySQL, one has basically the following options:
- Install ProxySQL on existing application server(s)
- Provision dedicated ProxySQL server(s) between your application servers and the database layer.
Each approach has its pros and cons, but if there’s a significant number of application servers (more than a dozen or so) having a dedicated ProxySQL “layer” can be a more attractive option, specially if there is no service discovery mechanism in place (e.g. Consul).
Let’s consider a simple scenario, with a master and a small number of slaves in a single geographic region. Assuming that you are following the best practice, your database servers should be split into different availability zones. So for ProxySQL, it also …
[Read more]