Showing entries 1 to 10 of 115
10 Older Entries »
Displaying posts with tag: Database Management (reset)
The key differences between MySQL and NoSQL DBs.

 

 

Experts say that the world’s data is doubling every two years. This epic increase in Big Data in recent times has highlighted the limitations of reliance on traditional forms of data storage and management and focused attention on new methods for addressing the volume and variety and veracity of structured and unstructured data. 

Not long ago, data was stored in physical files that were archived into racks of folders filling up entire rooms in the offices of large corporations. Then came computers, and the go-to technique for storage changed to flat file databases. 

 

Ever since the 1970s,  SQL databases have been an integral part of the IT infrastructure of organizations. And today  MySQL, an RDBMS based SQL implementation for the web, now powers very large-scale websites like Google, Facebook, Twitter and even YouTube. In fact,  MySQL is the world’s …

[Read more]
What products & improvements are new on AWS?

Amazon is releasing new products & services to it’s global cloud compute network at a rate that has all of our heads spinning. Join 32,000 others and follow Sean Hull on twitter @hullsean. Here’s new stuff worth mentioning around databases & data. 1. For ETL – AWS GLUE Moving data from your transactional MySQL or … Continue reading What products & improvements are new on AWS? →

Should we be muddying the relational waters? Use cases for MySQL & Mongodb

Many of you know I publish a newsletter monthly. One thing I love about it is that after almost a decade of writing it regularly, the list has grown considerably. And I’m always surprised at how many former colleagues are actually reading it. So that is a really gratifying thing. Thanks to those who are, … Continue reading Should we be muddying the relational waters? Use cases for MySQL & Mongodb →

[Read more]
Are software benchmarks to blame for Volkswagens woes?

With the recent media attention Volkswagen has gotten, a lot of folks are wondering, how could that happen? Aren’t there checks & balances? Join 32,000 others and follow Sean Hull on twitter @hullsean. Then I ran across this observation on Todd Hoff’s brilliant blog High Scalability Is what Volkswagen did really any different that what … Continue reading Are software benchmarks to blame for Volkswagens woes? →

When hosting data on Amazon turns bloodsport

There’s a strong trend to automation across the cloud. That’s a great thing for startups because it reduces operational headaches & lets them focus on building products. Join 31,000 others and follow Sean Hull on twitter @hullsean. But as that trend begins to touch the database tier, all sorts of complications emerge. Let’s take a … Continue reading When hosting data on Amazon turns bloodsport →

Replicate MySQL to Amazon Redshift with Tungsten: The good, the bad & the ugly

Heterogenous replication involves moving data from one database platform to another. This is a complicated endevour because datatypes, date & time formats, and a whole lot more tend to differ across platforms. In fact it’s so complex many enterprises simply employ a commercial solution to take away the drudgery. Join 31,000 others and follow Sean … Continue reading Replicate MySQL to Amazon Redshift with Tungsten: The good, the bad & the ugly →

Wrestling with bears or how I tamed Tungsten replicator

I just dove into Tungsten replicator very recently as I need to replicate from Amazon RDS to Redshift. I’d heard a lot of great things about Tungsten, but had yet to really dig my heels in. Join 28,000 others and follow Sean Hull on twitter @hullsean. I fetched the binary and began to dig through … Continue reading Wrestling with bears or how I tamed Tungsten replicator →

The cost of not properly managing your databases

Every day hundreds of millions of dollars are wasted by allowing improperly tuned or misconfigured systems, misunderstood infrastructure, and inefficient IT operations to live and thrive in data centers around the globe. There are both direct and indirect costs associated with allowing these unhealthy systems to continue to exist. Let’s look at some.

The setup:

Let us start by using a small example. We will start by looking at a small database setup. This setup will have a single master-slave, with a database size of lets say 500GB. Traffic is steady and let’s say this translates into 500 IOPS on the master. You have chosen to host this on Amazon’s AWS. A common way of ensuring backups occur in AWS is to setup ebs snapshots of the slave. In terms of usage, let us assume your CPU is about 50% used and you have about 20GB of hot data that needs to stay in the memory for the database.

If we look at what this …

[Read more]
Is upgrading RDS like a shit-storm that will not end?

Join 29,000 others and follow Sean Hull on twitter @hullsean. Can RDS worsen an outage ?? That’s another way to think about this question. In my experience, it very clearly increases outages, by tying one or both hands behind your back. Believe me when I say, that is terribly frustrating when you’re putting out fires! […]

Is Zero downtime even possible on RDS?

Join 29,000 others and follow Sean Hull on twitter @hullsean. Oh RDS, you offer such promise, but damn it if the devil isn’t always buried in the details. Diving into a recent project, I’ve been looking at upgrading RDS MySQL. Major MySQL upgrades can be a bit messy. Since the entire engine is rebuilt, queries […]

Showing entries 1 to 10 of 115
10 Older Entries »