Amazon EC2 and cloud computing offer great promise for startups to ramp up their online presence quickly.  Navigate those challenges with an strong partner.  We bring 20 years experience to the table with each new client.

• Scaling Web Applications
• MySQL High Availability in Amazon EC2
• Amazon Multi-AZ Deployments
• Amazon RDS Deployments
• Migrating to Amazon EC2
• Migrating to MySQL
• Managing Backups and Disaster Recovery in the Cloud
• Horizontal Scalability of MySQL on EC2
• Horizontal Scalability on Cloud Hosted Servers
• Evaluating Cloud Providers
• Evaluating MySQL Distributions and Platforms
• Strong Customer Facing Skills
• Integrate Directly with Development Team
• Agile …

With the fast growth of virtualized data centers, and companies like Google, Amazon and Facebook, it's easy to forget how much is built on open-source components, aka commodity software.  In a very real way open-source has enabled the huge explosion of commodity hardware, the fast growth of the internet itself, and now the further acceleration through cloud services, cloud infrastructure, and virtualization of data centers.

Your typical internet stack and application now stands on the shoulders of tens of thousands of open source developers and projects.  Let's look at a few of them.

1. Operating System - Linux

The commodity hardware craze would never have happened without the help of an open-source operating system to run on it.  Linux is an old story now, nonetheless everything else stands on it's shoulders.

2. Multi-purpose Webserver - Apache

As of July …

If you're headhunting a cloud computing expert, specifically someone who knows Amazon Web Services (AWS) and EC2, you'll want to have a battery of questions to ask them to assess their knowledge.  As with any technical interview focus on concepts and big picture.  As the 37Signals folks like to say "hire for attitude, train for skill".  Absolutely!

1. Explain Elastic Block Storage?  What type of performance can you expect?  How do you back it up?  How do you improve performance?

EBS is a virtualized SAN or storage area network.  That means it is RAID storage to start with so it's redundant and fault tolerant.  If disks die in that RAID you don't lose data.  Great!  It is also virtualized, so you can provision and allocate storage, and attach it to your server with various API calls.  No calling the …

My list of reasons for never using or recommending Amazon’s MySQL RDS service grows every time I experience problems with customers. This was an interesting and still unresolved issue.

ERROR 126 (HY000): Incorrect key file for table '/rdsdbdata/tmp/#sql_5b7_1.MYI'; try to repair it

You may see this is a MyISAM table. The MySQL database is version 5.5, all InnoDB tables and is very small 100MB in total size.
What is happening is that MySQL is generating a temporary table, and this table is being written to disk. I am unable to change the code to improve the query causing this disk I/O.

What I can not understand and have no ability to diagnose is why this error occurs sometimes and generally when the database is under additional system load. With RDS you have no visibility of the server running the production database. While you have SQL access, an API for managing MySQL configuration options (I also add not all …

In the press in the last two days has been the reported outage of Amazon Web Services Elastic Compute Cloud (EC2) in just one North Virginia data center. This has affected many large website includes FourSquare, Hootsuite, Reddit and Quora. A detailed list can be found at ec2disabled.com.

For these popular websites was this avoidable? Absolutely.

Basic scalability principles if deployed in these systems architecture would have averted the significant downtime regardless of your development stack. While I work primarily in MySQL these principles are not new, nor are they complicated, however they are fundamental concepts in scalability that apply to any technology including the …

The attached storage used by Amazon’s managed Relational Database Service has a known issue where the bytes per inode ratio is very high (default on RHEL5 systems is 4096, to be found in /etc/mke2fs.conf). Amazon does not allow any administrative access to these instances so there is no way to reformat the filesystem to allocate more inodes, or attach storage the user can format with a different ratio.

This becomes problematic for databases that have many small tables (generally MyISAM tables, or InnoDB with the innodb_file_per_table setting) which quickly consume the available inodes. When the inode allocation is exhausted MySQL responds with

"ERROR 1030 (HY000): Got error 28 from storage engine"

The only current solution is to increase the size of attached storage, which increases the number of inodes (at the same …

Openworld 2010, despite the supposedly lagging economy, had record attendance again this year.  No doubt this was the result of Oracle acquiring something like fourteen companies since last year, including Sun in 2009.  The crowds were thick, divided about evenly between geeks in badly-fitting vendor t-shirts and slick sales-side hustlers with dress pants and shiny shoes.  I landed somewhere in the middle of the two (badly-fitting dress shirt, comfortable jeans and loafers), proudly sporting a long dangling codpiece of ribbons from my attendee badge:

My OOW2010 Codpiece

Oracle made a number of important announcements this year at OpenWorld, including a the Exalogic machine, and support for Amazon EC2, which I blogged about …

I created the Bluegecko MySQL training AMI as a MySQL sandbox that folks could use to learn things about MySQL. I wanted the AMI to have MySQL 5.0, and a large collection of tools — for both tinkering and visualizing what is happening inside MySQL and on the system in general.

I chose to host the AMI on a small instance since they’re cheap to operate, which means you can fire up 3-4 of them to try out a replication scheme without feeling guilty. It runs CentOS 5.4 and MySQL 5.0.77 from the CentOS repository.

One of the goals I had for the training AMI was for it to be easy to visually inspect what is going on inside of MySQL and the system at large. To that end I’ve installed Cacti, a graphing and visualization tool, and equipped it with templates that allow you to visualize …

Blue Gecko has been officially recognized as an Amazon Web Services partner!  Blue Gecko was an early adopter of the AWS platform for databases and database-backed applications. By deploying Oracle, Oracle E-Business Suite and MySQL infrastructures in the cloud, Blue Gecko leverages AWS to substantially improve customer IT flexibility and reduce costs. Blue Gecko can provide a variety of cloud-related services:

Oracle Databases

• Deploy Data Guard on AWS for disaster recovery of conventionally-hosted infrastructure
• Design end-to-end AWS-based Oracle solutions
• Rapidly deploy test environments in the AWS cloud

Oracle E-Business Suite

• Instant On AWS-based Vision Demo environments
• Deploy Data Guard on AWS for disaster recovery of conventionally-hosted infrastructure
• Quickly scale E-Business Suite application components by deploying additional …

On Tuesday at the MySQL Camp 2009 in Santa Clara I presented Setting up MySQL on Amazon Web Services (AWS).

This presentation assumed you know nothing about AWS, and have no account. With Internet access via a Browser and a valid Credit Card, you can have your own running Web Server on the Internet in under 10 minutes, just point and click.

We also step into some more detail online click and point and supplied command line tools to demonstrate some more advanced usage.

Getting started with MySQL in Amazon Web Services View more presentations from Ronald Bradford.