Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 30 of 91 Next 30 Older Entries

Displaying posts with tag: amazon (reset)

Amazon EC2 Linux AMIs
+1 Vote Up -0Vote Down

If you use Amazon Elastic Compute Cloud (EC2), you are always given choices of AMIs (by default; there are plenty of other AMIs available for your base-os): Amazon Linux AMI, Red Hat Enterprise Linux, SUSE Enterprise Server and Ubuntu. In terms of cost, the Amazon Linux AMI is the cheapest, followed by SUSE then RHEL. 

I use EC2 a lot for testing, and recently had to pay a “RHEL tax” as I needed to run a RHEL environment. For most uses I’m sure you can be satisfied by the Amazon Linux AMI. The last numbers suggest Amazon Linux is #2 in terms of usage on EC2.

Anyway, recently Amazon Linux AMI came out with the 2014.03 release (see release

  [Read more...]
Shard-Query loader gets a facelift and now Amazon S3 support too
+0 Vote Up -0Vote Down

Shard-Query (source) now supports the MySQL “LOAD DATA INFILE” command.

When you use LOAD DATA LOCAL INFILE a single threaded load from the current process will be performed.  You can specify a path to a file anywhere readable by the PHP script.  This allows loading without using the Gearman workers and without using a shared filesystem.

If you do not specify LOCAL, then the Gearman based loader is used.  You must not specify a path to the file when you omit the LOCAL keyword.  This is because the shared path will the pre-pended to the filename automatically.  The shared path must be a shared or network filesystem (NFS,CIFS,etc) and the files to be loaded must be placed on the shared filesystem for the Gearman

  [Read more...]
We're hiring!
+1 Vote Up -0Vote Down
Continuent, a leading provider of database clustering and replication software has five (5) new positions open: Build/Test Engineer Senior Database Availability and Clustering Engineer Senior Database Replication Engineer Data Replication Sales Engineer Clustering and Replication Test Development Engineer If you want to get in on the ground floor of a growing company in a challenging field
Will AWS plans for PostgreSQL RDS help it finally pick up?
+1 Vote Up -0Vote Down
"Amazon to add Postgres to its most-favored database list" says GigaOM:
http://gigaom.com/2013/11/12/amazon-to-add-postgres-to-its-most-favored-database-list/
"To many this is no-brainer. Amazon wants to support the databases that its developer audiences want to use. This is simply a  case of Amazon responding to user demand and oh-by-the-way making its cloud infrastructure more attractive to a specific target audience. Some say Postgres has gained traction since Oracle’s acquisition of MySQL via its Sun buyout a few years back."

Some people I know said "yea, the writing was on the wall...". Well, was it?? Really? 
AWS finally got the time to "plan" for supporting Postgres now? After supporting MySQL, Oracle


  [Read more...]
MariaDB now in the AWS Marketplace
+3 Vote Up -0Vote Down

Saw this on @awsmarketplace the other day:

#opensource #MariaDB by @SkySQL on @AWSMarketplace http://t.co/o3KQ9xe9sr #mysql

— AWS Marketplace (@awsmarketplace) October 8, 2013

Now on the AWS Marketplace, you can

  [Read more...]
Data Analytics at NBCUniversal. Interview with Matthew Eric Bassett.
+0 Vote Up -0Vote Down
“The most valuable thing I’ve learned in this role is that judicious use of a little bit of knowledge can go a long way. I’ve seen colleagues and other companies get caught up in the “Big Data” craze by spend hundreds of thousands of pounds sterling on a Hadoop cluster that sees a few megabytes [...]
Continuent Tungsten Use Case: Modernizing Medicine, a SaaS solution running on Amazon AWS
+0 Vote Up -0Vote Down
Learn how Modernizing Medicine, an electronic medical records company, serves thousands of customers and leverages Continuent Tungsten to manage databases on Amazon AWS. Modernizing Medicine is as fast growing SaaS company, offering electronic medical records management solution for thousands of small and medium-sizes dermatology, ophthalmology, optometry, plastic surgery, cosmetic and
New Tungsten Replicator w/ MySQL 5.6 & Amazon RDS support
+4 Vote Up -0Vote Down
Tungsten Replicator 2.0.7 enables new MySQL versions, provides better support for multi-master and parallel replication, and improves setup of advanced topologies. In the MySQL area, we have added the ability to replicate from MySQL into Amazon RDS instances, as well as initial certification for MySQL 5.6.  There are several important new features for multi-master replication, including better
The Data Day, Two days: February 13/14 2013
+0 Vote Up -0Vote Down

TempoDB’s timely DBaaS for the Internet of Things. ScaleBase 2.0. And more

For 451 Research clients: TempoDB has timely database service for the Internet of Things bit.ly/YcQuqA

— Matt Aslett (@maslett) February 13, 2013

For 451 Research clients: ScaleBase provides centralized management of distributed MySQL databases bit.ly/YcQTcs

— Matt Aslett (@maslett) February 13, 2013

For 451 Research clients: XtremeData turns its attention to cloud-based data warehousing bit.ly/XB7MLY

— Matt Aslett (@maslett)

  [Read more...]
The Data Day, A few days: January 17-22 2013
+0 Vote Up -0Vote Down

DataStax and VoltDB launch their version 3.0s. And more

For 451 Research clients: DataStax adds security and manageability to distributed NoSQL database bit.ly/Vb1IiT

— Matt Aslett (@maslett) January 18, 2013

For 451 clients: LogiXML serves up fresh cut of BI stack with an eye to more embedded analytics deals bit.ly/SppzsH By Krishna Roy

— Matt Aslett (@maslett) January 21, 2013

Inside H-P’s Missed Chance To Avoid a Disastrous Deal – WSJ.com on.wsj.com/Td7wrh via @

  [Read more...]
How to STOP SLAVE on Amazon RDS read replica
+1 Vote Up -0Vote Down

We are doing a migration from Amazon RDS to EC2 with a customer. This, unfortunately, involves some downtime – if you are an RDS user, you probably know you can’t replicate an RDS instance to an external server (or even EC2). While it is annoying, this post isn’t going to be a rant on how RDS can make you feel locked in. Instead, I wanted to give you a quick tip.

So here’s the thing – you can’t stop replication on RDS read replica, because you don’t have (and won’t get) privileges to do that:

replica> STOP SLAVE;
ERROR 1045 (28000): Access denied for user 'usr'@'%' (using password: YES)

Normally, you don’t want to do that, however we wanted to run some pt-upgrade checks before we migrate



  [Read more...]
MySQL cloud database deployments via online configurator - free AWS trial
+1 Vote Up -2Vote Down

SkySQL™ Cloud Data Suite now comes with 4 nodes system on AWS

Plus: AWS tips & tricks, updated administration console, new video tour & more

As with all new open source software products, updates are a continuous process and we’ve been busy since the launch of the SkySQL™ Cloud Data Suitelast September! Here is a snapshot of the latest developments with our Cloud Data Suite, a collection of software components that provides a highly available database solution in a cloud environment, based on MySQL & MariaDB, deployable in the Amazon Cloud, i.e. AWS.

read more

Cloud Operations Interview
+1 Vote Up -0Vote Down

Read the original article at Cloud Operations Interview

What does a cloud computing expert need to know? How do you hire a cloud computing expert? Competition for operations & DBAs is fierce, so you’ll want to know how to find the best.

If you’re a systems administrator or ops guy, you may want to prepare for an interview for such a position. Meanwhile, if you’re a director of it or operations, a recruiter or manager in HR, you’ll want to have some idea how to find the right candidate.

Here’s my guide to do just that. You may

  [Read more...]
Amazon RDS – prime time? Time will tell
+0 Vote Up -0Vote Down
A client of ours is just getting started with Amazon Relational Database Service (RDS) and I wonder as time marches on how popular this cloud solution is going to play out for them and Amazon as a valid/useable service offering. Many times in the past we have encountered off-the-shelf solutions from vendor A based on [...]
Linus on Instantiation and Armadaification
+0 Vote Up -1Vote Down

I feel a sense of pride when I think that I was involved in the development and maintenance of what was probably the first piece of software accepted into Debian which then had and still has direct up-stream support from Microsoft. The world is a better place for having Microsoft in it. The first operating system I ever ran on an 08086-based CPU was MS-DOS 2.x. I remember how thrilled I was when we got to see how my friend’s 80286 system ran BBS software that would cause a modem to dial a local system and display the application as if it were running on a local machine. Totally sweet.

When we were living at 6162 NE Middle in the nine-eight 292, we got an 80386 which ran Doom. Yeah, the original one, not the fancy new one with the double barrel shotgun, but it would probably run that one, too.

  [Read more...]
Setting up RAID0 in Ubuntu 12.04 in AWS High I/O
+0 Vote Up -0Vote Down

Amazon announced high I/O instances today. This is huge for anyone with a database larger than available memory, as it’s been a complete nightmare dealing with EBS up till now. Now your Cassandra, MongoDB, MySQL, or whatever your using should be able to perform well without requiring keeping your entire dataset in memory.

With each instance you get 2x1TB of disk. In this tutorial I’ll be setting it up as a RAID0 to get a single 2TB disk which should deliver excellent performance.

Before you get started, make sure you’ve got mdadm installed:

apt-get install mdadm

To begin, check fdisk and make sure your 1TB drives are mounted.

root@ip-10-140-128-232:~# fdisk -l

Disk /dev/xvda1: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044

  [Read more...]
WordPress on S3: the beauty of simplicity
+2 Vote Up -1Vote Down

My first computer program was written almost quarter a century ago on a BK-0010 computer.  It was very simple: the program asked the user to enter their name and then greeted the user using the entered name, like “Hello, Artem!”.  I was fascinated.  A couple of lines written in Vilnius BASIC transformed a piece of metal and silicon into a considerate thing that cared about a person’s name enough to remember it :-).  Of course, the first experience doesn’t represent the day-to-day routine of software development, but the moments when I see a couple of lines making an amazing transformation still enchant me, and remind me why I’ve been writing code all this time.

I’ve just experienced this very same first-time feeling as we’ve released

  [Read more...]
CAOS Theory Podcast 2012.04.20
+0 Vote Up -0Vote Down

Topics for this podcast:

*OpenStack, Amazon, Eucalyptus and Citrix engage in open cloud warfare
*Microsoft spins off new company for openness
*Updates on automation players Puppet Labs and Opscode with Chef
*Percona turns attention to MySQL high availability
*Open APIs as the fifth pillar of modern IT openness

iTunes or direct download (28:42, 4.9MB)

Amazon RDS for MySQL - Is it any good?
+1 Vote Up -0Vote Down
We have been testiing the MySQL RDS Service from Amazon here at RF, and so far it looks good for what we use MySQL for. We don't have that much data left in MySQL though, but some of the services are still mission critical, and we have had a couple running on RDS for a week or so.

I have to say I am pretty happy so far, but there are a couple of things you should know before you get to use the services. To begin with, you don't get a proper MySQL root account, i.e. no SUPER privileges. No big deal I guess, but this means there are a few things you cannot do. I was planning to migrate off the EC2 based server to RDS by setting up the RDS service as a slave, and then switching to the RDS service, but as SUPER privilege is required for CHANGE MASTER TO, I could not do this. And before you ask: Amazon DOES support slaves among the RDS servers, but this is

  [Read more...]
Open APIs are the new open source
+1 Vote Up -0Vote Down

We’ve seen the rise of open source software in the enterprise and also beyond the IT industry, but the real keys to openness and its advantages in today’s technology world — where efficient use of cloud computing and supporting services are paramount — exist in open application programming interfaces, or APIs.

Open source software continues to be a critical part of software development, systems administration, IT operations and more, but much of the action in leveraging modern cloud computing and services-based infrastructures centers on APIs. Open APIs are the new open source.

Read the full story at LinuxInsider.

451 CAOS Links 2011.11.18
+0 Vote Up -0Vote Down

Rapid7 secures new funding. Microsoft drops Dryad. And more.

# Rapid7 secured $50m in series C funding.

# Microsoft confirmed that it is ditching its Dryad project in favour of Apache Hadoop.

# Arun Murthy provided more details of Apache Hadop 0.23.

# The Google Plugin for Eclipse and GWT Designer projects are now fully open source.

# openSUSE released version 12.1.

# Amazon

  [Read more...]
$1000 per hour Servers, Anyone?
+0 Vote Up -0Vote Down

Read the original article at $1000 per hour Servers, Anyone?

Amazon's spot market for computing power is set up as an open market for surplus servers. The price is dynamic and depends on demand. So when demand is low, you can get computing instances for rock bottom prices. When you do that you normally set a range of prices you're willing to pay. If it goes over your top end, your instances get killed and re-provisioned for someone else. Obviously this wouldn't work for all applications, like a website that has to be up all the time, but for computing power, say to run some huge hedge fund analytics, it might fit perfectly.

A recent post on SEO MOZ alerted us to an interesting story where spot instances spiked to

  [Read more...]
RAID 10 your EBS data
+0 Vote Up -0Vote Down

When I spoke at Percona Live (video here) on running an E-commerce database in Amazon EC2, I briefly talked about using RAID 10 for additional performance and fault tolerance when using EBS volumes. At first, this seems counter intuitive. Amazon has a robust infrastructure, EBS volumes run on RAIDed hardware, and are mirrored in multiple availability zones. So, why bother? Today, I was reminded of just how important it is. Please note that all my performance statistics are based on direct experience running a MySQL database on a m2.4xlarge instance and not on some random bonnie or orion benchmark. I have those graphs floating around on my hard drive in glorious 3D and, while interesting, they do not necessarily reflect real-life

  [Read more...]
Basic scalability principles to avert downtime
+1 Vote Up -1Vote Down

In the press in the last two days has been the reported outage of Amazon Web Services Elastic Compute Cloud (EC2) in just one North Virginia data center. This has affected many large website includes FourSquare, Hootsuite, Reddit and Quora. A detailed list can be found at ec2disabled.com.

For these popular websites was this avoidable? Absolutely.

Basic scalability principles if deployed in these systems architecture would have averted the significant downtime regardless of your development stack. While I work primarily in MySQL these principles are not new, nor are they complicated, however they are fundamental concepts in scalability that apply to any technology

  [Read more...]
Oh no, what have I done! Or: My cloud evangelism got cloudy. Or: The dog ate my network..
+2 Vote Up -0Vote Down
At the recent MySQL User Conference, I had a talk on how we at Recorded Future use Amazon EC2 to keep our servers humming (the slides for the talk are available here). And of cource, Amazon EC2 turned back on me (and us all at RF) about a week later. I will not go into details, but somehow, we still don't know exactly why ("The cleaning lady unplugged THE SERVER to plug in the vacuum-cleaner", "The dog ate my network"?).

The thing has been down for 24+ hours now, and there is no end in sight, as far as I can tell. As I said in my talk, we are considering a move to Amazon RDS instead of running our MySQL servers ourselves, and one of my first reactions to this trouble was that we really should have done that already. That was until I

  [Read more...]
Hey, it's time for the MySQL User Conference again! Come see me!
+1 Vote Up -1Vote Down
And I mean that, come see me, say hello, buy me a beer (extra points!). Or even more so, come see my session at 10:50 on tuesday morning April 12. I'll be speaking on how to manage large datasets in an Amazon EC2 environment, and this is largely based on my experiences at doing just that at my new job (or new, I've been doing it for more that 6 months now) as Database Architect at Recorded Future.

This will not be an incredibly technical presentation, in terms of showing actual code and things. Rather, I will look at some of the issues when running in an EC2 environment, and how we manage it here at Recorded Future. Also, I will present a bit of how our architecture works, which is more relevant that one may thinks, as we have Cloud based architectures on mind all the time, all our development, testing and

  [Read more...]
Developer Week in Review
+0 Vote Up -3Vote Down

Netflix went down over three hours ago, and everyone is on edge here. My son just started reciting the script to "Monty Python and the Holy Grail" in an attempt to keep our courage up. This may be the last thing I ever write, so — Oh, never mind, it's back up again ... Crisis averted, and on to this week's developer news.

We have an App Store Appstore for that!

Amazon this week unleashed their own Appstore for Android devices. Apple took umbrage at the use of the (evidently trademarked) term "App Store"

  [Read more...]
451 CAOS Links 2011.03.22
+0 Vote Up -0Vote Down

Paranoid Android. Canonical and Gnome. A new OSI. And more.

Paranoid Android
If you are interested in the potential violation of the GPL by the Android kernel you have probably already immersed yourself in the numerous blog posts published on the topic. If not, start with Sean Hogle’s analysis or Bradley M Kuhn’s overview of the original allegations and work backwards from there, not forgetting a detour for the obligatory Microsoft connection. Linus Torvalds said claim “seems totally bogus”. In the

  [Read more...]
Amazon moves into PaaS with Elastic Beanstalk, Java as 1st class citizen
Employee_Team +0 Vote Up -0Vote Down

Amazon's EC2 and its sister S3 service have been indisputable leaders in IaaS for a long while now and GlassFish and more generally J2EE/JavaEE took advantage of it starting in 2008 (see here and here), with documented how-to's and significant production references.

Just yesterday, AWS's Evangelist Jeff Barr announced

  [Read more...]
Cloud Migration Whitepapers
+0 Vote Up -2Vote Down
Amazon's AWS team has published a series of whitepapers covering various scenarios for migrating into AWS cloud infrastructure. Links to these whitepapers are provided below for your convenience:

- Migrating applications to the AWS cloud
- Migrating web application
- Migrating batch processing applications
- Migrating backend processing pipelines
Showing entries 1 to 30 of 91 Next 30 Older Entries

Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.