Planet MySQL Planet MySQL: Meta Deutsch Español Français Italiano 日本語 Русский Português 中文
10 Newer Entries Showing entries 31 to 40 of 64 10 Older Entries

Displaying posts with tag: ec2 (reset)

Looks like Amazon is listening
+0 Vote Up -0Vote Down
Just got the following in my email this morning. I sure wish they had done this earlier. “Free Inbound Data Transfer (until June 30, 2010) Data Transfer into AWS will be free of charge from now through June 30, 2010, making it even easier for customers to get their data into AWS. This applies to [...]
Dissection of EC2 / EBS volume
+3 Vote Up -0Vote Down

So during preparation of XtraDB template for EC2 I wanted to understand what IO characteristics we can expect from EBS volume ( I am speaking about single volume, not RAID as in my previous post). Yasufumi did some benchmarks and pointed me on interesting behavior, there seems several level of caching on EBS volume.

Let me show you. I did sysbench random read IO benchmark on files with size from 256M to 5GB with step 256M. And, as Morgan pointed me, I previously made first write, to avoid first-write penalty:

dd if=/dev/zero of=/dev/sdk bs=1M

for reference script is:

PLAIN TEXT CODE:
  • #!/bin/sh
  • set -u
  •   [Read more...]
    EC2/EBS single and RAID volumes IO benchmark
    +2 Vote Up -0Vote Down

    During preparation of Percona-XtraDB template to run in RightScale environment, I noticed that IO performance on EBS volume in EC2 cloud is not quite perfect. So I have spent some time benchmarking volumes. Interesting part with EBS volumes is that you see it as device in your OS, so you can easily make software RAID from several volumes.

    So I created 4 volumes ( I used m.large instance), and made:

    RAID0 on 2 volumes as:
    mdadm -C /dev/md0 --chunk=256 -n 2 -l 0 /dev/sdj /dev/sdk

    RAID0 on 4 volumes as:
    mdadm -C /dev/md0 --chunk=256 -n 4 -l 0 /dev/sdj /dev/sdk /dev/sdl /dev/sdm

    RAID5 on 3 volumes as:
    mdadm -C /dev/md0 --chunk=256 -n 3 -l 5 /dev/sdj /dev/sdk /dev/sdl

    RAID10 on 4 volumes in two steps:

    mdadm






      [Read more...]
    Three key things to know about moving MySQL into the cloud.
    +4 Vote Up -0Vote Down

    The question "what problems will I have when migrating to the cloud" gets asked often enough. If by cloud you mean Amazon EC2, then from a technical perspective there isn't much that changes. The biggest thing that changes is just how you pay your bill.

    Having said that, there's still a few potential gotchas:

  • There are no Virtual IP addresses. Most High Availability tools (like MMM or DRBD+Heartbeat)
    work on the principal of having a floating IP address which is used for the application to connect to the current master. With EC2, you can't do this.
  • There's no customization of the memory. The maximum amount of memory you can have is 15GB, so some users with larger working sets may find this a limitation. If you look at the Dell online store, it costs $2094 to upgrade an R900

  •   [Read more...]
    Your opinion on EC2 and other cloud/hosting options
    +0 Vote Up -0Vote Down

    EC2 is nifty, but it doesn’t appear suitable for all needs, and that’s what this post is about.

    For instance, a machine can just “disappear”. You can set things up to automatically start a new instance to replace it, but if you just committed a transaction it’s likely to be lost: MySQL replication is asynchronous, EBS which is slower if you commit your transactions on it, or EBS snapshots which are only periodic (you’d have to add foo on the application end). This adds complexity, and thus the question arises whether EC2 is the best solution for systems where this is a concern.

    When pondering this, there are two important factors to consider: a database server needs cores, RAM and reasonably low-latency disk access, and application servers should be near their database server. This means you shouldn’t split app and db servers to

      [Read more...]
    451 CAOS Links 2009.06.12
    +0 Vote Up -0Vote Down

    Yahoo opens up Hadoop distribution. Microsoft and Novell claim customer wins. And more.

    Follow 451 CAOS Links live @caostheory

    The elephant in the room
    Plenty of news emerged form the Hadoop Summit this week, including Cloudera announced support for Amazon Elastic Block Storage (EBS) and introduced Sqoop, open source tool for importing databases into Hadoop, while Yahoo! Released! The! Yahoo! Distribution! Of! Hadoop! opening up its Hadoop developments to the wider community. As Savio Rodrigues noted, there has been a surge in the number of contributors for the Hadoop project in the last year.

    Best of the rest
    # Novell and Microsoft


      [Read more...]
    SysBench on EC2: Size Matters
    +0 Vote Up -0Vote Down

    It been sometime since we benchmarked MySQL/Galera with sysbench, using it mostly for testing. Our recent visit to Percona Performance Conference showed that sysbench is probably most widely used tool for MySQL benchmarking in the community and besides it is the only benchmark I know that correctly measures response times. So I just gave it a shot with our 0.6 release.
    I ran OLTP test on 1-4 large EC2 instances. At first I tried 100K row table and it was good except that the deadlock rate was too high to my taste:

    nodes	users	trx/s	deadlks	95%lat
    --------------------------------------
    4	40	840	28.13	0.099
    4	60	866	86.34	0.150
    4	80	781	194.8	0.240
    

    Note how deadlock rate escalates with the number of concurrent connections. But what is 100K rows by modern standards? Kids play. So I tried 1M rows. And it just shows that Galera cluster is cut for big tables:


      [Read more...]
    Announcing Drizzle on EC2
    +1 Vote Up -0Vote Down

    I have published the very first sharable Drizzle Amazon Machine Image (AMI) for AWS EC2, based on the good feedback from my discussion at the Drizzle Developer Day on what options we should try.

    This first version is a 32bit Developer instance, showcasing Drizzle and all necessary developer tools to build Drizzle from source.

    What you will find on drizzle-ami/intrepid-dev32 - ami-b858bfd1

    Ubuntu 8.10 Intrepid 32 bit base server installation:

    • build tools
    • drizzle dependencies
    • bzr 1.31.1

    From the respective source trees the following software is available:

    • drizzle 2009.04.997
    • libdrizzle 0.0.2
    • gearman 0.0.4
    • memcached 1.2.8
    • libmemcached 0.28

    Drizzle has been configured

      [Read more...]
    Sun talks out Cloud: Open Cloud Platform
    Employee +0 Vote Up -0Vote Down

    Sun's Open Cloud Vision unveilled: Open Cloud Platform, an open infrastructure powered by Java, MySQL, OpenSolaris, and Open Storage software technologies.  Open APIs, Open formats and Open source.

    On March 18th, at CommunityONE aka CloudONE, Sun unveiled the open cloud platform for powering public and private clouds. We also  announced that we are building our own Public Cloud. This will include a Storage and Compute Cloud. Our Cloud will be compatible with Amazon S3 and EC2 at the API level. Meaning, we will provide S3 and EC2 compatibility APIs in addition to our own, hence enabling an easy migration from Amazon services to Sun Cloud. All clouds - public, private or hybrid, built on Sun's Open Cloud

      [Read more...]
    Sun talks out Cloud: Open Cloud Platform
    Employee +0 Vote Up -0Vote Down

    Sun's Open Cloud Vision unveilled: Open Cloud Platform, an open infrastructure powered by Java, MySQL, OpenSolaris, and Open Storage software technologies.  Open APIs, Open formats and Open source.

    On March 18th, at CommunityONE aka CloudONE, Sun unveiled the open cloud platform for powering public and private clouds. We also  announced that we are building our own Public Cloud. This will include a Storage and Compute Cloud. Our Cloud will be compatible with Amazon S3 and EC2 at the API level. Meaning, we will provide S3 and EC2 compatibility APIs in addition to our own, hence enabling an easy migration from Amazon services to Sun Cloud. All clouds - public, private or hybrid, built on Sun's Open

      [Read more...]
    10 Newer Entries Showing entries 31 to 40 of 64 10 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.