Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Previous 30 Newer Entries Showing entries 31 to 52

Displaying posts with tag: aws (reset)

A CTO Must Never Do This…
+0 Vote Up -4Vote Down

Read the original article at A CTO Must Never Do This…

A couple years back I was contacted to look at a very strange problem.

The firm ran flash sales. An email goes out at noon, the website traffic explodes for a couple of hours, then settles back down to a trickle.

Of course you might imagine where this is going. During that peak, the MySQL database was brought to its knees. I was asked to do analysis during this peak load, and identify and fix problems. Make it go faster, please!

First day on the job I’m working with a team of outsourced DBAs. I was also working

  [Read more...]
Impressions from Amazon's AWS Summit in NYC
+0 Vote Up -0Vote Down
Yesterday (4/19) I attended the AWS Summit in NYC (http://aws.amazon.com/aws-summit-2012/nyc).

I'm a big fan and also a heavy user of AWS especially S3, EC2, and naturally, RDS. In every point in time I have several dozens of AWS machines running for me out there in the East region, and in some cases when we do some special benchmarks and tests, number of EC2 and RDS machines can easily reach 3-digit. As I said, I'm a fan...

A few quotes I was able to catch and document on my laptop, on my laps...:
"When you develop an app for facebook, you must be prepared (and be afraid) that to your party, not noone will show up, but everybody will show up!"
So true! Simple and true. We all want to succeed, to have success with our app. We have to think about scaling




  [Read more...]
Setting up Amazon Web Services
+0 Vote Up -0Vote Down

This tutorial will help you register and get ready to use Amazon Web Service (AWS). AWS provides a free tier so it is possible to use these services at ZERO cost.

These instructions are used by the Effective MySQL: Backup and Recovery book examples.

Step 1: Registration

  • Goto AWS site
  • Register email address
  • Enter Login Credentials
  • Enter Contact Information
  • Enter Credit Card details (while this is required, provided you follow free guidelines you will not be charged)
  • Identity verification by Telephone
  • Activation of account
  • Screenshots

      [Read more...]

    Taming the EC2 API
    +1 Vote Up -0Vote Down

    I've been spending some time lately familiarizing myself with EC2, setting up some MySQL servers & clusters here and there, and doing some really basic configuration testing. One situation you'll run into when interacting with EC2 is that it gets unwieldy to use the AWS Management Console web interface for interacting with your instances. There ends up being lots of scrolling, lots of staring, and lots of sighs. Since I'm using SSH to connect to and interact with my instances, I want a reasonable way to find information about them on the Unix command line.

    Amazon has an official set of tools [http://aws.amazon.com/developertools/351] that give you this information , at least theoretically. It is some gigantic distribution of shell scripts and Java madness that, if you are very

      [Read more...]
    Resilient Services – Resilient Infrastructure – Site Reliability Engineer
    +0 Vote Up -0Vote Down

    Modern internet infrastructure are complex.  Components and services are prone to failure.  Resiliency involves building redundancy, best practices and processes into your architecture to make you able to bend and not break.

    • Migrating to cloud service providers
    • Rearchitecting and refactoring applications to scale
    • Scaling the database tier - MySQL and Oracle
    • Building redundancy into every layer
    • Deploying object caches - memcache
    • Deploying page caches - varnish
    • Migrating to Innodb - transactional storage engine
    • Infrastructure design
    • Infrastructure automation
    • Disaster Recovery
    • Business Continuity with cloud deployments

    Call or Skype us in New York City +1-212-533-6828

    3 Ways to Boost Cloud Scalability
    +0 Vote Up -0Vote Down

    Deploying in the Amazon cloud is touted as a great way to achieve high scalability while paying only for the computing power you use. How do you get the best scalability from the technology?

    1. Use Auto-scaling

    Auto-scaling is a unique feature of cloud computing and Amazon's EC2 offering. Setup a load balancer and a couple of webservers for your application as you normally would. Design your webserver based on a template AMI that you'll reuse over and over. Then setup auto-scaling and set thresholds based on the traffic you forecast. When a threshold is passed, AWS will spinup a new instance of your webserver, and roll it into the load balancer pool

      [Read more...]
    RAID 10 your EBS data
    +0 Vote Up -0Vote Down

    When I spoke at Percona Live (video here) on running an E-commerce database in Amazon EC2, I briefly talked about using RAID 10 for additional performance and fault tolerance when using EBS volumes. At first, this seems counter intuitive. Amazon has a robust infrastructure, EBS volumes run on RAIDed hardware, and are mirrored in multiple availability zones. So, why bother? Today, I was reminded of just how important it is. Please note that all my performance statistics are based on direct experience running a MySQL database on a m2.4xlarge instance and not on some random bonnie or orion benchmark. I have those graphs floating around on my hard drive in glorious 3D and, while interesting, they do not necessarily reflect real-life

      [Read more...]
    Basic scalability principles to avert downtime
    +1 Vote Up -1Vote Down

    In the press in the last two days has been the reported outage of Amazon Web Services Elastic Compute Cloud (EC2) in just one North Virginia data center. This has affected many large website includes FourSquare, Hootsuite, Reddit and Quora. A detailed list can be found at ec2disabled.com.

    For these popular websites was this avoidable? Absolutely.

    Basic scalability principles if deployed in these systems architecture would have averted the significant downtime regardless of your development stack. While I work primarily in MySQL these principles are not new, nor are they complicated, however they are fundamental concepts in scalability that apply to any technology

      [Read more...]
    Amazon moves into PaaS with Elastic Beanstalk, Java as 1st class citizen
    Employee_Team +0 Vote Up -0Vote Down

    Amazon's EC2 and its sister S3 service have been indisputable leaders in IaaS for a long while now and GlassFish and more generally J2EE/JavaEE took advantage of it starting in 2008 (see here and here), with documented how-to's and significant production references.

    Just yesterday, AWS's Evangelist Jeff Barr announced

      [Read more...]
    Video: Netflix's migration to AWS cloud
    +0 Vote Up -1Vote Down
    Found this video regarding Netflix's migration to Amazon's AWS cloud very informative. Enjoy!
    Cloud Migration Whitepapers
    +0 Vote Up -2Vote Down
    Amazon's AWS team has published a series of whitepapers covering various scenarios for migrating into AWS cloud infrastructure. Links to these whitepapers are provided below for your convenience:

    - Migrating applications to the AWS cloud
    - Migrating web application
    - Migrating batch processing applications
    - Migrating backend processing pipelines
    A review of Cloud Application Architectures by George Reese
    +2 Vote Up -0Vote Down

    Cloud Application Architectures

    Cloud Application Architectures. By George Reese, O’Reilly 2009. (Here’s a link to the publisher’s site).

    This is a great book on how to build apps in the cloud! I was happy to see how much depth it went into. It’s short — 150 pages plus some appendixes — so I was expecting it to be a superficial overview. But it isn’t. It is thorough. And it is also obviously built on his own experience building very specific applications that he uses to run his business — he

      [Read more...]
    Open source and the cloud - the quick and the dead
    +0 Vote Up -0Vote Down

    Savio Rodrigues has published a post arguing that cloud platforms such as Amazon Web Services and Microsoft’s Azure pose a threat to the monetization of open source by specialist vendors.

    Savio makes a good case based on the recent launch of AWS’s Relational Database Service, based on MySQL, and Microsoft’s support for MySQL and Tomcat on Azure:

      “When Amazon decided to offer MySQL via Amazon RDS, they did so without purchasing MySQL support from Sun. I’ve confirmed that Microsoft Azure is supporting MySQL on Azure without paying Sun for a MySQL Enterprise subscription.”

    Clearly there is a threat to open source vendors from cloud-based services. Meanwhile I have previous

      [Read more...]
    AWS Now With MySQL Support
    Employee_Team +1 Vote Up -0Vote Down



    Amazon has just announced the availability of a new service: the Amazon Relational Database Service (Amazon RDS), based on MySQL 5.1 (AWS Blog, RDS@AWS).  They support both InnoDB and MyISAM but not replication.  See notes from: Mark Callahan@Facebook,



      [Read more...]
    451 CAOS Links 2009.06.02
    +0 Vote Up -0Vote Down

    Cloudera lands funding. SourceForge acquires Ohloh. Novell reports Linux growth. And more.

    Follow 451 CAOS Links live @caostheory

    Cloudera shows signs of progress

    GigaOM reported that Cloudera raised $6m Series B funding from Accel and Greylock and is now looking beyond web applications to wider enterprise adoption of Hadoop. Cloudera also announced its first certification program for Hadoop.

    Open source goes mainstream in the UK
    There have been signs of change recently with regards to open source adoption in the UK, which has traditionally lagged behind the rest of Europe and the US. CBR Magazine provided an analysis of open source in the UK




      [Read more...]
    Cost of clouds, Mosso/Slicehost vs AWS
    +0 Vote Up -0Vote Down

    Marco Tabini has a great post discussing the cost of the cloud, and the current state of affairs. He calls for a simpler cloud platform, not just in terms of cost, but ease of use and products and services that adapt to changes in the market. Though the $100/month Mosso offering is mentioned (this site is hosted on Mosso), I would like to point out the recent acquisitions by Rackspace/Mosso that make their cloud offerings even more compelling than AWS for me.

    • Slicehost : Rackspace announced the acquisition in late 2008. This allows me
      [Read more...]
    Linux and open source no puff in the clouds
    +0 Vote Up -0Vote Down

    UPDATED - I had to update this post after a conversation with RightScale founder and CTO Thorsten von Eicken and for Sun’s Open Cloud announcement, which are both now included below.

    There has been some substantial technology and news regarding open source software in cloud computing lately. More proof that open source is reaching into nearly all aspects of enterprise and broader IT, and also reinforcement of the idea that open source software will continue to have a pervasive and disruptive impact on the way organizations of all shapes and sizes do their computing and deal with their data.

    First up is RightScale, which as detailed by 451 colleague and Principal Analyst William Fellows, is up and running across the pond on

      [Read more...]
    Cloud Computing - Executive Seminar
    +0 Vote Up -0Vote Down
    Tomorrow, I'll be attending the Executive Seminar on Cloud Computing at NASDAQ MarketSite (NY). Speakers include Dr. Werner Vogels and Mårten Mickos (ex-CEO of MySQL). Big thanks to Amazon and RightScale who were able to accommmodate my RSVP even when the registration had formally closed.

    I hope to be able to catch up with Mårten Mickos during the event. In case I do succeed in catching up, is there any question you want me to ask him? You can email me or post a comment.

    It's funny that the event site still shows Mårten's title as "SVP of Sun Microsystems’ Database Group."
    FathomDB: Database as a service, in the cloud
    +0 Vote Up -0Vote Down

    A lot of people are into the whole cloud computing scenario these days. However, no one has talked about offering DBA-like services in the cloud, all automated, so that startups don’t have to get their own DBAs.

    Enter FathomDB. They are poised to offer databases as a service (maybe they’ll charge per database - so you can in theory run both WordPress and Mediawiki, if you prefix wp_ and mw_ in your table creation, for example). They are using MySQL. They’ve also taken the worry of running a database out - they will backup, they will setup (so you don’t have to issue GRANT commands :P), and they will also monitor your databases for you.

    But what really takes the cake? The fact that they will also offer performance advisors. This totally reminds me of the MySQL

      [Read more...]
    On Why Auto-Scaling in the Cloud Rocks
    +0 Vote Up -0Vote Down

    In high school, I had a great programmable calculator. I’d program it to solve complicated math and science problems “automatically” for me. Most of my teachers got upset if they found out, but I’ll always remember one especially enlightened teacher who didn’t. He said something to the effect of “Hey, if you managed to write software to solve the equation, you must thoroughly understand the problem. Way to go!”.

    George Reese wrote up a blog post over at O’Reilly the other day called On Why I Don’t Like Auto-Scaling in the Cloud. His main argument seems to be that auto-scaling is bad and reflects poor capacity planning. In the comments, he specifically calls

      [Read more...]
    Thoughts on the Cloud
    +0 Vote Up -0Vote Down

    For those of you who have been under a rock for the last several years, there is a buzz-phrase floating around—cloud computing. If you haven’t been paying attention, it is time to wake up.

    While I could spend an entire blog post—if not several—on a definition of cloud computing, I will be talking only about cloud computing in the sense of companies moving servers from their building or network operations center to running virtual servers in this computing cloud.

    While there are a number of companies providing virtual servers, the most visible is Amazon, with their Amazon Web Services (AWS). I will be talking about AWS in this post as it is the service with which I am most familiar. It seems like every month, AWS rolls out new options and services. Just recently Amazon announced that you can now run on AWS the Windows operating system along with

      [Read more...]
    S3 storage engine ported to Drizzle
    +0 Vote Up -0Vote Down
    I've ported my AWS S3 storage engine to Drizzle.

    The source is at bzr branch lp:~fallenpegasus/drizzle/awss3. Pull it and build it like you would the main Drizzle. The engine is built-in, no need to plugin load it.

    Example use:
    
       CREATE TABLE colors
         (nam VARCHAR(32) NOT NULL PRIMARY KEY, val BLOB)
            ENGINE='AWSS3'
            CONNECTION='awss3 bucket_name aws_id aws_secret';
       SELECT val FROM colors WHERE nam='BlueViolet';
    
    


    I will try to keep it tracking the main Drizzle dev tree.
    Previous 30 Newer Entries Showing entries 31 to 52

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.