Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 19

Displaying posts with tag: Amazon Web Services (reset)

Amazon’s Big Data Suite – Part 2
+0 Vote Up -0Vote Down

 

In Part 1 we started our study of Amazon Services and looked at Amazon EC2. In this part, we will look at other Amazon services like EMR, DynamoDB and RDS.

 

  • 1.      Amazon Elastic Map Reduce
  • Amazon EMR is a web service which makes cloud computing very easy. Amazon’s EMR cluster comes preconfigured with Hadoop, which as mentioned earlier is a data processing and storage framework. This preconfiguration makes it very easy to start analysing your data in no time. Amazon EMR has applications in machine learning, financial analysis, bioinformatics etc.

     

    Just like EC2, you can launch any number of EMR instances as you need and you will only be charged for the computing power you have used.

      [Read more...]
    The network is reliable
    +2 Vote Up -0Vote Down

    A fascinating post-mortem on high profile network failures:

    This post is meant as a reference point–to illustrate that, according to a wide range of accounts, partitions occur in many real-world environments. Processes, servers, NICs, switches, local and wide area networks can all fail, and the resulting economic consequences are real. Network outages can suddenly arise in systems that are stable for months at a time, during routine upgrades, or as a result of emergency maintenance. The consequences of these outages range from increased latency and temporary unavailability to inconsistency, corruption, and data loss. Split-brain is not an academic concern: it happens to all kinds of systems–sometimes for days on end. Partitions deserve serious consideration.

    Percona Live MySQL Conference 2013 wrap-up
    +2 Vote Up -0Vote Down

    The Percona Live MySQL Conference & Expo 2013 was April 22-25 in Santa Clara, California. This was Percona’s second year organizing the conference and we were very pleased with the event and the feedback (check the #perconalive hashtag for a sampling of the great comments such as this from Tom Krouper or this from John Goulah or this from Jeremy Tinley or this from SF MySQL Meetup).

      [Read more...]
    Keynotes, BOFs, and the Community Networking Reception at Percona Live MySQL Conference and Expo
    +1 Vote Up -0Vote Down

    The Percona Live MySQL Conference and Expo begins next Monday and runs April 22-25, 2013. Attendees will see great keynotes from leaders in the industry including representatives from Oracle, Amazon Web Services, HP, Continuent, and Percona. They can also participate in thought provoking Birds of a Feather sessions on Tuesday night and the Wednesday night Community Networking Reception will be fun and entertaining with the presentation of the Community Awards and the Lightning Talks.

    If you

      [Read more...]
    Setting up Amazon Web Services
    +0 Vote Up -0Vote Down

    This tutorial will help you register and get ready to use Amazon Web Service (AWS). AWS provides a free tier so it is possible to use these services at ZERO cost.

    These instructions are used by the Effective MySQL: Backup and Recovery book examples.

    Step 1: Registration

  • Goto AWS site
  • Register email address
  • Enter Login Credentials
  • Enter Contact Information
  • Enter Credit Card details (while this is required, provided you follow free guidelines you will not be charged)
  • Identity verification by Telephone
  • Activation of account
  • Screenshots

      [Read more...]

    Open APIs are the new open source
    +1 Vote Up -0Vote Down

    We’ve seen the rise of open source software in the enterprise and also beyond the IT industry, but the real keys to openness and its advantages in today’s technology world — where efficient use of cloud computing and supporting services are paramount — exist in open application programming interfaces, or APIs.

    Open source software continues to be a critical part of software development, systems administration, IT operations and more, but much of the action in leveraging modern cloud computing and services-based infrastructures centers on APIs. Open APIs are the new open source.

    Read the full story at LinuxInsider.

    The market for Cloud Computing
    +0 Vote Up -0Vote Down

    Read the original article at The market for Cloud Computing

    Saw this awesome infographic by Cloud Spectator on twitter today. A great snapshot of the expected growth in Cloud Computing. If the Cloud Computing market was stacked up against world economies it would be the 51st largest in the world with massive inequality - Amazon has half the share.

    For more articles like these go to MySQL Expert, Linux, EC2 & Scalability Consulting NYC

    Specialty Technology Consultant – New York Scalability Consultant – MySQL & EC2 Scalability
    +0 Vote Up -0Vote Down

    Amazon EC2 and cloud computing offer great promise for startups to ramp up their online presence quickly.  Navigate those challenges with an strong partner.  We bring 20 years experience to the table with each new client.

    • Scaling Web Applications
    • MySQL High Availability in Amazon EC2
    • Amazon Multi-AZ Deployments
    • Amazon RDS Deployments
    • Migrating to Amazon EC2
    • Migrating to MySQL
    • Managing Backups and Disaster Recovery in the Cloud
    • Horizontal Scalability of MySQL on EC2
    • Horizontal Scalability on Cloud Hosted Servers
    • Evaluating Cloud Providers
    • Evaluating MySQL
      [Read more...]
    Open Source Enables the Cloud
    +0 Vote Up -0Vote Down

    With the fast growth of virtualized data centers, and companies like Google, Amazon and Facebook, it's easy to forget how much is built on open-source components, aka commodity software.  In a very real way open-source has enabled the huge explosion of commodity hardware, the fast growth of the internet itself, and now the further acceleration through cloud services, cloud infrastructure, and virtualization of data centers.

    Your typical internet stack and application now stands on the shoulders of tens of thousands of open source developers and projects.  Let's look at a few of them.

    1. Operating System - Linux

    The commodity hardware craze would never have happened without the help of an open-source operating system to run on it.  Linux is an old story now, nonetheless everything else stands on it's shoulders.

    2. Multi-purpose

      [Read more...]
    8 Questions to ask an AWS Expert
    +0 Vote Up -0Vote Down

    If you're headhunting a cloud computing expert, specifically someone who knows Amazon Web Services (AWS) and EC2, you'll want to have a battery of questions to ask them to assess their knowledge.  As with any technical interview focus on concepts and big picture.  As the 37Signals folks like to say "hire for attitude, train for skill".  Absolutely!

    1. Explain Elastic Block Storage?  What type of performance can you expect?  How do you back it up?  How do you improve performance?

    EBS is a virtualized SAN or storage area network.  That means it is RAID storage to start with so it's redundant and fault tolerant.  If disks die in that RAID you don't lose data.  Great!  It is also virtualized, so you can provision and allocate storage, and attach it to your server with various API

      [Read more...]
    Another reason to avoid RDS
    +1 Vote Up -0Vote Down

    My list of reasons for never using or recommending Amazon’s MySQL RDS service grows every time I experience problems with customers. This was an interesting and still unresolved issue.

    ERROR 126 (HY000): Incorrect key file for table '/rdsdbdata/tmp/#sql_5b7_1.MYI'; try to repair it
    

    You may see this is a MyISAM table. The MySQL database is version 5.5, all InnoDB tables and is very small 100MB in total size.
    What is happening is that MySQL is generating a temporary table, and this table is being written to disk. I am unable to change the code to improve the query causing this disk I/O.

    What I can not understand and have no ability to diagnose is why this error occurs sometimes and generally when the database is under additional system load. With RDS you have no visibility of the server running the production database. While you have SQL


      [Read more...]
    Basic scalability principles to avert downtime
    +1 Vote Up -1Vote Down

    In the press in the last two days has been the reported outage of Amazon Web Services Elastic Compute Cloud (EC2) in just one North Virginia data center. This has affected many large website includes FourSquare, Hootsuite, Reddit and Quora. A detailed list can be found at ec2disabled.com.

    For these popular websites was this avoidable? Absolutely.

    Basic scalability principles if deployed in these systems architecture would have averted the significant downtime regardless of your development stack. While I work primarily in MySQL these principles are not new, nor are they complicated, however they are fundamental concepts in scalability that apply to any technology

      [Read more...]
    Inode allocation on Amazon AWS RDS (Relation Database Service)
    +5 Vote Up -0Vote Down

    The attached storage used by Amazon’s managed Relational Database Service has a known issue where the bytes per inode ratio is very high (default on RHEL5 systems is 4096, to be found in /etc/mke2fs.conf). Amazon does not allow any administrative access to these instances so there is no way to reformat the filesystem to allocate more inodes, or attach storage the user can format with a different ratio.

    This becomes problematic for databases that have many small tables (generally MyISAM tables, or InnoDB with the innodb_file_per_table setting) which quickly consume the available inodes. When the inode allocation is exhausted MySQL responds with

    "ERROR 1030 (HY000): Got
      [Read more...]
    Report from Oracle Openworld
    +3 Vote Up -0Vote Down

    Openworld 2010, despite the supposedly lagging economy, had record attendance again this year.  No doubt this was the result of Oracle acquiring something like fourteen companies since last year, including Sun in 2009.  The crowds were thick, divided about evenly between geeks in badly-fitting vendor t-shirts and slick sales-side hustlers with dress pants and shiny shoes.  I landed somewhere in the middle of the two (badly-fitting dress shirt, comfortable jeans and loafers), proudly sporting a long dangling codpiece of ribbons from my attendee badge:

    My OOW2010 Codpiece

    Oracle made a number of important announcements this year at OpenWorld, including a the Exalogic machine, and support for Amazon EC2, which I blogged

      [Read more...]
    Introducing the Bluegecko MySQL Training AMI
    +0 Vote Up -0Vote Down

    I created the Bluegecko MySQL training AMI as a MySQL sandbox that folks could use to learn things about MySQL. I wanted the AMI to have MySQL 5.0, and a large collection of tools — for both tinkering and visualizing what is happening inside MySQL and on the system in general.

    I chose to host the AMI on a small instance since they’re cheap to operate, which means you can fire up 3-4 of them to try out a replication scheme without feeling guilty. It runs CentOS 5.4 and MySQL 5.0.77 from the CentOS repository.

    One of the goals I had for the training AMI was for it to be easy to visually inspect what is going on inside of MySQL and the system at large. To that end I’ve installed Cacti, a graphing and visualization tool, and equipped it with templates

      [Read more...]
    Blue Gecko named Amazon Web Services partner
    +0 Vote Up -0Vote Down

    Blue Gecko has been officially recognized as an Amazon Web Services partner!  Blue Gecko was an early adopter of the AWS platform for databases and database-backed applications. By deploying Oracle, Oracle E-Business Suite and MySQL infrastructures in the cloud, Blue Gecko leverages AWS to substantially improve customer IT flexibility and reduce costs. Blue Gecko can provide a variety of cloud-related services:

    Oracle Databases

    • Deploy Data Guard on AWS for disaster recovery of conventionally-hosted infrastructure
    • Design end-to-end AWS-based Oracle solutions
    • Rapidly deploy test environments in the AWS cloud

    Oracle E-Business Suite

    • Instant On AWS-based Vision Demo environments
    • Deploy Data Guard on AWS for disaster recovery of conventionally-hosted infrastructure
    • Quickly scale
      [Read more...]
    Setting up MySQL on Amazon Web Services (AWS) Presentation
    +0 Vote Up -1Vote Down

    On Tuesday at the MySQL Camp 2009 in Santa Clara I presented Setting up MySQL on Amazon Web Services (AWS).

    This presentation assumed you know nothing about AWS, and have no account. With Internet access via a Browser and a valid Credit Card, you can have your own running Web Server on the Internet in under 10 minutes, just point and click.

    We also step into some more detail online click and point and supplied command line tools to demonstrate some more advanced usage.

    Getting started with MySQL in Amazon Web Services View more presentations from Ronald Bradford.
    Yahoo adds SmugMug support!
    +0 Vote Up -0Vote Down

    Yahoo! in cloud OR Hadoop? (Яху в облаках) by Alexander & Natalie

    tl;dr: Yahoo adds SmugMug support to Profiles. Windows Live coming. Lots of other services, too.

    Wow, what a pleasant surprise! Woke up this morning to this story on TechCrunch about 20 new services they’d added to Yahoo Profiles (here’s

      [Read more...]
    On Why Auto-Scaling in the Cloud Rocks
    +0 Vote Up -0Vote Down

    In high school, I had a great programmable calculator. I’d program it to solve complicated math and science problems “automatically” for me. Most of my teachers got upset if they found out, but I’ll always remember one especially enlightened teacher who didn’t. He said something to the effect of “Hey, if you managed to write software to solve the equation, you must thoroughly understand the problem. Way to go!”.

    George Reese wrote up a blog post over at O’Reilly the other day called On Why I Don’t Like Auto-Scaling in the Cloud. His main argument seems to be that auto-scaling is bad and reflects poor capacity planning. In the comments, he specifically calls

      [Read more...]
    Showing entries 1 to 19

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.