Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Previous 30 Newer Entries Showing entries 31 to 60 of 98 Next 30 Older Entries

Displaying posts with tag: amazon (reset)

Basic scalability principles to avert downtime
+1 Vote Up -1Vote Down

In the press in the last two days has been the reported outage of Amazon Web Services Elastic Compute Cloud (EC2) in just one North Virginia data center. This has affected many large website includes FourSquare, Hootsuite, Reddit and Quora. A detailed list can be found at ec2disabled.com.

For these popular websites was this avoidable? Absolutely.

Basic scalability principles if deployed in these systems architecture would have averted the significant downtime regardless of your development stack. While I work primarily in MySQL these principles are not new, nor are they complicated, however they are fundamental concepts in scalability that apply to any technology

  [Read more...]
Oh no, what have I done! Or: My cloud evangelism got cloudy. Or: The dog ate my network..
+2 Vote Up -0Vote Down
At the recent MySQL User Conference, I had a talk on how we at Recorded Future use Amazon EC2 to keep our servers humming (the slides for the talk are available here). And of cource, Amazon EC2 turned back on me (and us all at RF) about a week later. I will not go into details, but somehow, we still don't know exactly why ("The cleaning lady unplugged THE SERVER to plug in the vacuum-cleaner", "The dog ate my network"?).

The thing has been down for 24+ hours now, and there is no end in sight, as far as I can tell. As I said in my talk, we are considering a move to Amazon RDS instead of running our MySQL servers ourselves, and one of my first reactions to this trouble was that we really should have done that already. That was until I

  [Read more...]
Hey, it's time for the MySQL User Conference again! Come see me!
+1 Vote Up -1Vote Down
And I mean that, come see me, say hello, buy me a beer (extra points!). Or even more so, come see my session at 10:50 on tuesday morning April 12. I'll be speaking on how to manage large datasets in an Amazon EC2 environment, and this is largely based on my experiences at doing just that at my new job (or new, I've been doing it for more that 6 months now) as Database Architect at Recorded Future.

This will not be an incredibly technical presentation, in terms of showing actual code and things. Rather, I will look at some of the issues when running in an EC2 environment, and how we manage it here at Recorded Future. Also, I will present a bit of how our architecture works, which is more relevant that one may thinks, as we have Cloud based architectures on mind all the time, all our development, testing and

  [Read more...]
Developer Week in Review
+0 Vote Up -3Vote Down

Netflix went down over three hours ago, and everyone is on edge here. My son just started reciting the script to "Monty Python and the Holy Grail" in an attempt to keep our courage up. This may be the last thing I ever write, so — Oh, never mind, it's back up again ... Crisis averted, and on to this week's developer news.

We have an App Store Appstore for that!

Amazon this week unleashed their own Appstore for Android devices. Apple took umbrage at the use of the (evidently trademarked) term "App Store"

  [Read more...]
451 CAOS Links 2011.03.22
+0 Vote Up -0Vote Down

Paranoid Android. Canonical and Gnome. A new OSI. And more.

Paranoid Android
If you are interested in the potential violation of the GPL by the Android kernel you have probably already immersed yourself in the numerous blog posts published on the topic. If not, start with Sean Hogle’s analysis or Bradley M Kuhn’s overview of the original allegations and work backwards from there, not forgetting a detour for the obligatory Microsoft connection. Linus Torvalds said claim “seems totally bogus”. In the

  [Read more...]
Amazon moves into PaaS with Elastic Beanstalk, Java as 1st class citizen
Employee_Team +0 Vote Up -0Vote Down

Amazon's EC2 and its sister S3 service have been indisputable leaders in IaaS for a long while now and GlassFish and more generally J2EE/JavaEE took advantage of it starting in 2008 (see here and here), with documented how-to's and significant production references.

Just yesterday, AWS's Evangelist Jeff Barr announced

  [Read more...]
Cloud Migration Whitepapers
+0 Vote Up -2Vote Down
Amazon's AWS team has published a series of whitepapers covering various scenarios for migrating into AWS cloud infrastructure. Links to these whitepapers are provided below for your convenience:

- Migrating applications to the AWS cloud
- Migrating web application
- Migrating batch processing applications
- Migrating backend processing pipelines
A world of ebooks
+2 Vote Up -5Vote Down
I am a bibliophile, or, to say it in plain English, a book lover. I have been collecting books since I was in first grade. I read books at high speed, which is both a blessing and a curse. A blessing, because I can squeeze useful information out of a book very quickly, and that's useful for my job, and for some of my hobbies. A curse, because when I travel one book is usually not enough to keep me busy for the whole travel, and I need to carry or buy more, with negative effects on the weight of my luggage and my on my back. Ten years ago I had a brief but intense experience with electronic books in a Palm hand held device. It didn't last long, though. The quality of ebooks and readers  [Read more...]
451 CAOS Links 2010.10.08
+0 Vote Up -0Vote Down

Patents! Patents! Patents! Canonical’s perfect 10. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca, and daily at Paper.li/caostheory
“Tracking the open source news wires, so you don’t have to.”

# Google responded to Oracle’s claims that its Android OS infringes copyrights and patents related to Java.

# Matt Asay evaluated the various patent claims against Android and its related devices.

# Microsoft licensed smartphone patents from ACCESS Co and a subsidiary of Acacia Research.

# Glyn Moody assessed what Microsoft’s


  [Read more...]
Report from Oracle Openworld
+3 Vote Up -0Vote Down

Openworld 2010, despite the supposedly lagging economy, had record attendance again this year.  No doubt this was the result of Oracle acquiring something like fourteen companies since last year, including Sun in 2009.  The crowds were thick, divided about evenly between geeks in badly-fitting vendor t-shirts and slick sales-side hustlers with dress pants and shiny shoes.  I landed somewhere in the middle of the two (badly-fitting dress shirt, comfortable jeans and loafers), proudly sporting a long dangling codpiece of ribbons from my attendee badge:

My OOW2010 Codpiece

Oracle made a number of important announcements this year at OpenWorld, including a the Exalogic machine, and support for Amazon EC2, which I blogged

  [Read more...]
Open source in the clouds and in the debates
+0 Vote Up -1Vote Down

We continue to see more evidence of the themes we discuss in our latest CAOS special report, Seeding the Clouds, which examines the open source software used in cloud computing, the vendors backing open source, the cloud providers using it and the impact on the industry.

First, as usual, we are seeing consistencies between our own research — which indicates open source is a huge part of today’s cloud computing offerings from major providers like Amazon, Google, Rackspace, Terremark and VMware — and that of code analysis and management vendor Black Duck. In its analysis of code that runs the cloud, Black Duck also found a preponderance of open source pieces, in many cases the same projects we profile in our report.

Indeed, open source software is an

  [Read more...]
Nginx-Fu: X-Accel-Redirect From Remote Servers
+0 Vote Up -0Vote Down

We use nginx and its features a lot in Scribd. Many times in the last year we needed some pretty interesting, but not supported feature – we wanted nginx X-Accel-Redirect functionality to work with remote URLs. Out of the box nginx supports this functionality for local URIs only. In this short post I want to explain how did we make nginx serve remote content via X-Accel-Redirect.

First of all, here is why you may need this feature. Let’s imagine you have a file storage on Amazon S3 where you store tons of content. And you have an application where you have some content downloading functionality that you want to be available for logged-in/paying/premium users and/or you want to keep track of downloads your

  [Read more...]
Amazon now accepts hard drives for EC2 data transfer
+0 Vote Up -0Vote Down

I guess they got tired of people sending angry emails about data transfer fees:

“Amazon provides an online calculator to help customers decide whether it makes financial sense to ship data via mail rather than uploading over the Internet. You plug in the number of terabytes, devices, average file size, return shipping information and other factors, and find out how much the data transfer would cost via mail compared to standard Internet uploads.

For example, transferring data from a single device containing 2TB would require 26 hours of data loading time and cost $144.74. Uploading the same amount of data over the Internet would cost $204.80. The calculator does not show how long the Internet transfer would take.”

  [Read more...]
451 CAOS Links 2010.04.27
+0 Vote Up -0Vote Down

VMware and Salesforce.com launch VMforce. Red Hat provides Cloud Access. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
“Tracking the open source news wires, so you don’t have to.”

# VMware and Salesforce.com launched VMforce, a platform for developing and deploying Java cloud applications.

# Red Hat Cloud Access enables enterprises to use their Red Hat Enterprise Linux subscription on Amazon Web Services.

# Canonical announced Ubuntu 10.04 LTS Server Edition, Desktop Edition and ISV support.

# Novell


  [Read more...]
Piper Jaffray on the Cloud
+0 Vote Up -1Vote Down

Piper Jaffray has published a 300+ page study on the cloud computing industry based on a recent survey undertaken of 100 CIOs. Bottom line, cloud computing is expected to grow significantly over the next five years. 

    Survey respondents expect the mix of cloud computing to escalate strongly to 13.5% in five years. This equates to a five-year CAGR of 19.2%, or 23.9% when we also incorporate IDC’s forecast that total software budgets will grow 4.7% annually. In other words, software spending will grow gradually in the next five years, but the mix of spend allocated to cloud-based applications will likely surge rapidly. Another way to think about the data is that the Cloud Computing market is expected to grow five times as fast as the broader software market: 23.9% vs. 4.7%.

If anything, I think the prediction is conservative and the impact could

  [Read more...]
451 CAOS Links 2010.03.05
+0 Vote Up -0Vote Down

Elliot offers $2bn for Novell. OSI refutes IIPA’s view on open source. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
“Tracking the open source news wires, so you don’t have to.”

# Novell confirmed a $2bn purchase offer from Elliot Associates. Interesting perspectives on Elliot’s offer for Novell from Linuxquestions, Andy Updegrove, and Matt Asay.

# The OSI categorically rejected the IIPA’s special pleadings against open source.


  [Read more...]
Oracle/Sun vs. The Cloud
+5 Vote Up -1Vote Down
Larry Ellison makes it very clear that Oracle believes in a back to the future model where software and hardware meld together into “systems”, purpose-built, integrated solutions. In other words you won’t buy an Oracle database and a server and configure it to run a data warehouse, instead you’ll buy the “Oracle Data Warehouse Server.” The first such system is Exadata, which is apparently doing quite well, according to Ellison.

This is a classic bundling, although some may call it a tying strategy. Microsoft, seeing that they couldn’t win each office productivity segment individually—including word processing, spreadsheet and presentations—decided to play to their strength and bundle them into a solution that no individual company could compete with. This is bundling. The tying strategy is

  [Read more...]
Looks like Amazon is listening
+0 Vote Up -0Vote Down
Just got the following in my email this morning. I sure wish they had done this earlier. “Free Inbound Data Transfer (until June 30, 2010) Data Transfer into AWS will be free of charge from now through June 30, 2010, making it even easier for customers to get their data into AWS. This applies to [...]
Open source and the cloud - the quick and the dead
+0 Vote Up -0Vote Down

Savio Rodrigues has published a post arguing that cloud platforms such as Amazon Web Services and Microsoft’s Azure pose a threat to the monetization of open source by specialist vendors.

Savio makes a good case based on the recent launch of AWS’s Relational Database Service, based on MySQL, and Microsoft’s support for MySQL and Tomcat on Azure:

    “When Amazon decided to offer MySQL via Amazon RDS, they did so without purchasing MySQL support from Sun. I’ve confirmed that Microsoft Azure is supporting MySQL on Azure without paying Sun for a MySQL Enterprise subscription.”

Clearly there is a threat to open source vendors from cloud-based services. Meanwhile I have previous

  [Read more...]
451 CAOS Links 2009.11.06
+0 Vote Up -0Vote Down

Funambol acquires Zapatec. Open source gains Closure. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
“Tracking the open source news wires, so you don’t have to.”

For the latest on Oracle’s acquisition of MySQL via Sun, see Everything you always wanted to know about MySQL but were afraid to ask

# Funambol acquired Zapatec, an AJAX web 2.0 frameworks vendor.

# The top ten issues facing open source users, according to Mark Radcliffe.

# Google open sourced its Closure


  [Read more...]
451 CAOS Links 2009.10.30
+0 Vote Up -0Vote Down

Government adoption. Financial results. New funding. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
“Tracking the open source news wires, so you don’t have to.”

For the latest on Oracle’s acquisition of MySQL via Sun, see Everything you always wanted to know about MySQL but were afraid to ask

Government approval
The US Department of Defense issued guidance on the adoption of open source software, while ComputerWorld reported that the U.S Department of Defense has open-sourced an enterprise


  [Read more...]
Comparing Cloud Databases: SimpleDB, RDS and ScaleDB
+0 Vote Up -1Vote Down

Amazon’s SimpleDB isn’t a relational database, but it does provide elastic scalability and high-availability. Amazon’s recently announced Relational Database Services (RDS) is a relational database, but it doesn’t provide elastic scalability or high-availability. If you are deploying enterprise applications on the cloud (including Amazon Web Services), you might want to look at ScaleDB because it is a relational database and it does provide elastic scalability and high-availability.

Amazon describes SimpleDB by comparing it to a clustered database:

"A traditional, clustered relational database requires a sizable upfront capital outlay, is complex to design, and often requires extensive and repetitive database administration. Amazon SimpleDB is dramatically simpler, requiring no schema, automatically indexing your data and providing a simple API for storage and access.

  [Read more...]
Comparing Cloud Databases: SimpleDB, RDS and ScaleDB
+0 Vote Up -0Vote Down

Amazon’s SimpleDB isn’t a relational database, but it does provide elastic scalability and high-availability. Amazon’s recently announced Relational Database Services (RDS) is a relational database, but it doesn’t provide elastic scalability or high-availability. If you are deploying enterprise applications on the cloud (including Amazon Web Services), you might want to look at ScaleDB because it is a relational database and it does provide elastic scalability and high-availability.

Amazon describes SimpleDB by comparing it to a clustered database:

"A traditional, clustered relational database requires a sizable upfront capital outlay, is complex to design, and often requires extensive and repetitive database administration. Amazon SimpleDB is dramatically simpler, requiring no schema, automatically indexing your

  [Read more...]
451 CAOS Links 2009.10.27
+0 Vote Up -0Vote Down

Red Hat invests in EnterpriseDB. The White House goes open source. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
“Tracking the open source news wires, so you don’t have to.”

For the latest on Oracle’s acquisition of MySQL via Sun, see Everything you always wanted to know about MySQL but were afraid to ask

In other news…

# EnterpriseDB confirmed Red Hat investment, partnership.

# Whitehouse.gov migrated to Drupal, as well as Linux, Apache,


  [Read more...]
Three key things to know about moving MySQL into the cloud.
+4 Vote Up -0Vote Down

The question "what problems will I have when migrating to the cloud" gets asked often enough. If by cloud you mean Amazon EC2, then from a technical perspective there isn't much that changes. The biggest thing that changes is just how you pay your bill.

Having said that, there's still a few potential gotchas:

  • There are no Virtual IP addresses. Most High Availability tools (like MMM or DRBD+Heartbeat)
    work on the principal of having a floating IP address which is used for the application to connect to the current master. With EC2, you can't do this.
  • There's no customization of the memory. The maximum amount of memory you can have is 15GB, so some users with larger working sets may find this a limitation. If you look at the Dell online store, it costs $2094 to upgrade an R900

  •   [Read more...]
    As license issues swirl, a new CAOS report
    +0 Vote Up -0Vote Down

    There has been no shortage of lively discussion on open source software licenses with recent shifts in the top licenses, perspectives on the licenses or lack of them for networked, SaaS and cloud-based software, increased prominence of a Microsoft open source license and concern over the openness (or closedness, depending on your perspedtive) of the latest devices. Amid all of it, we’re pleased to present our latest long-form report, CAOS 12 - The Myth of Open Source License

      [Read more...]
    451 CAOS Links 2009.06.19
    +0 Vote Up -0Vote Down

    Red Hat betas Enterprise Virtualization, partners with HP for SOA. And more.

    Follow 451 CAOS Links live @caostheory
    “Tracking the open source news wires, so you don’t have to.”

    # Red Hat announced that its Enterprise Virtualization portfolio of products is now available for beta testing.

    # Red Hat collaborated with HP on SOA.

    # David Megginson published mixing GPL and non-GPL: a different perspective. A new take on the MySQL/MariaDB storage engine debate.

    # UK Government CIO shed some light on “G-Cloud” plans and how the new open source policy provides an opportunity.

    # WAZI: Freedom and


      [Read more...]
    Your opinion on EC2 and other cloud/hosting options
    +0 Vote Up -0Vote Down

    EC2 is nifty, but it doesn’t appear suitable for all needs, and that’s what this post is about.

    For instance, a machine can just “disappear”. You can set things up to automatically start a new instance to replace it, but if you just committed a transaction it’s likely to be lost: MySQL replication is asynchronous, EBS which is slower if you commit your transactions on it, or EBS snapshots which are only periodic (you’d have to add foo on the application end). This adds complexity, and thus the question arises whether EC2 is the best solution for systems where this is a concern.

    When pondering this, there are two important factors to consider: a database server needs cores, RAM and reasonably low-latency disk access, and application servers should be near their database server. This means you shouldn’t split app and db servers to

      [Read more...]
    451 CAOS Links 2009.06.12
    +0 Vote Up -0Vote Down

    Yahoo opens up Hadoop distribution. Microsoft and Novell claim customer wins. And more.

    Follow 451 CAOS Links live @caostheory

    The elephant in the room
    Plenty of news emerged form the Hadoop Summit this week, including Cloudera announced support for Amazon Elastic Block Storage (EBS) and introduced Sqoop, open source tool for importing databases into Hadoop, while Yahoo! Released! The! Yahoo! Distribution! Of! Hadoop! opening up its Hadoop developments to the wider community. As Savio Rodrigues noted, there has been a surge in the number of contributors for the Hadoop project in the last year.

    Best of the rest
    # Novell and Microsoft


      [Read more...]
    451 CAOS Links 2009.06.09
    +0 Vote Up -0Vote Down

    Vyatta raises series C funding. Greenplum launches data cloud initiative. Fedora 11. And more.

    Follow 451 CAOS Links live @caostheory

    # Vyatta raised $10m in series C round, led by Citrix.

    # Carlo Daffara published Horses, carriages and cars an assessment of the shifting OSS business models, and a proposal of what is the optimal model.

    # Greenplum delivered version 3.3 of its analytical database, launched its Enterprise Data Cloud initiative.

    # Daniel Abadi asked whether betting on the MySQL mass market for data warehousing a good idea.

    # Roberto Galoppini reported on open source adoption in Italian

      [Read more...]
    Previous 30 Newer Entries Showing entries 31 to 60 of 98 Next 30 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.