Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 30 of 37 Next 7 Older Entries

Displaying posts with tag: s3 (reset)

Shard-Query loader gets a facelift and now Amazon S3 support too
+0 Vote Up -0Vote Down

Shard-Query (source) now supports the MySQL “LOAD DATA INFILE” command.

When you use LOAD DATA LOCAL INFILE a single threaded load from the current process will be performed.  You can specify a path to a file anywhere readable by the PHP script.  This allows loading without using the Gearman workers and without using a shared filesystem.

If you do not specify LOCAL, then the Gearman based loader is used.  You must not specify a path to the file when you omit the LOCAL keyword.  This is because the shared path will the pre-pended to the filename automatically.  The shared path must be a shared or network filesystem (NFS,CIFS,etc) and the files to be loaded must be placed on the shared filesystem for the Gearman

  [Read more...]
OblakSoft Cloud Storage Engine Newsletter, June 2013
+0 Vote Up -0Vote Down

ClouSE 1.0b.1.8 is released

OblakSoft is pleased to announce the release of ClouSE Beta version 1.0b.1.8.  This is a minor maintenance release that addresses a couple pain points, while we’re working on a release candidate that will bring the built-in point-in-time recovery and other major features.

Here is the summary of changes:

  • Improved caching for Weblobs

Now ClouSE sets the cache control headers for Weblobs.  The cache control headers specify the max-age directive that allows caching content for one year.  This makes proxies and content delivery networks (CDN) more efficient.  The change resolves this support issue.

  • Improved error handling on startup

Now database requests


  [Read more...]
MySQL on Cloud Storage: ClouSE upgrade made easy
+0 Vote Up -0Vote Down

Updating ClouSE can now be done with one command

With more than a thousand registered users worldwide, guiding customers through the upgrade process is getting hard, so we decided to automate the servicing steps.  Now the update-clouse script can be used to update ClouSE binaries to the current version.  This script ships with the ClouSE binary distribution.

Here is an example of updating ClouSE using the Webmin console.

First, download ClouSE 64-bit binaries from http://www.oblaksoft.com/downloads/.  Then upload and extract the binaries to the /home/ec2-user directory. In


  [Read more...]
MySQL on Cloud Storage: do it yourself with one command
+1 Vote Up -0Vote Down

Cloud Storage Engine (ClouSE) installation and configuration is now fully automated. Try new ClouSE installer and you’ll have cloud storage access configured in no time.

OblakSoft is pleased to announce the release of Cloud Storage Engine (ClouSE) installer that can be used to deploy and configure ClouSE with your MySQL server. Now ClouSE can be deployed with just one command. The installer will guide the user through the configuration process, prompt for Cloud Storage connection parameters, and install ClouSE into MySQL.

Presented is a step-by-step guide for ClouSE installation and configuration, from downloading the binaries to running the installer. The guide was designed by request of WordPress-to-Cloud users, however it is fully applicable to any generic ClouSE installation.

The slides have notes, they are a little hard to discover with the

  [Read more...]
OblakSoft Cloud Storage Engine Newsletter, March 2013
+2 Vote Up -0Vote Down

ClouSE 1.0b.1.7 is released

OblakSoft is pleased to announce the release of Cloud Storage Engine (ClouSE) for MySQL Beta version 1.0b.1.7.  In this release we added support for a variety of environments to address the platform diversity of our growing customer base.

Here is the summary of changes that are included into 1.0b.1.7:

  • Support for ClouSE on Microsoft Windows (limited preview)

Now ClouSE builds are available both for Linux and Microsoft Windows.  The cloud data format is the same across all platforms: Linux and Windows, 32-bit and 64-bit.  This allows for seamless transitions between machines, platforms and clouds.  ClouSE for Windows is currently available to a group of limited preview customers.  If you would like to sign up for the limited preview program please


  [Read more...]
OblakSoft Cloud Storage Engine Newsletter, December 2012
+2 Vote Up -0Vote Down

ClouSE version 1.0b.1.6 is released

OblakSoft is pleased to announce the release of ClouSE version 1.0b.1.6.  In this release we fixed some of the known ClouSE Beta limitations as well as performance and functional bugs reported by our users.

Here is the summary of changes that are included into 1.0b.1.6:

  • Support for latest MySQL 5.5

Now ClouSE supports MySQL thru 5.5.29.  To keep the distribution small, we don’t build binaries for MySQL prior to 5.5.19 anymore.  If you need one, please contact us.

  • DECIMAL keys support

Now ClouSE supports using DECIMAL fields in keys.  Previously neither the primary key nor indices could include DECIMAL fields.  This fixes the following Beta limitation: DECIMAL fields cannot be


  [Read more...]
OblakSoft Cloud Storage Engine Newsletter, October 2012
+2 Vote Up -0Vote Down

MySQL on Amazon S3: ClouSE version 1.0b.1.4 is released

OblakSoft is pleased to announce the release of ClouSE version 1.0b.1.4.  In this release we fixed some of the known ClouSE Beta limitations that required workarounds in some configurations.

In particular, now the popular BuddyPress WordPress plugin can store its tables in ClouSE without a patch that worked around the missing features.  If you’re using the patched version of BuddyPress 1.6.1 provided by us, you can now upgrade ClouSE and use the original BuddyPress sources.  Thank you for your patience and commitment!

Here is the summary of changes:

  • Support for latest MySQL 5.5

Now ClouSE supports MySQL thru 5.5.28.  To keep the distribution small, we don’t build binaries for MySQL prior to


  [Read more...]
MySQL BLOB meets Amazon S3: advanced Weblob features
+1 Vote Up -0Vote Down

Advanced Weblob operations help to use Weblobs most effectively.

Weblob recap

In an earlier post I introduced Weblobs.  Weblob is a new data type that is supported by the Cloud Storage Engine for MySQL (ClouSE).  To a database developer, a WEBLOB behaves (almost) like a regular BLOB.  However, in addition to the regular BLOB functionality, Weblobs can be downloaded directly from Amazon S3 by HTTP URLs.

In MySQL, a Weblob is expressed via a pair of BLOB fields that have a special naming convention: field_name$wblob and field_name$wblob_info.  The latter field is what provides the Weblob functionality.  It can be used to retrieve the direct Amazon S3 URL for the BLOB

  [Read more...]
MySQL with ClouSE is the first Secure Database in the Cloud
+1 Vote Up -0Vote Down

Want to learn how you can store your sensitive data in the cloud storage? Take a look at the thorough and honest security analysis of the approach you can take to deploy your existing MySQL workloads to cloud.

keep reading in August issue of Hackin9 security magazine.

MySQL on S3: performance with storage located across the continent
+2 Vote Up -0Vote Down

Can OLTP database workloads use Amazon S3 as primary storage? Now they can, thanks to the Cloud Storage Engine (ClouSE), but the question is: how fast?


To answer the question about performance, we decided to run db_STRESS benchmark on a MySQL database in Amazon EC2.  We compared 3 configurations:

  • “Across the street storage”: ClouSE with data stored in S3 in the same region (US Standard)
  • “Across

  [Read more...]
OblakSoft Cloud Storage Engine Newsletter, June 2012
+1 Vote Up -0Vote Down

ClouSE version 1.0b.1.2 and WordPress on S3 / Yapixx refresh is released

OblakSoft is pleased to announce the release of ClouSE version 1.0b.1.2 and WordPress on S3 / Yapixx refresh.

This release addresses performances and usability issues reported by our early adopters.  Thank you all for your feedback.

  • Support for MySQL 5.5.25

Now ClouSE supports MySQL thru 5.5.25.  To keep the distribution small, we don’t build binaries for MySQL prior to 5.5.14 anymore.  If you need one, please contact us.

  • Weblob content type improvement

Now the content type for Weblobs is set based on their name.  Previously, the content type for all Weblobs was set to application/octet-stream, which could lead to undesirable Web Browser

  [Read more...]
MySQL BLOB meets Amazon S3: Weblobs explained
+2 Vote Up -0Vote Down

Cloud-powered BLOB type provides ACID guarantees and fast direct access to blobs via Web URLs.

Storing unstructured data

Typically unstructured data (such as pictures, media files, documents)

a) Is either stored on the file system, unlike the related with it relational data which is stored in the database. This is well known, “convenient” practice that allows fast access to files but offers no transactional story and no unified data management (for db and filesystem)

b) Or is stored in BLOBs. This ensures transactional consistency and reduces management complexities, but is really bad for performance and scalability.

We took advantage of the cloud, and came up with an upgrade to the BLOB – a solution that combines the benefits of the two.

Weblob data type

Weblob is a new data type that is


  [Read more...]
WordPress on S3: run it anywhere
+2 Vote Up -1Vote Down

Where to host a dynamic website that stores all its content on Amazon S3? Anywhere you choose to.

OblakSoft is pleased to announce availability of an OVF Virtual Appliance with ready-to-run WordPress on S3: Yapixx.  Now WordPress on S3 can run anywhere, not just in Amazon EC2.

Any web server

The virtual appliance is distributed in the Open Virtualization Format that is supported by most major hypervisor software vendors (such as VMware, VirtualBox, Oracle VM, etc.).  The virtual appliance (one-file OVA package) contains the same software components as the corresponding Yapixx Amazon Machine Image (AMI).

The Yapixx VM has the

  [Read more...]
WordPress on S3: no more backups
+2 Vote Up -1Vote Down

WordPress on S3: no more backups

How much trouble will it be if your webserver failed?  No trouble at all, if your website keeps its content on reliable Amazon S3 storage.

There are a lot of nuances in ensuring proper backups and restores of websites. When was the last backup taken? How much data might have been lost? How long will it take to recover it? When was the last time you tested restore? Do you even have an offsite backup?

Now that you can run dynamic websites off Amazon S3 storage, we’ll demonstrate why you no longer need to worry about backing up and restoring your website data. Losing the webserver is no longer a disaster. Cloud storage offers almost unsurpassable reliability a lot of website owners (small & large) would benefit from. In a way you get an

  [Read more...]
WordPress on S3: the beauty of simplicity
+2 Vote Up -1Vote Down

My first computer program was written almost quarter a century ago on a BK-0010 computer.  It was very simple: the program asked the user to enter their name and then greeted the user using the entered name, like “Hello, Artem!”.  I was fascinated.  A couple of lines written in Vilnius BASIC transformed a piece of metal and silicon into a considerate thing that cared about a person’s name enough to remember it :-).  Of course, the first experience doesn’t represent the day-to-day routine of software development, but the moments when I see a couple of lines making an amazing transformation still enchant me, and remind me why I’ve been writing code all this time.

I’ve just experienced this very same first-time feeling as we’ve released

  [Read more...]
“WordPress on Amazon S3″, OblakSoft Cloud Storage Newsletter, May 2012
+2 Vote Up -0Vote Down

WordPress on S3: run a beautiful website on Amazon S3 cloud storage

OblakSoft is proud to introduce the 1st ever dynamic WordPress site running on top of Amazon S3: Yapixx.  Now you too can launch your own beautiful website on Amazon S3.

While Yapixx stands for Yet Another Picture Sharing Site, it is actually one of a kind.  Yapixx is WordPress that was moved to run on top of Amazon S3 storage without changing a line of code in the WordPress core engine.

  [Read more...]
WordPress on S3: how it works
+2 Vote Up -0Vote Down

OblakSoft is pleased to showcase how simple it is to run LAMP applications on the cloud storage.  OblakSoft configured the WordPress web publishing platform to run on Amazon S3 storage and made the recipe available for anyone to replicate.  A ready-to-run WordPress site (configured as Yapixx) – is available for public use for FREE.  Yapixx is WordPress configured as a picture sharing website that runs on top of Amazon S3 (Yapixx stands for Yet Another Picture Sharing Site).

 

  [Read more...]
PBMS Version 2 released
+1 Vote Up -0Vote Down
Version 2 of the PBMS daemon is now ready.

Here are the major changes introduced with this version:
  • PBMS is fully integrated with MySQL 5.5:
    PBMS is now provided as a patch for MySQL 5.5 which simplifies installation and provides numerous benefits.

    • All engines are "PBMS enabled":
      PBMS no longer requires that you have a "PBMS enabled" storage engine to be able to use PBMS.

    • The MySQL client lib provides the PBMS client API:
      You no longer need to link your application to a separate PBMS lib to use the PBMS 'C' API.

    • mysqldump understands PBMS BLOB URLS:
      When dumping tables or databases containing PBMS BLOB URLs mysqldump will dump the referenced BLOBs as binary data to a separate file. Since the BLOBs are dumped to their own file there is no need to












  [Read more...]
Nginx-Fu: X-Accel-Redirect From Remote Servers
+0 Vote Up -0Vote Down

We use nginx and its features a lot in Scribd. Many times in the last year we needed some pretty interesting, but not supported feature – we wanted nginx X-Accel-Redirect functionality to work with remote URLs. Out of the box nginx supports this functionality for local URIs only. In this short post I want to explain how did we make nginx serve remote content via X-Accel-Redirect.

First of all, here is why you may need this feature. Let’s imagine you have a file storage on Amazon S3 where you store tons of content. And you have an application where you have some content downloading functionality that you want to be available for logged-in/paying/premium users and/or you want to keep track of downloads your

  [Read more...]
PBMS Cloud storage is back!
+1 Vote Up -0Vote Down
Hi,

Support for S3 BLOB storage has now been fully integrated into the PBMS engine. It works in much the same way that I mentioned in an earlier post but with some important changes so I will explain it all again here.

When using S3 BLOB storage with PBMS the BLOB reference tracking and metadata is handled the same as before in that they are stored in the BLOB record in the repository, but the actual BLOB is stored on an S3 server.

To setup S3 storage you need to add an S3 cloud reference record to the pbms.pbms_cloud table provided by PBMS. For example:

INSERT INTO pbms.pbms_cloud(ID, Server, bucket, PublicKey, PrivateKey) VALUES(16, "S3.amazonaws.com", "PBMS-Test", "abc123", "amjr15vWq");

Then you need to tell PBMS which database should use S3 cloud storage for its BLOBs. This is done by updating a couple of records in the









  [Read more...]
Your opinion on EC2 and other cloud/hosting options
+0 Vote Up -0Vote Down

EC2 is nifty, but it doesn’t appear suitable for all needs, and that’s what this post is about.

For instance, a machine can just “disappear”. You can set things up to automatically start a new instance to replace it, but if you just committed a transaction it’s likely to be lost: MySQL replication is asynchronous, EBS which is slower if you commit your transactions on it, or EBS snapshots which are only periodic (you’d have to add foo on the application end). This adds complexity, and thus the question arises whether EC2 is the best solution for systems where this is a concern.

When pondering this, there are two important factors to consider: a database server needs cores, RAM and reasonably low-latency disk access, and application servers should be near their database server. This means you shouldn’t split app and db servers to

  [Read more...]
Sun talks out Cloud: Open Cloud Platform
Employee +0 Vote Up -0Vote Down

Sun's Open Cloud Vision unveilled: Open Cloud Platform, an open infrastructure powered by Java, MySQL, OpenSolaris, and Open Storage software technologies.  Open APIs, Open formats and Open source.

On March 18th, at CommunityONE aka CloudONE, Sun unveiled the open cloud platform for powering public and private clouds. We also  announced that we are building our own Public Cloud. This will include a Storage and Compute Cloud. Our Cloud will be compatible with Amazon S3 and EC2 at the API level. Meaning, we will provide S3 and EC2 compatibility APIs in addition to our own, hence enabling an easy migration from Amazon services to Sun Cloud. All clouds - public, private or hybrid, built on Sun's Open Cloud

  [Read more...]
Sun talks out Cloud: Open Cloud Platform
Employee +0 Vote Up -0Vote Down

Sun's Open Cloud Vision unveilled: Open Cloud Platform, an open infrastructure powered by Java, MySQL, OpenSolaris, and Open Storage software technologies.  Open APIs, Open formats and Open source.

On March 18th, at CommunityONE aka CloudONE, Sun unveiled the open cloud platform for powering public and private clouds. We also  announced that we are building our own Public Cloud. This will include a Storage and Compute Cloud. Our Cloud will be compatible with Amazon S3 and EC2 at the API level. Meaning, we will provide S3 and EC2 compatibility APIs in addition to our own, hence enabling an easy migration from Amazon services to Sun Cloud. All clouds - public, private or hybrid, built on Sun's Open

  [Read more...]
Sun talks out Cloud: Open Cloud Platform
Employee +0 Vote Up -0Vote Down

Sun's Open Cloud Vision unveilled: Open Cloud Platform, an open infrastructure powered by Java, MySQL, OpenSolaris, and Open Storage software technologies.  Open APIs, Open formats and Open source.

On March 18th, at CommunityONE aka CloudONE, Sun unveiled the open cloud platform for powering public and private clouds. We also  announced that we are building our own Public Cloud. This will include a Storage and Compute Cloud. Our Cloud will be compatible with Amazon S3 and EC2 at the API level. Meaning, we will provide S3 and EC2 compatibility APIs in addition to our own, hence enabling an easy migration from Amazon services to Sun Cloud. All clouds - public, private or hybrid, built on Sun's

  [Read more...]
I’m *not* speaking at Cloud Computing Expo 2008
+0 Vote Up -0Vote Down

Just a quick update, I was invited to speak at Sys-Con’s Cloud Computing Expo 2008 West (how’s that for a mouthful?) and accepted, planning on talking about SkyNet, S3, and our future use of cloud computing. Alas, my Inbox is so crazy, I failed to see the handful of emails the conference sent me asking me to sign a contract of some type. So I missed the deadline and they canceled my spot. (BTW, I can’t recall a conference ever asking me to sign something to speak, but this one does and I was full of FAIL.)

So, I’m sorry, despite being listed on the program, I’m *not* speaking there this week. It was my bad – I just missed the

  [Read more...]
Thoughts on the Cloud
+0 Vote Up -0Vote Down

For those of you who have been under a rock for the last several years, there is a buzz-phrase floating around—cloud computing. If you haven’t been paying attention, it is time to wake up.

While I could spend an entire blog post—if not several—on a definition of cloud computing, I will be talking only about cloud computing in the sense of companies moving servers from their building or network operations center to running virtual servers in this computing cloud.

While there are a number of companies providing virtual servers, the most visible is Amazon, with their Amazon Web Services (AWS). I will be talking about AWS in this post as it is the service with which I am most familiar. It seems like every month, AWS rolls out new options and services. Just recently Amazon announced that you can now run on AWS the Windows operating system along with

  [Read more...]
ZFS with Cloud Storage or Faraway Storage
Employee +0 Vote Up -0Vote Down

Recently I am been testing few pieces of Storage projects of OpenSolaris with PostgreSQL. One of tests involves using an iSCSI disk  with PostgreSQL.  Unfortunately the storage that's available is  in Colorado  while my PostgreSQL server is  located in Massachusetts. Latency will definitely be one of my top problems since storage  is halfway across the country (in Colorado). Plus the fact that I will be running a database server on my end  doesn't really sound like a good idea. Come to think about it, this could be a more common problem nowadays since Cloud Storage (for example Amazon S3 Webservice ) could be  optimistically  half way across the country and pessimistically be on the other side of the world.

 So what are my options to solve such


  [Read more...]
S3 suffers major outage
+0 Vote Up -0Vote Down
“Funny how Amazon doesn't use S3 to store any assets for amazon.com”tweet by @gruber

Amazon's S3 suffered a major outage today knocking many websites offline. S3 outage started at approximately 12:00 PM EST and the last time I checked at 11:11PM EST, Smugmug, a popular photo hosting site that extensively uses S3, was still down.

- S3 down for more than 7 hours
- S3 outage, 7 hours and counting
- S3 down again
- Amazon failure downs Web 2.0 sites
-







  [Read more...]
Your data and the cloud
+0 Vote Up -0Vote Down

I will be speaking on July 29th in New York at an Entrepreneurs Forum on A Free Panel on Cloud Computing. With a number of experts including Hank Williams of KloudShare, Mike Nolet of AppNexus, and Hans Zaunere of New York PHP fame is should be a great event.

The focus of my presentation will be on “Extending existing applications to leverage the cloud” where I will be discussing both the advantages of the cloud, and the complexities and issues that you will encounter such as data management, data consistency, loss of control, security and latency for example.

Using traditional MySQL based applications I’ll be providing an approach that can lead to your application gaining greater power of cloud computing.


About the Author

  [Read more...]
Talking with Zmanda's CEO, Chander Kant
+0 Vote Up -0Vote Down
At the Red Hat Summit I was able to grab sometime with Chander Kant, CEO of open source back-up provider, Zmanda.

I had previously met Chander at the MySQL conference where they were named a partner of the year, but we didn't get a chance to talk much.  It was pretty cool to hear about how he originally identified the opportunity for Zmanda and then built a business around it.

My interview with Chander (13:27)  Listen (


  [Read more...]
Showing entries 1 to 30 of 37 Next 7 Older Entries

Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.