Showing entries 25033 to 25042 of 44119
« 10 Newer Entries | 10 Older Entries »
PBMS backup and S3 storage

Hi,

So I had to make some changes to the way that backup worked with PBMS in order that it would behave as expected when the BLOB data is stored remotely on an S3 server.

I will go over how the PBMS repository is backed up first and then explain how it works with S3 storage.

PBMS provides a pbms_backup table in its 'pbms' database that records all the backups that have been performed on any of the PBMS repositories on the server. The create statement for this table looks like this:

CREATE TABLE pbms.pbms_backup (
id INT NOT NULL AUTO_INCREMENT,
Database_Name VARCHAR(64) NOT NULL,
Started TIMESTAMP,
Completed TIMESTAMP,
IsRunning BOOL,
IsDump BOOL,
Location VARCHAR(1024),
Cloud_Ref INT,
Cloud_backup_no INT,
PRIMARY KEY (id)
)

There are 2 ways to backup a PBMS repository:

[Read more]
Amazon RDS, MySQL, Hmm?

When a name like Amazon gets into the business, everyone acts like everything is new and shiny again :)

Why, I can remember like it was, well... almost a decade ago when I first saw a hosting vendor get into the business of support MySQL databases.

The first vendor I remember? Rackspace. Why? Because way back when, they were the main sponsor for the second OpenSource Database Conference.

Looking through the options that Amazon provides, they do look pretty sharp. Database backups can be a pain, and providing snapshot based ones is an excellent idea. There was some talk of snapshotting when I was at the MySQL User Group this week talking about Drizze. The general consensus was that this was the …

[Read more]
Air traffic queries in MyISAM and Tokutek (TokuDB)

This is next post in series
Analyzing air traffic performance with InfoBright and MonetDB
Air traffic queries in LucidDB
Air traffic queries in InfiniDB: early alpha

Let me explain the reason of choosing these engines. After initial three posts I am often asked "What is baseline ? Can we compare results with standard MySQL engines ?". So there come MyISAM to consider it as base point to see how column-oriented-analytic engines are better here.

However, take into account, that for MyISAM we need to choose proper indexes to execute queries …

[Read more]
Back from Hiatus - Summary Update 2

Back from Hiatus - Summary Update 1

GoodDataGoodData has launched and they are providing a cloud based analytics platform for use in integration with online apps.  Starting with some initial focus on SalesForce data, but working hard on expanding the list of ISV’s who choose to provide their customers analytics via GoodData.

GoodData was started by “good guy” Czech serial entrepreneur Roman Stanek (NetBeans) and has just raised funds from Andressen Horowitz and appointed Time O’Reilly to the board.  GoodData is interesting because it is simple, accessible and available on demand.  Still early days but think Roman is on to another winner here.  Certainly …

[Read more]
OQGRAPH session on MySQL University – recording now available

It was fun doing the MySQL University session on OQGRAPH yesterday. Now also available: slides (PDF) and audio/video recording (FLV download, if anyone can convert to a more open format, that’d be great).

New developers training course is almost ready

We've been busy expanding our training curriculum to include training for developers building applications with MySQL.  We have reached the point where we're ready for a pilot teach - and it brings me great pleasure to announce that we're opening it up for blog readers to attend, free of charge.

The details:
San Francisco
4th December
9:30AM - 5PM

Spaces are limited, so to give everyone a fair chance we're delaying registration to open at noon tomorrow (Friday) Pacific Time. It's strictly first in first served, so be quick!  The registration link is here.

Entry posted by Morgan Tocker | One comment

Add to: …

[Read more]
PBMS Cloud storage is back!

Hi,

Support for S3 BLOB storage has now been fully integrated into the PBMS engine. It works in much the same way that I mentioned in an earlier post but with some important changes so I will explain it all again here.

When using S3 BLOB storage with PBMS the BLOB reference tracking and metadata is handled the same as before in that they are stored in the BLOB record in the repository, but the actual BLOB is stored on an S3 server.

To setup S3 storage you need to add an S3 cloud reference record to the pbms.pbms_cloud table provided by PBMS. For example:

INSERT INTO pbms.pbms_cloud(ID, Server, bucket, PublicKey, PrivateKey) VALUES(16, "S3.amazonaws.com", "PBMS-Test", "abc123", "amjr15vWq");

Then you need to tell PBMS which database should use S3 cloud storage for its BLOBs. This is done by updating a couple of records in the pbms_variable table that PBMS provides for each …

[Read more]
The Danger of blocking the Oracle/Sun deal

Image via Wikipedia

FYI - the thoughts here have been gathered from conversations with several individuals, including an interesting conversation yesterday.  As these conversations were off the record I won’t name names here but thanks to those people.

I love open source software and I am a big supporter of many companies that produce open source offerings.  Here I am not going to debate if Oracle acquiring MySQL will be better for MySQL or not as that has been done to death.  But I do think it is relevant to discuss the dangers of blocking a commercial vendor from acquiring a potentially competitive open source vendor.

Many open source software initiatives are purely community backed and are …

[Read more]
The impact from InnoDB readahead

InnoDB uses background threads to handle readahead (prefetch) requests. Requests are generated when it detects sequential or random access to most blocks in an extent. This is described in the 5.0 MySQL manual with new behavior in the plugin.

The Facebook MySQL patch has new my.cnf variables to disable readahead: innodb_readahead_random and innodb_readahead_sequential. I don't know whether readahead is useful for my workload. This is hard to determine because SHOW STATUS counters for InnoDB readahead display the number of times the readahead generation functions are called rather than the number of readahead requests issued (fixed in the Facebook patch, fix …

[Read more]
Aspects and benefits of distributed version control systems (DVCS)

This blog post is a by-product of my preparation work for an upcoming talk titled "Why you should be using a distributed version control system (DVCS) for your project" at SAPO Codebits in Lisbon (December 3-5, 2009). Publishing these thoughts prior to the conference serves two purposes: getting some peer review on my findings and acting as a teaser for the actual talk. So please let me know — did I cover the relevant aspects or did I miss anything? What's your take on DVCS vs. the centralized approach? Why do you prefer one over the other? I'm looking forward to your comments!

Even though there are several distributed alternatives available for some years now (with Bazaar, git and …

[Read more]
Showing entries 25033 to 25042 of 44119
« 10 Newer Entries | 10 Older Entries »