I'm the boards of two companies (Pentaho, Revolution Analytics) that are starting to see a lot of customer traction around Big Data. More and more companies in media, pharma, retail and finance are doing advanced analysis, reporting, graphing, etc with massive data sets. It made me wonder what other areas of the technology stack might evolve with the trend towards Big Data.  Obviously, there's new middleware layers like Hadoop and Map Reduce, and we're also seeing the emergence of NoSQL data management layers with Cassandra, MongoDB, MemBase and others.  But what …

Introduction

StackOverflow is an amazing site for coding questions. It was created by Joel Spolsky of joelonsoftware.com, Jeff Atwood of codinghorror.com, and some other incredibly smart guys who truly care about user experience. I have been a total fan of SO since it went mainstream and it's now a borderline addiction (you can see my StackOverflow badge on the right sidebar).

The Story

Update 6/21/09: This server is currently under very heavy load (10-200), even with caching plugins enabled. Please bear with me as I try to resolve the situation.

Feel free to …

It gives us great pride to announce the release of MyComponents V4.4 native Delphi/Kylix VCL suite. This update includes mainly fixes to issues as it has been reported to Support and on this and other forums.

What's new?

TMySQLDataset:
New: RemObjects' DataAbstract driver 3 and 4 API included.
Fix: Various issues as has been reported to SciBit Support

This update is free of charge for all customers whom own a 2005.4.x MyComponents serial. Everyone still using a pre-2005.4 MyComponents may upgrade to the newest version by logging into their Secure accounts: simply click the Secure link at the top of this page.

Previous articles concerning MyComponents 4.x are:
…

It gives us great pride to announce the release of MyComponents V4.3 native Delphi/Kylix VCL suite. This update includes mainly fixes to issues as it has been reported to Support and on this forum, as well as Delphi 2006 certification.

What's new?

TMySQLDataset:
New: doSingleSQL option which allows an SQL script to be executed as a single SQL statement, thereby enabling you to use the SQL property to define functions and procedures in MySQL.
Fix: Various issues as has been reported to SciBit Support

This update is free of charge for all customers whom own a 2005.4.x MyComponents serial. Everyone still using a pre-2005.4 MyComponents may upgrade to the newest version by logging into their Secure accounts: simply click the Secure link at the top of this …

It gives us great pride to announce the release of MyComponents V4.2 native Delphi/Kylix VCL suite. This update includes mainly fixes to issues as it has been reported to Support and on this forum, as well as some new functionality. Without explicitly setting the new properties, and thereby using the new features, should this version be completely compatible with your existing code.

What new?

TMySQLServer:
ptTCP/ptPipe: now sports connection capabilities which includes tcp (default), as well as using the MySQL pipe on the localhost.

TMySQLDataset:
New: Carry over support for previously set macro values
New: Added QueryInfo public method to obtain MySQL query informative result string
New: Added support for MySQL 5.0.3 FIELD_TYPE_BIT as ftBoolean
New: Added support for MySQL 5 FIELD_TYPE_DEC …

Due to popular demand, are we reposting our flying dataset MyComponents Quick Tip from almost a year back.

Many times in development, do you find yourself just quickly looking for a dataset containing something from the database. Usually will such a dataset not be connected to visual controls. TMySQLServer is capable of creating, maintaining and destroying just such dynamic "in-memory" datasets. These datasets closely resemble ADO or ASP style coding and each dataset is referenced by a userdefined name. You can even connect such datasets up master-detail. The aim is of course to minimize the number of lines you have to write and your effort in general. Here are a couple of examples:

Example 1 (Usage):
...

with TMySQLDataset(MySQLServer1.Dataset) do begin
ShareConnection := False;
TableName := 'accounts'; …

SciBit now also maintains our own libmysql.dll which supports both old and new authentication and is only 157KB in size. So if you absolutely have to use a dll (instead of the Direct driver), then you can download it from MyComponents

Unlike MySQL's newest clientlibraries, which are 1-2MB in size and is usually not versioned, does the SciBit library contain full version info, is small and works 100% with the MyComponents. NOTE: It only implements the API needed by the MyComponents, which is minimilistic, so don't go replace all your other apps' libmysql.dll with it!

It is also free, and contains 0% MySQL source code (it is written 100% in native Delphi) and therefore does not carry any licensing issues for your commercial applications.

Regards, Support

SciBit is proud to announce the availability of our newest portal: http://campus.scibit.com.

This site is open to any and all whom which to publish or present a course on any subject. Of course, we will appreciate it very much if some of your courses do address solutions and work arounds to problems you might have experienced in regards to products and/or environments in which some SciBit products function, ex. MySQL, Delphi, Kylix, ASP, etc. But, as mentioned, your courses can be on any subject you choose, and is a way for you to give back some of your acquired knowledge to the world. We have added a few categories already and any one can register as a teacher, to compile your own courses, or as a student, to signup for courses (if they are hidden from public view).

If you wish to compile private courses and do so as a commercial venture using SciBit's Secure …

This question pops up often, but the solution is not specific to MyComponents, and will work in and with any Borland dataset component (in fact, this is how you are suppose to do it in Delphi/Kylix):

TBlobField(MySQLQuery1.FieldByName('MyBlob')).LoadFromFile('MyBlobContents.doc');

the following of course also works:
TBlobField(MySQLQuery1.FieldByName('MyBlob')).SaveToFile('MyBlobContents.doc');

or you can also use the LoadFromStream and SaveToStream methods.

NOTE: If you post blobs to a table in MySQL you should keep a couple of things in mind:
1. The blob value is sent to the MySQL using a standard SQL statement. For this purpose, the value is hexed by the dataset and thus 2 SQL characters=1 blob byte.
2. Most MySQL servers' "max_allowed_packet" variable is set to a default value of less than 1Mb and a single sql statement must fit within one packet and thus within …