Planet MySQL

[MySQL][Spider][VP]Spider-3.0 VP-0.18 released

+4

-0

posted by Kentoku SHIBA on Sun 17 Feb 2013 19:18 UTC
Tags:

(edit) mysql, spider, VP, handlersocket

I'm pleased to announce the release of Spider storage engine version 3.0(beta) and Vertical Partitioning storage engine version 0.18(beta).
Thank you for waiting such a long time! This release includes my 1 year development.
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql

Please use the following for downloading binary file.
http://spiderformysql.com/download_spider.html

The main changes in this version are following.
Spider
- Support link to oracle tables.
Connection from Spider to Oracle is now available by using table parameter

[Read more...]

[MySQL][Spider][VP]Spider-2.28 VP-0.17 released

+2

-0

posted by Kentoku SHIBA on Thu 09 Feb 2012 16:43 UTC
Tags:

(edit) mysql, spider, VP

I'm pleased to announce the release of Spider storage engine version 2.28(beta) and Vertical Partitioning storage engine version 0.17(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql

Please use the following for downloading binary file.
http://spiderformysql.com/download_spider.html

The main changes in this version are following.
Spider
- Support parallel searching. ("spider_bgs_mode > 0")
The table using the Spider bundled MySQL and table partitioning performs parallel search of each partition. However,

[Read more...]

[MySQL][Spider][VP]Spider-2.27 VP-0.16 released

+1

-0

posted by Kentoku SHIBA on Wed 19 Oct 2011 13:35 UTC
Tags:

(edit) mysql, Q4M, spider, VP, handlersocket

I'm pleased to announce the release of Spider storage engine version 2.27(beta) and Vertical Partitioning storage engine version 0.16(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql

Please use the following for downloading binary file.
http://spiderformysql.com/download_spider.html

The main changes in this version are following.
Q4M is bundled for Linux 64bit.
Bundled Q4M supports replication, but please use it carefully.

Spider
- Support R-Tree index.
- Support direct updating for SQL

[Read more...]

[MySQL][Spider][VP][Other]Spider-2.24 VP-0.13 released

+1

-0

posted by Kentoku SHIBA on Sat 12 Feb 2011 18:34 UTC
Tags:

(edit) mysql, spider, VP

I'm pleased to announce the release of Spider storage engine version 2.24(beta) and Vertical Partitioning storage engine version 0.13(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql

The main changes in this version are following.
Spider
- MySQL 5.5 support.
- handlersocket support.
  You can use handlersocket through Spider table that called by handlersocket. It means handlersocket can access to sharded databases. Currently, handlersocket support only Linux.
  Set "spider_use_hs_read=1" and "spider_use_hs_write=1" for activating this feature.
  Added

[Read more...]

[MySQL][Spider][VP]Spider-2.23 VP-0.12 released

+4

-0

posted by Kentoku SHIBA on Sat 16 Oct 2010 17:02 UTC
Tags:

(edit) mysql, spider, VP

I'm pleased to announce the release of Spider storage engine version 2.23(beta) and Vertical Partitioning storage engine version 0.12(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql

The main changes in this version are following.
Spider
- Add server parameter "spider_udf_ct_bulk_insert_interval" and "spider_udf_ct_bulk_insert_rows".

Vertical Partitioning
This release is bug fix release.

Please see "99_change_logs.txt" in the download documents for checking other changes.

Thanks to Gen, Yoshihiko, Satoko and Makoto for testing for clustering and online schema changing.
Thanks to Frederic for bug report.

Enjoy!

[MySQL][Spider][VP][Other]Spider-2.22 VP-0.11 BKA-for-ha_partition-0.3 released

+0

-0

posted by Kentoku SHIBA on Mon 30 Aug 2010 16:35 UTC
Tags:

(edit) mysql, Other, spider, VP

I'm pleased to announce the release of Spider storage engine version 2.22(beta), Vertical Partitioning storage engine version 0.11(beta) and BKA-for-ha_partition version 0.3.
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql
BKA-for-ha_partition is a patch file of supporting "Batched Key Access" for table partitioning feature.
http://launchpad.net/partitionmrrformysql

The main changes in this version are following.
Spider
- MS Windows support.
- Add UDF "spider_copy_tables".
Spider HA feature is now available!

[Read more...]

[MySQL][Spider]Spider-2.21 released

+1

-0

posted by Kentoku SHIBA on Sat 26 Jun 2010 17:19 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.21(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Add table parameter "bka_mode" and "bka_engine".
- Add server parameter "spider_bka_mode" and "spider_bka_engine".
This parameters are for improvement performance for using BKA and using a lot of conditions with IN clause and so on.

"mysql-5.1.44.slave-trx-retry.diff" is included in the source tar ball from this release.
mysql-5.1.44.slave-trx-retry.diff adds a option "slave_transaction_retry_errors". This parameter is used like "slave_transaction_retry_errors=1158,1159,2013,12701". Slave sql thread retries the transaction if slave sql thread encounters the errors at this parameter. Number of retries are at

[Read more...]

[MySQL][Spider][VP][Other]Spider-2.20 VP-0.10 BKA-for-ha_partition-0.2 released

+0

-0

posted by Kentoku SHIBA on Mon 17 May 2010 15:38 UTC
Tags:

(edit) mysql, Other, spider, VP

I'm pleased to announce the release of Spider storage engine version 2.20(beta), Vertical Partitioning storage engine version 0.10(beta) and BKA-for-ha_partition version 0.2.
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql
BKA-for-ha_partition is a patch file of supporting "Batched Key Access" for table partitioning feature.
http://launchpad.net/partitionmrrformysql

The main changes in this version are following.
Spider
- "spider_multi_split_read" supports dividing condition count.
From this release, there is "install_spider.sql"

[Read more...]

[MySQL][Spider]Spider-2.19 released

+0

-0

posted by Kentoku SHIBA on Mon 03 May 2010 16:36 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.19(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Support "Batched Key Access".
This feature is now available on MariaDB 5.3 with "join_cache_level=6 and more".

Please see "99_change_logs.txt" in the download documents for checking other changes.

Enjoy!

[MySQL][Spider]Spider-2.18 released

+0

-0

posted by Kentoku SHIBA on Thu 29 Apr 2010 07:28 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.18(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
This release is bug fix release.

Please see "99_change_logs.txt" in the download documents for more detail.

Enjoy!

Not Only NoSQL!! Uber Scaling-Out with SPIDER storage engine

+5

-0

posted by Mikiya Okuno of team blog MySQL Support Team on Tue 30 Mar 2010 09:58 UTC
Tags:

(edit) mysql, sharding, twitter, spider

The history tells that a single RDBMS node cannot handle tons of traffics on web system which come from all over the world, no matter how the database is tuned. MySQL has implemented a master/slave style replication built-in for long time, and it has enabled web applications to handle traffics using a scale-out strategy. Having many slaves has been suitable for web sites where most of traffics are reads. Thus, MySQL's master/slave replication has been used on many web sites, and is being used still.

However, when a site grow large, amount of traffic may exceed the replication's capacity. In such a case, people may use memcached. It's an in-memory, very fast and well-known KVS, key value store, and its read throughput is far better than MySQL. It's been used as a cache for web applications to store 'hot' data with MySQL as a back-end storage, as it can reduce

[Read more...]

[MySQL][Spider]Spider-2.17 released

+0

-0

posted by Kentoku SHIBA on Fri 26 Mar 2010 20:54 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.17(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Add table parameter "semi_split_read_limit".
- Add server parameter "spider_semi_split_read_limit".
This parameters are for searching performance improvement.

Please see "99_change_logs.txt" in the download documents for checking other changes.

Enjoy!

[MySQL][Spider][VP]Spider-2.16 Vartical Partitioning-0.9 released

+0

-0

posted by Kentoku SHIBA on Sun 14 Mar 2010 19:04 UTC
Tags:

(edit) mysql, spider, VP

I'm pleased to announce the release of Spider storage engine version 2.16(beta) and Vertical Partitioning storage engine version 0.9(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql

The main changes in this version are following.
(This release for Vertical Partitioning is a bug fix release)
- Add table parameter "semi_split_read".
- Add server parameter "spider_semi_split_read".
This parameters are for searching performance improvement.

Please see "99_change_logs.txt" in the download documents for checking other changes.

Enjoy!

[MySQL][Spider]Spider-2.15 released

+3

-0

posted by Kentoku SHIBA on Sun 07 Mar 2010 18:30 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.15(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
This release is bug fix release.

Please see "99_change_logs.txt" in the download documents for more detail.

Enjoy!

[MySQL][Spider]Spider-2.14 released

+2

-0

posted by Kentoku SHIBA on Mon 01 Mar 2010 19:00 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.14(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Add table parameter "bulk_update_mode" and "bulk_update_size".
- Add server parameter "spider_bulk_update_mode" and "spider_bulk_update_size".
This parameters are for performance improvement.
Please examine to use "spider_direct_dup_insert", if "REPLACE" and "INSERT IGNORE" are slow.
Please examine to use "spider_bulk_update_mode", if "UPDATE" and "DELETE" are slow.

Please see "99_change_logs.txt" in the download documents for checking other changes.

Enjoy!

[MySQL][Spider]Spider-2.13 released

+1

-0

posted by Kentoku SHIBA on Sun 21 Feb 2010 06:41 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.13(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
This release is bug fix release.

Please see "99_change_logs.txt" in the download documents for more detail.
Thanks to Mitsuhiro for bug report.

Enjoy!

[MySQL][Spider]Spider-2.12 released

+0

-0

posted by Kentoku SHIBA on Thu 21 Jan 2010 18:22 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.12(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
MariaDB support.
- Add server parameter "spider_connect_mutex", "spider_connect_retry_count" and "spider_connect_retry_interval".
This parameters are used for avoiding failed connected processing caused by intense connected processing. (Especially for using "spider_conn_recycle_mode=0")

Please see "99_change_logs.txt" in the download documents for checking other changes.
Thanks to Mohammad and Jay for bug report.

Enjoy!

[MySQL][Spider]Spider-2.11 released

+2

-0

posted by Kentoku SHIBA on Sun 27 Dec 2009 16:48 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.11(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Add table link background monitoring feature.
- Add table parameter "monitoring_bg_interval" and "monitoring_bg_kind".

Please see "99_change_logs.txt" in the download documents for checking other changes.

Enjoy!

[MySQL][Spider]Spider-2.10 released

+1

-0

posted by Kentoku SHIBA on Mon 14 Dec 2009 17:14 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.10(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Add table parameter "ssl_ca", "ssl_capath", "ssl_cert", "ssl_cipher", "ssl_key", "ssl_verify_server_cert", "default_file" and "default_group".
- Add UDF parameter "ssl_ca", "ssl_capath", "ssl_cert", "ssl_cipher", "ssl_key", "ssl_verify_server_cert", "default_file" and "default_group".
You can use ssl for Spider's communication to remote servers.
Spider can read config file(my.cnf) at connecting to remote servers.

Please see "99_change_logs.txt" in the download documents for checking other changes.
Thanks to Shinya for bug report.

Enjoy!

[MySQL][Spider]Spider-2.9 released

+2

-0

posted by Kentoku SHIBA on Sat 28 Nov 2009 17:02 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.9(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Add UDFs "spider_ping_table".
- Add table parameter "monitoring_kind", "monitoring_limit" and "monitoring_server_id".
- Add server parameter "spider_udf_table_mon_mutex_count".
Add Spider's link fault monitor at this release.

Please see "99_change_logs.txt" in the download documents for checking other changes.
Thanks to shinichiro and merikonjatta for bug report.

Enjoy!

MySQL University: The Spider Storage Engine

+2

-0

posted by Stefan Hinz on Mon 23 Nov 2009 16:56 UTC
Tags:

(edit) mysql, sun, plugins, university, engine, storage, sharding, spider

This Thursday (November 26th, 14:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. This session was originally scheduled for October 15th but had to be postponed for technical reasons.

Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with multiple

+0

-0

posted by Stefan Hinz on Mon 23 Nov 2009 08:56 UTC
Tags:

(edit) mysql, sun, plugins, university, engine, storage, sharding, spider

This Thursday (November 26th, 14:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. This session was originally scheduled for October 15th but had to be postponed for technical reasons.

Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with

+0

-0

posted by Stefan Hinz on Mon 23 Nov 2009 08:56 UTC
Tags:

(edit) mysql, sun, plugins, university, engine, storage, sharding, spider

This Thursday (November 26th, 14:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. This session was originally scheduled for October 15th but had to be postponed for technical reasons.

Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with

[Read more...]

[MySQL][Spider]Spider-2.8 released

+0

-0

posted by Kentoku SHIBA on Tue 03 Nov 2009 22:13 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.8(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Add table parameter "link_status".
You can change link_status using "alter table" statement.
Spider's link fault management is table level.

Please see "99_change_logs.txt" in the download documents for checking other changes.

Enjoy!

[MySQL][Spider]Spider-2.7 released

+1

-0

posted by Kentoku SHIBA on Thu 29 Oct 2009 18:49 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.7(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Spider table can load balance using multiple links at searching without locking. Load balance rule is "((server_id + thread_id) % number_of_links)".
Please write multiple connection informations splitting space characters at "host", "user", "table", "server", "socket", "wrapper", "database" and "password" table parameters.
Example: "host 'h1 h2 h3'"

I will continue to develop Spider's functions for Active-Active type clustering.

Please see "99_change_logs.txt" in the download documents for checking other changes.

Enjoy!

[MySQL][Spider]Spider-2.6 released

+5

-0

posted by Kentoku SHIBA on Sun 18 Oct 2009 16:11 UTC
Tags:

(edit) mysql, spider

I'm pleased to announce the release of Spider storage engine version 2.6(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Add server parameter "spider_remote_access_charset", "spider_remote_autocommit", "spider_remote_sql_log_off" and "spider_remote_trx_isolation".
These parameters are setted by Spider at connecting remote server. But it does not need to be setted if you know it previously and no need to change it. In this case, you can set these parameters for improvement connecting performance.

Please see "99_change_logs.txt" in the download documents for checking other changes.
Thanks to Giuseppe for bug report.

Enjoy!

Spider and vertical partition engines with new goodies

+4

-0

posted by Giuseppe Maxia on Thu 15 Oct 2009 09:00 UTC
Tags:

(edit) mysql, scaling, ha, partitioning, sharding, partitions, spider, vertical

The Spider storage engine should be already known to the community. Its version 2.5 has recently been released, with new features, the most important of which is that you can execute remote SQL statements in the backend servers. The method is quite simple. Together with Spider, you also get an UDF that executes SQL code in a remote server. You send a query with parameters saying how to connect to the server, and check the result (1 for success, 0 for failure). If the SQL involves a SELECT, the result can be sent to a temporary table. Simple and effective.

In addition to the Spider engine, Kentoku

[Read more...]

MySQL University: The Spider Storage Engine

+1

-0

posted by Stefan Hinz on Mon 12 Oct 2009 16:24 UTC
Tags:

(edit) mysql, personal, university, engine, storage, spider

This Thursday (October 15th, 13:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with multiple backends in the server layer. This means that the data is accessible from any application without code changes. This

+0

-0

posted by Stefan Hinz on Mon 12 Oct 2009 09:24 UTC
Tags:

(edit) mysql, personal, university, engine, storage, spider

This Thursday (October 15th, 13:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with multiple backends in the server layer. This means that the data is accessible from any application without code changes. This

+0

-0

posted by Stefan Hinz on Mon 12 Oct 2009 09:24 UTC
Tags:

(edit) mysql, personal, university, engine, storage, spider

This Thursday (October 15th, 13:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with multiple backends in the server layer. This means that the data is accessible from any application without code changes.

[Read more...]

Search

Profile

Top Voted (Last Week)

Top Voted (Last Month)

Top 20 Most Active Authors

Top 10 Most Active Team Blogs

Oracle MySQL Blogs

MySQL Links

Other Links

Planetarium