Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Previous 30 Newer Entries Showing entries 31 to 60 of 72 Next 12 Older Entries

Displaying posts with tag: storage (reset)

MySQL University: The Spider Storage Engine
Employee +0 Vote Up -0Vote Down

This Thursday (November 26th, 14:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. This session was originally scheduled for October 15th but had to be postponed for technical reasons.

Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with


  [Read more...]
MySQL University: The Spider Storage Engine
Employee +0 Vote Up -0Vote Down

This Thursday (November 26th, 14:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. This session was originally scheduled for October 15th but had to be postponed for technical reasons.

Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with


  [Read more...]
MySQL University: GRAPH computation engine for MySQL
Employee +0 Vote Up -0Vote Down

This Thursday (November 5th, 10:00 UTC - note the different time for this session!), Arjen Lentz of Open Query will present the brand new GRAPH computation engine for MySQL.

From the abstract: Most of us have had to deal with hierarchies (trees) and graphs (such as friend-of-a-friend style problems), and have thus learn that this is -at best- a bit of a monster to do in an SQL/RDBMS. Until now. The GRAPH engine (GPLv2 licensed) is a MySQL storage engine allowing hierarchies and more complex graph structures to be handled in a relational fashion. In a nutshell, tree structures and friend-of-a-friend style searches can now be done using standard

  [Read more...]
MySQL University: GRAPH computation engine for MySQL
Employee +0 Vote Up -0Vote Down

This Thursday (November 5th, 10:00 UTC - note the different time for this session!), Arjen Lentz of Open Query will present the brand new GRAPH computation engine for MySQL.

From the abstract: Most of us have had to deal with hierarchies (trees) and graphs (such as friend-of-a-friend style problems), and have thus learn that this is -at best- a bit of a monster to do in an SQL/RDBMS. Until now. The GRAPH engine (GPLv2 licensed) is a MySQL storage engine allowing hierarchies and more complex graph structures to be handled in a relational fashion. In a nutshell, tree structures and friend-of-a-friend style searches can now be done using

  [Read more...]
MySQL University: GRAPH computation engine for MySQL
Employee +0 Vote Up -0Vote Down

This Thursday (November 5th, 10:00 UTC - note the different time for this session!), Arjen Lentz of Open Query will present the brand new GRAPH computation engine for MySQL.

From the abstract: Most of us have had to deal with hierarchies (trees) and graphs (such as friend-of-a-friend style problems), and have thus learn that this is -at best- a bit of a monster to do in an SQL/RDBMS. Until now. The GRAPH engine (GPLv2 licensed) is a MySQL storage engine allowing hierarchies and more complex graph structures to be handled in a relational fashion. In a nutshell, tree structures and friend-of-a-friend style searches can now be done using

  [Read more...]
Interesting links that predict the future of data storage
+0 Vote Up -0Vote Down

Ok, they aren’t like the 2012 nonsense or anything but they are interesting articles that will be important topics in the near future for expanding our knowledge and usefulness in the job market. Being a DBA does not limit you to relational database systems. I expect to see more requests for non-relational or No-SQL type of data stores as they can have many advantages over an RDBMS. Stability, scalability, simplification of administration, higher performance on lesser hardware for larger datasets, and many other items make no-sql engines very interesting. Here are some useful links:

http://en.wikipedia.org/wiki/NoSQL

http://www.linux-mag.com/cache/7579/1.html

http://www.computerworld.com/s/article/9135086/No_to_SQL_Anti_database_movement_gains_steam_

http://www.viget.com/extend/nosql-misconceptions/

How can I pass up talking about the various Cloud

  [Read more...]
MySQL University: The Spider Storage Engine
Employee +1 Vote Up -0Vote Down

This Thursday (October 15th, 13:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with multiple backends in the server layer. This means that the data is accessible from any application without code changes. This

  [Read more...]
MySQL University: The Spider Storage Engine
Employee +0 Vote Up -0Vote Down

This Thursday (October 15th, 13:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with multiple backends in the server layer. This means that the data is accessible from any application without code changes. This

  [Read more...]
MySQL University: The Spider Storage Engine
Employee +0 Vote Up -0Vote Down

This Thursday (October 15th, 13:00 UTC), Giuseppe Maxia will present the Spider Storage Engine. Here's from the abstract: Everybody needs sharding. Which is not easy to maintain. Being tied to the application layer, sharding is hard to export and to interact with. The Spider storage engine, a plugin for MySQL 5.1 and later, solves the problem in a transparent way. It is an extension of partitioning. Using this engine, the user can deal transparently with multiple backends in the server layer. This means that the data is accessible from any application without code changes.

  [Read more...]
Storage Miniconf Deadline Extended!
+0 Vote Up -0Vote Down

The linux.conf.au organisers have given all miniconfs an additional few weeks to spruik for more proposal submissions, huzzah!

So if you didn’t submit a proposal because you weren’t sure whether you’d be able to attend LCA2010, you now have until October 23 to convince your boss to send you and get your proposal in.

Storage for your Database
Employee +0 Vote Up -0Vote Down

Save the date - October 14th, 3pm Paris & Berlin, 2pm London, 4pm Jerusalem  -  for this free live webinar where you'll have a chance to ask questions to our experts.

This webinar focuses on how ZFS, SSDs and the Open Storage line of products from Sun are changing the rules in the database storage industry. You will learn how to increase data security, scalability, and reduce the price/performance ratio with these technologies. This webinar includes ZFS best practises for databases backup and performance.

To register, click here.

Four short links: 4 August 2009
+0 Vote Up -0Vote Down

  • NASA Nebula Services/Platform Stack -- The NEBULA platform offers a turnkey Software-as-a-Service experience that can rapidly address the requirements of a large number of projects. However, each component of the NEBULA platform is also available individually; thus, NEBULA can also serve in Platform-as-a-Service or Infrastructure-as-a-Service capacities. Bundles RabbitMQ, Eucalyptus, LUSTRE storage, Fabric deployment, Varnish front-end, MySQL and more. (via Jim Stogdill)
  • A Short History of btrfs -- Now for some
  •   [Read more...]
    Business Intelligence Using Open Storage
    +0 Vote Up -0Vote Down

    Sun recently rolled out a new Business Intelligence (BI) solution that uses Open Storage at its core. There are several things that are different about this solution that make it stand out from the crowd.

    1) It is based on Open Source software.

    This solution uses the commercial versions of open source software from Pentaho and Infobright to provide the BI and Datawarehouse (DW) functions respectively and both use the MySQL database. Also, this solution uses Sun's Open Storage products as the core storage component which are built using Open Source software and industry standard components. Combine those with an Open Source operating system like Solaris or

      [Read more...]
    Business Intelligence Using Open Storage
    +0 Vote Up -0Vote Down

    Sun recently rolled out a new Business Intelligence (BI) solution that uses Open Storage at its core. There are several things that are different about this solution that make it stand out from the crowd.

    1) It is based on Open Source software.

    This solution uses the commercial versions of open source software from Pentaho and Infobright to provide the BI and Datawarehouse (DW) functions respectively and both use the MySQL database. Also, this solution uses Sun's Open Storage products as the core storage component which are built using Open Source software and industry standard components. Combine those with an Open Source operating system like Solaris

      [Read more...]
    Business Intelligence Using Open Storage
    +0 Vote Up -0Vote Down

    Sun recently rolled out a new Business Intelligence (BI) solution that uses Open Storage at its core. There are several things that are different about this solution that make it stand out from the crowd.

    1) It is based on Open Source software.

    This solution uses the commercial versions of open source software from Pentaho and Infobright to provide the BI and Datawarehouse (DW) functions respectively and both use the MySQL database. Also, this solution uses Sun's Open Storage products as the core storage component which are built using Open Source software and industry standard components. Combine those with an Open Source operating system like Solaris

      [Read more...]
    Notes on changes made to the Drizzle Storage Subsystem
    +0 Vote Up -0Vote Down

    Yesterday I merged the BlitzDB tree with Drizzle‘s trunk for the first time in a long time (yeah…) and discovered some interesting changes made to the storage subsystem while I was away.

    Previously all functions that caused an action to the storage engine was a member of the handler class but various things like table creation and transaction related functions have now moved to the StorageEngine class. These changes are somewhat drastic but makes good sense for Drizzle to grow further since it makes the subsystem easier to understand and frees Drizzle from the interface design that was strongly affected by MyISAM. For those that are interested, the StorageEngine class is located in “drizzled/plugin/storage_engine.h”.

    For me it was pretty

      [Read more...]
    Storage Engine Dev Journal #3 : Supporting variable width tables
    +0 Vote Up -0Vote Down

    Something I’ve added to BlitzDB recently that was pretty high on my todo list is support for variable width tables. So what is a variable width table? it is a table that contains columns that can vary in size, namely BLOB and TEXT types.

    Going back to the basics, when a new row is to be written, a storage engine is given a pointer to the row data in MySQL format that it must somehow store for later lookup/retrieval. By meaning “somehow”, the storage engine is given the freedom to do whatever it likes with the row.

    Writing a row for a fixed length table (a table with columns that are always the same size) is deadly easy. A storage engine can choose to not temper with the row and simply write or copy the data to it’s storage mechanism. This is because the storage engine is given a row that

      [Read more...]
    Make sure write cache is enabled on your RAID controller
    +1 Vote Up -0Vote Down
    Using a write cache protected by battery (BBWC) is well known and one of the best practices in RDBMS world. But I have frequently seen situations that people do not set write cache properly. Sometimes they just forget to enable write cache. Sometimes write cache is disabled even though they say they set properly.

    Make sure that BBWC is enabled. If not enabled, you will be able to easily get better performance by just enabling it. The following is a DBT-2 example.

    Write cache is disabled:

    # iostat -xm 10
    avg-cpu: %user %nice %system %iowait %steal %idle
    21.16 0.00 6.14 29.77 0.00 42.93

    Device: rrqm/s wrqm/s r/s w/s rMB/s
    sdb 2.60 389.01 283.12 47.35 4.86
    wMB/s avgrq-sz avgqu-sz await svctm %util
    2.19 43.67 4.89 14.76












      [Read more...]
    Journal of Storage Engine Development on Drizzle
    +0 Vote Up -0Vote Down

    I’ve decided to start a series of blog entries on not-so-obvious findings that I’ve found while working on my new project. By archiving the findings, I’m hoping that I can help those that are looking into developing a storage engine for the MySQL family in the future.

    Accumulating these mini-knowledge would also be useful for me since I can refer back to it when I forget something. Also, once I write enough entries I’m planning on summarizing them and making it available on the Drizzle Wiki. If MySQL (http://www.mysql.com) is interested in updating the engine documentation, I would be more than happy to help there too.

    So to begin with, I’ll describe something trivial that I stumbled across while trying to catch an error on duplicate primary key insertion to

      [Read more...]
    Open Storage Webinar
    +0 Vote Up -0Vote Down
    I will be hosting a webinar on May 7 about how companies like Wikimedia and Smugmug are using Open Storage and MySQL to deliver rich media (photos, videos) to their users. You can view the webinar live or on demand here (http://www.mysql.com/news-and-events/on-demand-webinars/display-od-337.html).
    Open Storage Webinar
    +0 Vote Up -0Vote Down
    I will be hosting a webinar on May 7 about how companies like Wikimedia and Smugmug are using Open Storage and MySQL to deliver rich media (photos, videos) to their users. You can view the webinar live or on demand here (http://www.mysql.com/news-and-events/on-demand-webinars/display-od-337.html).
    Open Storage Webinar
    +0 Vote Up -0Vote Down
    I will be hosting a webinar on May 7 about how companies like Wikimedia and Smugmug are using Open Storage and MySQL to deliver rich media (photos, videos) to their users. You can view the webinar live or on demand here (http://www.mysql.com/news-and-events/on-demand-webinars/display-od-337.html).
    Another Pluggable Storage Engine for MySQL
    Employee +0 Vote Up -0Vote Down

    Kazuho Oku of Cybozu Labs, Inc., a community contributor to MySQL and SCA signatory, gives a talk on Q4M, a message queue stroage engine for MySQL.

    Another Pluggable Storage Engine for MySQL
    Employee +0 Vote Up -0Vote Down

    Kazuho Oku of Cybozu Labs, Inc., a community contributor to MySQL and SCA signatory, gives a talk on Q4M, a message queue stroage engine for MySQL.

    Another Pluggable Storage Engine for MySQL
    Employee +0 Vote Up -0Vote Down

    Kazuho Oku of Cybozu Labs, Inc., a community contributor to MySQL and SCA signatory, gives a talk on Q4M, a message queue stroage engine for MySQL.

    Understanding how auto increment works with InnoDB
    +0 Vote Up -0Vote Down

    Lately I’ve been having lots of fun going through Drizzle and InnoDB‘s sourcecode to get a grasp of how auto increment is processed internally. I think I now have a fairly good grasp of what’s going on so I’m writing this entry as a note for myself. I’m also hoping that this will be helpful to those that are interested in this topic too.

    So in MySQL and Drizzle, the storage engine (in this case InnoDB) is responsible for computing the auto increment value. Here’s an abbreviated execution path for a simple INSERT statement to a table with an auto increment column:

    mysql_parse() -> mysql_execute_command() -> mysql_insert() ->
    write_record() -> handler::ha_write_row() -> ha_innobase::write_row() ->
      [Read more...]
    More MySQL Advice (Update)
    Employee +0 Vote Up -0Vote Down

    In my last post, I forgot to mention another MySQL related Sun Blueprints™ that was recently published: MySQL Guide for Sun Storage 7000 Unified Storage Systems by Bill Aiken and Krishnan Shankar.  MySQL and the Sun Storage 7000 is a great marriage because it delivers good performance, low cost, combined with ease of management.   Configuring system I/O can be a complex and frustrating task even for experienced systems administrators.   Start ups and smaller companies using MySQL typically just don't have the skill or time to tune the I/O interface of their database.   Here the Sun

      [Read more...]
    More MySQL Advice (Update)
    Employee +0 Vote Up -0Vote Down

    In my last post, I forgot to mention another MySQL related Sun Blueprints™ that was recently published: MySQL Guide for Sun Storage 7000 Unified Storage Systems by Bill Aiken and Krishnan Shankar.  MySQL and the Sun Storage 7000 is a great marriage because it delivers good performance, low cost, combined with ease of management.   Configuring system I/O can be a complex and frustrating task even for experienced systems administrators.   Start ups and smaller companies using MySQL typically just don't have the skill or time to tune the I/O interface of their database.   Here the

      [Read more...]
    Introducing the InnoDB Blog
    +0 Vote Up -0Vote Down

    Well, here we are … the first post to the InnoDB blog.   Now there is a blog dedicated solely to InnoDB products and technology. The Innobase team will be posting here regularly on all manner of topics regarding the InnoDB storage engine.  We plan to provide timely updates and important technical information about InnoDB-related products including the built-in InnoDB distributed by MySQL, the InnoDB Plugin and InnoDB Hot Backup.  We invite you to visit regularly and post your comments.

    We’ve borrowed the name “Transactions on” from the computer-science journal Transactions on Database Systems, published by the ACM society for computing professionals.  Like that journal, this blog will cover a wide range of database topics, specifically as they relate to InnoDB.

    Users of InnoDB know a transaction is an atomic all-or-nothing set of

      [Read more...]
    Different Technology Stacks On Production and DR?
    +0 Vote Up -0Vote Down

    Last week, I was at the NetApp office in North Sydney for the presentation on NetApp SnapManager for Oracle. It was good opportunity to learn more about NetApp snapshots while working on a project for one of our clients in Sydney. It was an especially interesting topic as I have some experience using Veritas Checkpoints (see my presentation on test systems refreshes), and it was interesting to see what’s different and new in the NetApp implementation. But I digress.

    I learned that NetApp can provide access to the same LUNs via either Fiber-Channel (FC) or iSCSI. And this is when the interesting argument surfaced. Apparently, some companies aim to

      [Read more...]
    Previous 30 Newer Entries Showing entries 31 to 60 of 72 Next 12 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.