Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 30 of 1029 Next 30 Older Entries

Displaying posts with tag: General (reset)

Query Sphinx with Node.js
+0 Vote Up -0Vote Down
You probably already know that Sphinx supports MySQL binary network protocol. But, if you haven’t heard– Sphinx can be accessed with the regular ol’ MySQL API. Pretty much any language you use to query MySQL can be used to query Sphinx. So, in this post, to demonstrate how using ‘SphinxQL’ (our subset of SQL) makes [...]
Performance evaluation of MariaDB 10.1 and MySQL 5.7.4-labs-tplc
+0 Vote Up -0Vote Down

Introduction

Evaluating the performance of database systems is a very demanding task. There are a lot of hard choices to be made, e.g.:

  • What operating system and operating system version is to be used
  • What configuration setup is to be used
  • What benchmarks are to be used and how long are the warm-up and measure times
  • What test setups are to be used
  • What version of the database management system is used
  • What storage engine is used

While performance evaluation is mostly machine time, there is still a lot of hard work for the human monitoring the tests. In this blog post we have made following choices:

  • We’re using an Intel Xeon E5-2690 @ 2.9GHz CPU containing 32-cores and Linux 3.4.12 with 132G main memory. The database is stored on a Fusion-IO ioDrive2 Duo 2.41TB
  [Read more...]
Sphinx Searches Gmail with MySQL and PHP
+0 Vote Up -0Vote Down
There may come a time when you want to collect some of your emails, put them into a database, and search them with Sphinx. If that time has come, you may enjoy this blog post. It will outline one way to get emails from Gmail into MySQL (with PHP’s IMAP extension) so that they become [...]
Sphinx in Docker. The basics.
+0 Vote Up -0Vote Down
With an ear to the interwebs, you’ll hear a few things about Docker. Docker is an open platform for developers and sysadmins to build, ship, and run distributed applications. In this blog post, I’m going to outline a very basic example of how to use Sphinx from within a Docker container. What is Docker? This [...]
Eventually Consistent Databases: State of the Art
+0 Vote Up -0Vote Down

Introduction

Eventual consistency [1] is a consistency model, which is used in many large distributed databases. Such databases require that all changes to a replicated piece of data eventually reach all affected replicas. Furthermore, the conflict resolution is not handled in these databases, and the responsibility is pushed up to the application authors in the event of conflicting updates. Eventual consistency is a specific form of weak consistency: the storage system guarantees that if no new updates are made to the object, eventually all accesses will return the last updated value [1]. If no failures occur, the maximum size of the inconsistency window can be determined based on the factors such as communication delays, the load on the system, and the number of replicas involved in the replication scheme. We earlier in

  [Read more...]
Getting Started with Sphinx?
+0 Vote Up -0Vote Down
Here are a few videos those of you who are just getting started with Sphinx may find useful. The first video demonstrates a very simple implementation with Ubuntu, PHP, and MySQL. The second video is also about installing on Ubuntu. And, the last video discusses fulltext query syntax. Check ‘em out. Quick Start with Ubuntu [...]
Walking through the Autocomplete Example
+0 Vote Up -0Vote Down
If you would like to see how to set up autocomplete and correction suggestion with Sphinx, PHP, MySQL, and jQuery, take a look at this. This quick video will walk you through the steps of setting up the autocomplete example that we wrote about a while ago. For details on how the whole process works, go [...]
MySQL 5.6 on POWER (patch available)
+0 Vote Up -0Vote Down

The following sentence is brought to you by IBM Legal. The postings on this site are my own and don’t necessarily represent IBM’s positions, strategies or opinions.

Okay, now that is out of the way….

If you’re the kind of person who follows the MySQL bugs database closely or subscribes to the MySQL Internals mailing list, you may have worked out that I’ve spent a small amount of time poking at MySQL on modern POWER systems.

Unlike Intel CPUs, POWER CPUs require explicit memory barriers to synchronize memory state between

  [Read more...]
MariaDB moves development to Github
+0 Vote Up -0Vote Down

Today marks a milestone in terms of the MariaDB project – going forward, the MariaDB project plans to use Github and git for source code management. The migration happens from Launchpad and the bzr tool.

The 10.1 server development (under heavy development now) will happen on Github. You can check it out here: https://github.com/MariaDB/server. Feel free to watch, star or even fork the code, and send us contributions!

Previous maria-captains should now provide their Github IDs so that they can be accorded similar status. Send the IDs to the maria-developers mailing list.

The project eventually wants to move the 10.0, 5.5, 5.3, 5.2, and

  [Read more...]
OurSQL Episode 185: Getting in Sync
+0 Vote Up -0Vote Down

This week we discuss pt-table-checksum for keeping data in sync. Ear Candy is a rational look at why one company chose MySQL; At the Movies is using MySQL in a practical way for Big Data.

pt-table-checksum
pt-table-checksum
pt-table-sync

Episode 151, where we talked about Oracle toolsmysqldbcompare and mysqldiff
Options discussed:
--replicate, --no-create-replicate-table

read more

OurSQL Episode 184: Digging Through the Tool Chest
+1 Vote Up -0Vote Down

This week we discuss more Percona tools: pt-online-schema-change and pt-slave-find. Ear Candy is using the CONNECT storage engine to read GPX files, and At the Movies is Performance at Scale with TokuDB.

Events
DB Hangops - every other Wednesay at noon Pacific time

Upcoming MySQL events (http://www.mysql.com/news-and-events/events/)

OSCon 2014 at the Oregon Convention Center in Portland, Oregon from Sunday July 20th through Thursday July 24th.

Training
SkySQL Trainings

read more

Sphinx at Divendo
+0 Vote Up -0Vote Down
Many Sphinx users utilize MySQL as a data source. Divendo is one of them. This blog post will relay the story of how Divendo got going with Sphinx after MySQL fulltext search became unwieldy. Enjoy! Divendo Divendo is a meta-search engine for classified ads serving the following continents and countries: Europe: Spain, Italy, Portugal, United Kingdom Americas: Mexico, Argentina, Brazil, Chile, Colombia, Peru, Venezuela Asia: India Australia [...]
The Other MariaDB Blog
+1 Vote Up -0Vote Down

This is the blog of the MariaDB Foundation in particular and the MariaDB project in general. It is used to announce new MariaDB versions, for posts from MariaDB developers about new features, and for news from or about the MariaDB Foundation itself, among other things. For many this is the MariaDB blog, and on behalf of the MariaDB Foundation, welcome! We’re glad you’re here. Thanks for stopping by!

What you may not know is that there’s another MariaDB blog over at https://mariadb.com/blog run by the fine folks at SkySQL (full disclosure: I work for SkySQL, but my posts here are on behalf of the MariaDB project and the Foundation). This other MariaDB blog contains posts about SkySQL’s commercial MariaDB offerings (naturally) but also a lot of other

  [Read more...]
Crunching XML files with MariaDB
+0 Vote Up -0Vote Down

In January I wrote my first post about node.js and MariaDB . In February I continued with a second post about using jQuery and some GIS calculations. Now it is time for the third and this time the main focus is not so much on GIS functionality, but instead on the capabilities MariaDB has for handling piles of unstructured data. In this case I’ll be focusing on crunching a pile of XML files without importing the XML data itself.

MariaDB 10.0, which had its GA launch in early April, includes the Connect engine. It has been developed to dynamically access all kinds of data sources,

  [Read more...]
ActionMessage Email Marketing – Powered by Sphinx Search
+0 Vote Up -0Vote Down
This blog post features a quick and interesting story from James (from ActionMessage), an early adopter of Sphinx. We met him at Percona Live: the MySQL User Conference, a few years back. This year, we asked if he would like to share his story with our community. Here it is. Enjoy! “I’m James Briggs from ActionMessage [...]
Dotdeb repository problems with MariaDB 5.5 (solution)
+0 Vote Up -0Vote Down

Dotdeb is a repository currently targeting Debian and Ubuntu, providing a nice set of packages for LAMP servers.

Recently, MySQL 5.6 was added to the dotdeb repository. On the surface, this is a very harmless addition. MariaDB is a replacement for MySQL and it should be possible for applications designed for MySQL to easily switch to MariaDB. Therefore MariaDB also includes the libraries that applications using MySQL depend upon, such as libmysqlclient18 and mysql-common. The dpkg package manager looks at the MySQL 5.6 packages in dotdeb and assumes that 5.6 is a higher version than 5.5, which results in it removing or replacing libraries during normal apt-get installation and upgrade procedures.

The problems appear in the following scenarios:

  [Read more...]
Advanced Search with MySQL and Sphinx
+0 Vote Up -0Vote Down
We had a great time at the MySQL user conference (Percona Live) and now, in this post, we’d like to share the talk we gave about how to deliver ultra-fancy search with Sphinx. This year’s talk was delivered by Vladimir Fedorkov (of Blackbird) and Andrew Aksyonoff (creator of Sphinx). If you missed Percona Live (or [...]
MariaDB Client Library for C 2.0 and Maria JDBC Client 1.1.7 released
+1 Vote Up -0Vote Down

The MariaDB Foundation is pleased to announce the releases of MariaDB C Client Library 2.0 and MariaDB JDBC Client 1.1.7

The MariaDB Client Library for C 2.0 is a major release which contains more than 70 bug fixes and a lot of new functions and features, e.g.

  • SSH support
  • Dynamic Columns API
  • Support for MinGW and Objective/C
  • Read-ahead cache

…and much more!

For a complete list of all new features please visit MariaDB Client Library for C 2.0.0 Release Notes

We are very proud for getting a tremendous amount of contributions: bug reports, ports, patches and suggestions which helped

  [Read more...]
SphinxQL and the MySQL .NET connector
+0 Vote Up -0Vote Down
Want to use C#/.NET with Sphinx? This blog post will tell you how to do it. Check it out. Sphinx with C#/.NET Here are your options: use SphinxSE. This option makes sense only if you already use MySQL server and you want to use Sphinx via the MySQL server… It has it’s advantages and disadvantages. [...]
New kid on the block: MariaDB ODBC Driver 0.9.1-beta
+1 Vote Up -0Vote Down

The MariaDB project is pleased to announce MariaDB ODBC Driver Beta – the start of the public beta testing phase of MariaDB ODBC Driver

MariaDB ODBC Driver is a standarized database driver for Windows platforms. It supports ODBC Standard 3.5 and can be used as a drop-in replacement for MySQL Connector/ODBC.

Maria ODBC Driver is licensed under the LGPL license. It is compatible to MySQL Connector/ODBC and supports both Unicode and ANSI mode.

MariaDB ODBC Driver is build on top of the MariaDB LGPL C library and uses binary prepared statement protocol for client server communication.

For more information please visit the MariaDB ODBC Driver page

Significant performance boost with new MariaDB page compression on FusionIO
+0 Vote Up -0Vote Down

The MariaDB project is pleased to announce a special preview release of MariaDB 10.0.9 with significant performance gains on FusionIO devices. This is is a beta-quality preview release.

Download MariaDB 10.0.9-FusionIO preview

Background

The latest work between MariaDB and FusionIO has focused on dramatically improving performance of MariaDB on the high-end SSD drives produced by Fusion-IO and at the same time delivering much better endurance for the drives themselves. Furthermore, FusionIO flash memory solutions increase transactional database performance. MariaDB includes specialized improvements for FusionIO devices, leveraging a feature of the NVMFS filesystem on these popular, high performance solid state disks. Using this feature, MariaDB 10 can

  [Read more...]
MariaDB and WebScaleSQL
+2 Vote Up -0Vote Down

On Thursday MySQL technology saw a huge boost. It’s hard for anyone now to argue that MySQL isn’t in the game of extreme scalability and performance, which some NoSQL vendors have been using as a tagline for the last years. To see four of the largest MySQL and MariaDB users come together to bootstrap a branch of MySQL for extreme scaling needs is simply fantastic. The improvements done inside these companies will now be available to the rest of the community. In all fairness Facebook and Twitter, in particular, have been making their improvements publicly available also before. Google has also made some improvements available publicly over the years and have lately been active in the MariaDB project with code reviews, bug fixes and other patches. But broadening the public contributions further and combining it all, is new.

Engineering of MySQL technology happens in many places. Aside from

  [Read more...]
Merging 5.6 test cases and thoughts on feature deprecation in MariaDB 10.0
+1 Vote Up -0Vote Down

MariaDB 10 is nearing GA, and it makes sense to make sure that the test suite from MySQL 5.6 is merged into MariaDB 10. Svoj is doing a lot of this work, and then we like to look at features, especially ones that are deprecated upstream. We don’t do that on blogs, but on the maria-developers mailing list.

I bring to your attention: Intermediate status for test cases merge. We see that INSERT DELAYED and SHOW PROFILE for example are deprecated in MySQL 5.6. The only way for feedback to the MySQL team seems to be comments on Morgan’s blog. However with MariaDB, especially with the feedback plugin enabled, we

  [Read more...]
MariaDB Eventually Consistent?
+0 Vote Up -0Vote Down
Background

Eventual consistency is a consistency model used in many large distributed databases which requires that all changes to a replicated piece of data eventually reach all affected replicas; conflict resolution is not handled and responsibility is pushed up to the application author in the event of conflicting updates [13].

Eventual consistency is a specific form of weak consistency; the storage system guarantees that if no new updates are made to the object, eventually all accesses will return the last updated value [14]. If no failures occur, the maximum size of the inconsistency window can be determined based on factors such as communication delays, the load on the system, and the number of replicas involved in the replication scheme [3].

A few examples of eventually consistent systems:

  • DNS
  • Asynchronous master/slave replication on an RDBMS e.g.
  [Read more...]
Installing MariaDB Galera Cluster on Debian/Ubuntu
+1 Vote Up -0Vote Down

A MariaDB Howto authored by: Erkan Yanar.

This is a Howto about installing MariaDB Galera Cluster on Debian/Ubuntu. Because a lot of people were having problems installing MariaDB Galera Cluster, elenst from #maria on freenode forced me to write this Howto

Installing MariaDB Galera Cluster is in fact quite easy and actually kind of boring in the end. This Howto is written for (and tested on) on Debian 7.1 (Wheezy) and Ubuntu 12.04 (Precise).

What we need

In our setup we assume 3 nodes (node01, node02, node03) with one interface each. We assume following IP addresses: 172.16.8.5, 172.16.8.6, and 172.16.8.4. We need three packages installed on all nodes:

  • rsync
  • galera
  • mariadb-galera-server

As Galera

  [Read more...]
Case Study: Sphinx@Jobma
+0 Vote Up -0Vote Down
In this blog post, we’ll talk about how Jobma improved search for their users by switching from MySQL fulltext search to Sphinx. Enjoy! What is Jobma? Jobma is a new job portal based solely on Video Resumes, which permits job seekers to quickly and directly reach potential employers. The hiring process is easier with the help [...]
Reports exaggerated
Employee +1 Vote Up -0Vote Down
I've been letting the blog rest recently, and not so recently as well.  The problem is not a lack of subjects, but a lack of time to do them any justice.  However it is quite sad to see that my last entry was in September 2012, so it is time to post again.

Of late I have been pondering what I have to say about :
  • Distributed MVCC and write-scaling
  • Different approaches to eventual consistency with replicated RDBMS
  • Various MySQL Cluster related topics
  • Various general rambling and unstructured topics
However, these will take some time to percolate and calcify.

In the meantime here are some things I have found interesting recently :






  [Read more...]
Ghosts of MySQL Past, Part 7: PBXT
+0 Vote Up -0Vote Down

Recently, I’ve been writing based on my linux.conf.au 2014 talk, which you can watch the recording of. Also see Part 1, Part 2, Part 3, Part 4,

  [Read more...]
Auto increments in Galera
+0 Vote Up -0Vote Down

Lets start by considering a scenario where records are being inserted in a single auto-increment table via different nodes of a multi-master cluster. One issue that might arise is ‘collision’ of generated auto-increment values on different nodes, which is precisely the subject of this article.

As the cluster is multi-master, it allows writes on all master nodes. As a result of which a table might get same auto-incremented values on different nodes on INSERTs. This issue is discovered only after the writeset is replicated and that’s a problem!

Galera cluster suffers with the similar problem.

Lets try to emulate this on a 2-node Galera cluster :

1) On node #1:

MariaDB [test]> CREATE TABLE t1(c1 INT AUTO_INCREMENT PRIMARY KEY, c2 INT)ENGINE=InnoDB;
Query OK, 0 rows affected (0.07 sec)

MariaDB [test]> START TRANSACTION;
Query OK, 0
  [Read more...]
Use Sphinx with MySQL
+0 Vote Up -0Vote Down
In this blog post (which was inspired by Adrian Nuta’s recent talk about Sphinx at FOSDEM), we go through some more of the differences between MySQL fulltext search and Sphinx. People frequently ask us questions along these lines, so we decided another blog post on the subject would be worthwhile. Check it out! Introduction This [...]
Showing entries 1 to 30 of 1029 Next 30 Older Entries

Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.