The CAP Theorem has become a convenient excuse for throwing data
consistency under the bus. It is automatically assumed that every
distributed system falls prey to CAP and therefore must sacrifice
one of the three objectives, with consistency being the
consistent fall guy. This automatic assumption is simply false. I
am not debating the validity of the CAP Theorem, but instead
positing that the onset of CAP limitations—what I call the CAP
event horizon—does not start as soon as you move to a second
master database node. Certain approaches can, in fact, extend the
CAP event horizon.
Physics tells us that different properties apply at different
scales. For example, quantum physics displays properties that do
not apply at larger scale. We see similar nuances in scaling
databases. For example, if you are running a master slave
database, using synchronous replication with a single slave is no
problem. Add nine more slaves and it slows the …
Oracle, after dating HP, Dell, Netapp and EMC has found its mate
in Sun. Oracle is now becoming a systems company, and unceremoniously dumping
these former paramours. These leaves the spurned lovers to find
alternate accommodations, especially in the area of the
database.
As I have stated previously on this blog, the clear partner of
choice on the Windows front is Microsoft. This is demonstrated by
today’s partner announcement around MS SQL Server for
OLTP. But who is their partner in the Linux segment?
The following are contenders:
* Postgres (HP rolls their own)
* EnterpriseDB (pre-rolled Postgres)
* Ingres or Sybase—Oracle has felled them both in the past, …
DBT-2 is a TPC-C like OLTP benchmark, and very popular amongst
many MySQL users. It is used by MySQL QA team to test the
stability and performance before release. However, steps to setup
DBT-2 is a little bit messy, and its README files include some
dummy information. So I introduce you these steps below:
1. Download it!
You can download the source code from here: http://osdldbt.sourceforge.net/
2. Required packages
The following perl packages are required to build DBT-2.
Unfortunately, configure script doesn't complain even if they are
missing. Install them using, e.g. CPAN.
shell> sudo cpan Statistics::Descriptive
shell> sudo cpan Test::Parser
shell> sudo cpan Test::Reporter
If you want to make a graph from the output, you have to install
gnuplot in advance. e.g. Ubuntu …
- Phil Hilderbrand of thePlatform for Media, Inc presents
- classic partitioning
- old school - union in the archive tables
- auto partitioning and partition pruning
- great for data warehousing
- query performance improved
- maintenance is clearly improved
- design issues in applying partitioning to OLTP (On-Line
Transaction Processing)
- often id driven access vs date driven access
- 1 big clients could be 80% of the whole database, so there's a difficulty selecting partitioning schemes
- partitioning is only supported starting from MySQL 5.1
- understanding the …
Recently we put together a consolidation benchmark to see how an open-source stack performs against the proprietary stack from Microsoft. Solaris, MySQL, and Sun Web Server running on the open-source UltraSPARC T2 processor were pitted against a Microsoft SW stack running on a 4-socket QC Xeon server. This benchmark highlights the continued trend to incorporate MySQL open-source databases and how it works under virtualization (Solaris Zones).
The Sun SPARC Enterprise T5220 (1.4 Ghz UltraSPARC T2 processor) and Solaris Containers managing a consolidation of Open-Source Software components (MySQL Database and Sun Java System Web Server) provided 2.4 times better performance than the HP DL580 system (four Xeon quad-core processors) and a major virtualization software, Microsoft Windows 2003 Server EE, Microsoft SQLserver database and Microsoft IIS webserver.
The Sun SPARC Enterprise T5220 using the MySQL database in Solaris zones is …
[Read more]Recently we put together a consolidation benchmark to see how an open-source stack performs against the proprietary stack from Microsoft. Solaris, MySQL, and Sun Web Server running on the open-source UltraSPARC T2 processor were pitted against a Microsoft SW stack running on a 4-socket QC Xeon server. This benchmark highlights the continued trend to incorporate MySQL open-source databases and how it works under virtualization (Solaris Zones).
The Sun SPARC Enterprise T5220 (1.4 Ghz UltraSPARC T2 processor) and Solaris Containers managing a consolidation of Open-Source Software components (MySQL Database and Sun Java System Web Server) provided 2.4 times better performance than the HP DL580 system (four Xeon quad-core processors) and a major virtualization software, Microsoft Windows 2003 Server EE, Microsoft SQLserver database and Microsoft IIS webserver.
The Sun SPARC Enterprise T5220 using the MySQL database in Solaris zones is …
[Read more]Recently we put together a consolidation benchmark to see how an open-source stack performs against the proprietary stack from Microsoft. Solaris, MySQL, and Sun Web Server running on the open-source UltraSPARC T2 processor were pitted against a Microsoft SW stack running on a 4-socket QC Xeon server. This benchmark highlights the continued trend to incorporate MySQL open-source databases and how it works under virtualization (Solaris Zones).
The Sun SPARC Enterprise T5220 (1.4 Ghz UltraSPARC T2 processor) and Solaris Containers managing a consolidation of Open-Source Software components (MySQL Database and Sun Java System Web Server) provided 2.4 times better performance than the HP DL580 system (four Xeon quad-core processors) and a major virtualization software, Microsoft Windows 2003 Server EE, Microsoft SQLserver database and Microsoft IIS webserver.
The Sun SPARC Enterprise T5220 using the MySQL database in Solaris zones is …
[Read more]When your company decides that "it is time to build a data warehouse", what thoughts come to mind?1) A magical fairy ice cream land where data is presented in chocolate shells for everyone to digest perfectly;2) A big literal warehouse in the industrial section of town with rusty old containers;3) Another place to put data, which means another place for you to track and monitor additional
One of the enhancements I added to MySQL Archiver in the recent release was listed innocently in the changelog as "Destination plugins can now rewrite the INSERT statement." Not very exciting or informative, huh? Keep reading.
In the first two articles in this series, I discussed archiving basics, relationships and dependencies, and specific archiving techniques for online transaction processing (OLTP) database servers. This article covers how to move the data from the OLTP source to the archive destination, what the archive destination might look like, and how to un-archive data. If you can un-archive easily and reliably, a whole new world of possibilities opens up.