In this part we will discuss how NDB batch handling works. Query
execution of
complex SQL queries means that more rows can be delivered than
the receiver is
capable of receiving. This means that we need to create a data
flow from the
producer where the data resides and the query executor in the
MySQL Server.
The MySQL Server uses a record where the storage engine have to
copy the result
row into the record. This means that the storage of batches of
rows is taken
care of by the storage engine.
When NDB performs a range scan it will decide on the possible
parallelism before
the scan is started. The NDB API have to allocate enough memory
to ensure that
we have memory prepared to receive the rows as they arrive in a
flow of result
rows from the data nodes. It is possible to set batch size of
hundreds and even
thousands of rows for a query.
The …
We’re delighted to be able to share that Tungsten Clustering – our flagship product – is named in the DBTA 2020 List of Trend Setting Products!
Congratulations to all the products and their teams that were named in the 2020 list.
We have been at the forefront of the market need since 2004 with our solutions for platform agnostic, highly available, globally scaling, clustered MySQL databases that are driving businesses to the cloud (whether hybrid or not) today; and our software solutions are the expression of that.
Tungsten Clustering allows enterprises running business-critical MySQL database applications to cost-effectively …
[Read more]As you may know, I’m using MySQL exclusively on GNU/Linux. To be honest for me it’s almos 20 years that the year of Linux on the desktop happened. And I’m very happy with that.
But this week-end, I got a comment on an previous post about upgrading to MySQL 8.0, asking how to proceed on Windows. And in fact, I had no idea !
So I spent some time to install a Windows VM and for the very first time, MySQL on Windows !
The goal was to describe how to upgrade from MySQL 5.7 to MySQL 8.0.
So once MySQL 5.7 was installed (using MySQL Installer), I created some data using MySQL Shell:
Of course I used latest MySQL Shell, 8.0.18 in this case. Don’t forget that if you are using MySQL Shell or MySQL Router, you must always use the latest …
[Read more]
In the previous part we showed how NDB will parallelise a
simple
2-way join query from TPC-H. In this part we will describe
how
the pushdown of joins to a storage engine works in the MySQL
Server.
First a quick introduction to how a SQL engine handles a
query.
The query normally goes through 5 different phases:
1) Receive query on the client connection
2) Query parsing
3) Query optimisation
4) Query execution
5) Send result of query on client connection
The result of 1) is a text string that contains the SQL query
to
execute. In this simplistic view of the SQL engine we will
ignore
any such things as prepared statements and other things making
the
model more complex.
The text string is parsed by 2) into a data structure that
represents
the query in objects that match concepts in the SQL engine.
Query …
Overview
Over the past few days we have been working with a number of customers on the best way to handle Triggers within their MySQL environment when combined with Tungsten Replicator. We looked at situations where Tungsten Replicator was either part of a Tungsten Clustering installation or a standalone replication pipeline.
This blog dives head first into the minefield of Triggers and Replication.
Summary and Recommendations
The conclusion was that there is no easy one-answer-fits-all solution – It really depends on the complexity of your environment and the amount of flexibility you have in being able to adjust. Our top level summary and recommendations are as follows:
If using Tungsten Clustering and you need to use Triggers:
- Switch to …
In part 1 we showed how NDB can parallelise a simple query with
only a single
table involved. In this blog we will build on this and show how
NDB can only
parallelise some parts of two-way join query. As example we will
use Q12 in
DBT3:
SELECT
l_shipmode,
SUM(CASE
WHEN
o_orderpriority = '1-URGENT'
OR o_orderpriority = '2-HIGH'
THEN 1
ELSE
0
END) AS high_line_count,
SUM(CASE
WHEN
o_orderpriority <> …
As always, the MySQL, MariaDB and Friends devroom received far more high-quality submissions than we could fit in. The committee, consisting of Marco Tusa (Percona), Kenny Gryp (MySQL), Vicențiu Ciorbaru (MariaDB Foundation), Matthias Crauwels (Pythian), Giuseppe Maxia (Community), Federico Razzoli (Community) and Øystein Grøvlen (Alibaba/Community) had the task of reducing 75 submissions into the final 17.
The following sessions were selected:
| Session | Speaker | Start | End |
|---|---|---|---|
| Welcome | Frédéric Descamps and Ian Gilfillan | 10h30 | 10h40 |
| MySQL 8 vs MariaDB 10.4 | Peter Zaitsev | 10h40 | 11h00 |
| … |
I will describe how NDB handles complex SQL queries in a number
of
blogs. NDB has the ability to parallelise parts of join
processing.
Ensuring that your queries makes best possible use of these
parallelisation features enables appplications to boost
their
performance significantly. It will also be a good base to
explain
any improvements we add to the query processing in NDB
Cluster.
NDB was designed from the beginning for extremely efficient key
lookups
and for extreme availability (less than 30 seconds of downtime
per year
including time for software change, meta data changes and
crashes).
Originally the model was single-threaded and optimised for 1-2
CPUs.
The execution model uses an architecture where messages are
sent
between modules. This made it very straightforward to extend
the
architecture to support multi-threaded execution when CPUs …
Angular 9 is in pre-release! Read about its new features in this article and how to update to the latest Angular version in this article.
You can also get our Angular 8 book for free or pay what you can.
This tutorial is designed for developers that want to use Angular 9 to build front-end apps for their back-end REST APIs. You can either use Python & Django as the backend or use JSON-Server to mock the API if you don't want to deal with Python. We'll be showing both ways in this tutorial.
Check out the other parts of this tutorial:
Adding Routing Building Navigation UI Using Angular Material 8
This tutorial deals with REST APIs and routing but you can also start with basic concepts by following this tutorial (part 1 and part 2) instead which you'll build a simple calculator.
If you would like to consume a third-party REST API instead of building your own API, make to check out this tutorial. …
[Read more]Right-sizing database instances is the process of adjusting your database instances’ size to match the workload generated by the application. In most cases, the incentive to right-size your database instances will be to lower the cloud infrastructure’s costs, ideally without compromising on performance.
In this post we’ll guide you through how to analyze the instance’s used resources, in an effort to identify opportunities to save on your RDS costs.
How to identify memory related down-sizing opportunities
MySQL has a lot of “moving parts” which may contribute to the amount of memory it needs to operate efficiently. Just to list a few of the most impactful factors: fixed-size buffers (query cache, innodb buffer pool size), the database’s workload (query connections, query buffers), replication internals (replication connections, binary log caches) and more.
When looking for down-sizing opportunities, …
[Read more]