Last week I had to update several million rows in a single MySQL
table. Rather that executing the update directly in the database,
I decided to use common_schema's split() function.
There are two reasons I chose to use common_schema for this task:
Chunking
Chunking breaks a single update statement into multiple
statements, each updating at most a certain specified
number of rows. The default chunk size is 1000, and I changed it
to 2000 by setting the size parameter.
Throttling
…[Read more]