Shuttleworth opens a can of worms. Fedora 15. IBM commits to Hadoop. And more.
# Mark Shuttleworth shared his thoughts on companies, contributor agreements and free software, prompting responses from Simon Phipps, and Dave Neary.
# The Fedora Project launched Fedora 15.
# IBM launched a new version of its BigInsight software, based on Hadoop, committed $100m to …
[Read more]
In the InnoDB plugin, a new variable was added named innodb_io_capacity, which controls the maximum
number of I/O operations per second that InnoDB will perform
(which includes the flushing rate of dirty pages as well as the
insert buffer (ibuf) batch size).
First off, let me just say this is a welcome addition (an addition provided by the
Google Team, fwiw).
However, before this was configurable, the internal hard-coded
value for this was 100. But when this became configurable, the
default was increased to 200.
For many systems, this is not an issue (i.e., the overall system
can perform 200 IOPS).
However, there are still many disks (which is often the
bottleneck) out there that are …
It has only been a few days since the 0.2.0
release of mydumper but there have been some big changes since
then. I will try and go over them all here.
Mydumper 0.2.1
Mydumper 0.2.1 has been released today, many thanks for all those
who have been testing the trunk source, the feedback has gone a
long way to making fixes and improvements to mydumper. You
can download the source for it here.
Myloader
A few days ago Mark Callaghan asked about restoring mydumper backups. There is
of course the great ' …
It has only been a few days since the 0.2.0 release of mydumper but there have been some big changes since then. I will try and go over them all here.
Mydumper 0.2.1
Mydumper 0.2.1 has been released today, many thanks for all those who have been testing the trunk source, the feedback has gone a long way to making fixes and improvements to mydumper. You can download the source for it here.
Myloader
A few days ago Mark Callaghan asked about restoring mydumper backups. There is of course the great ‘ …
[Read more]
A couple of years ago Domas Mituzas created a
tool which could basically be thought of as basically a
lightweight multi-threaded mysqldump. By this I mean it can
retrieve data from multiple tables simultaneously and can even
break a table down into parts for simultaneous retrieval.
Sometime around 2010 I started hacking on mydumper too but
stopped whilst working at Rackspace (Drizzle was way more than
full-time for me).
Back when Domas first blogged about it he was managing to dump
his sample data over 10x faster than mysqldump!
Since the 0.1 series Domas has fixed a lot of problems and since
starting at SkySQL I have finished a lot of work that I …
Photo by Pockafwye under a CC by NC SA 2.0 license
A couple of years ago Domas Mituzas created a tool which could basically be thought of as basically a lightweight multi-threaded mysqldump. By this I mean it can retrieve data from multiple tables simultaneously and can even break a table down into parts for simultaneous retrieval. Sometime around 2010 I started hacking on mydumper too but stopped whilst working at Rackspace (Drizzle was way more than full-time for me).
Back when Domas first blogged about it he was managing to dump his sample data over 10x faster than mysqldump!
Since the 0.1 series Domas has fixed a lot of problems and since starting at …
[Read more]
[caption id="attachment_209" align="alignright" width="240"
caption="Photo by Stéfan under a CC by NC SA 2.0
license"][/caption]
If you have been reading Planet MySQL over April you will have seen many
blog posts on the new features in the MySQL 5.6 (currently a
development release). I developed several patches that are
in 5.6 including the 'Slave_last_heartbeat' status variable to
show the time of the last replication heartbeat received.
One of the cool new features I developed which I am most
proud of is the option to remotely backup …
Whilst supporting customers at SkySQL I often have
to load gigabytes of SQL data into MySQL servers to run
tests. This process can be slow especially for InnoDB
because in a standard dump file every insert is a transaction and
every transaction has to be synchronised to disk for crash
safety. The thing is, most of the time I don't care if the
machine I'm using crashes whilst I'm loading this data into the
server.
There are of course many ways around this, such as editing the
SQL files and wrapping transactions around batches of inserts and
editing the configuration files to disable all the syncing
involved. But I don't want one configuration to load in
data and then another to play with the data, so this is where
libeatmydata comes in.
…
I apologise to those reading Planet MySQL who
will see this twice, this is aimed at a different audience to my
personal blog.
Rackspace and Drizzle
If you have read my last ‘Last Week in Drizzle‘ post you will know that Rackspace are no longer supporting Drizzle. They have done a fantastic job so far and have decided to pass the baton to other companies. As for the staff, they wished to redeploy us to other teams which is something I personally was not keen on. I would rather remain within the MySQL/Drizzle sphere which I would have no longer been able to do effectively inside Rackspace any more.
Drizzle itself will go on to do great things without Rackspace, there are a number of companies that announced support for Drizzle during …
[Read more]
The last few weeks have been particularly quiet from me on the
blogging front. Behind the scenes things have been quite
the opposite so here is a summary of things past, present and
future.
Rackspace and Drizzle
If you have read my last 'Last Week in
Drizzle' post you will know that Rackspace are no longer
supporting Drizzle. They have done a fantastic job so far
and have decided to pass the baton to other companies. As
for the staff, they wished to redeploy us to other teams which is
something I personally was not keen on. I would rather
remain within the MySQL/Drizzle sphere which I would have no
longer been able to do effectively inside Rackspace any
more.
Drizzle itself will go on to do great things without Rackspace,
there are a number of companies that announced support for
Drizzle during the O'Reilly MySQL Conference and Expo …
