I wrote this up a while ago and decided that I didn’t want to lose it in a shuffle of documents during my transition to a new workstation. It’s the basics of setting up Heartbeat (LVS) + DRBD (block replication between active/passive master servers) + MySQL. This should give you the basics of a H/A system without the benefits of SAN but also without the associated cost. The validity of this setup for H/A purposes is highly dependent on your workload and environment. You should know the ins and outs of your H/A solution before deciding to blame the system for not performing as expected. As with all production systems you should test, test, test and test some more before going live.

When I get around to it later I’ll post my How-To for setting up RHCS + SAN + MySQL. You can download the DRBD document PDF here: …

Quick update to the framework that was released yesterday; I’ve added automatic graph generation. I chose DyGraphs due to the quick ability to enable support – the HTML is very quick and simply loads the CSV data. It has the same zooming features of Highcharts without the JS overhead.

Now when you run a load test you will get (in the output directory) a mixture of files: the main cumulative CSV and HTML file for the hostname that was tested, and then one CSV and HTML per report variable that was tested. This means you don’t have to drag the main CSV file into an alternate program or spend time parsing out certain variables one at a time to generate specific graphs.  I’ve also added support for limiting output of SNMP variables (LOAD,CPU,MEM). Head over here and download the update: http://code.google.com/p/quadrant-framework/

To enable …

It seems that everyone loves load testing these days. Problem is that everyone is using their own quick scripts, simple or complex, to drive their tests without the ability for other DBAs to duplicate those tests. Let’s say I write a great test and share my results and graphs on the blog – you want to run the same tests to see how your new DB servers compare in performance: this framework allows you to do that without duplicating any work or writing code. This is a basic release that will get the ball rolling. I’ve included some sample tests in the README file, so give them a try.

This codebase offers a user friendly framework for creating and visualizing MySQL database load test jobs. It is based around Sysbench, which is generally considered the industry standard load test application. The framework allows you to do the following:

• standardize your tests without requiring you to write one-off bash scripts to handle …

Two years ago I published a post entitled “things I wrote down during OSBC”. It tuned out to be surprisingly popular, so I decided to try the same formula again.

Just as was the case two years ago these are presented chronologically. I wrote down a lot more than this, to be clear, but these were the most quote-worthy things. Also, as in 2009, some of them confirm things we already think about commercial open source (or in some cases data management), others were interesting ways of expressing old ideas:

“The next generation of computing is being led by users, rather than vendors.”
Jim Whitehurst

“The value of open source has moved from commoditization to innovation.”
…

Next Monday, May 16, I will be hosting session at the Open Source Business Conference in San Francisco focused on NoSQL, NewSQL and Beyond.

The presentation covers our recently published report of the same name, and provides some additional context on the role of open source in driving innovation in distributed data management.

Specifically, the presentation looks at the evolving influence of open source in the database market and the context for the emergence of new database alternatives.

I’ll be walking through the six core drivers that have driven the development …

If you happen to be around at this years LinuxTag 2011 in Berlin/Germany, you are invited to attend my short talk on MariaDB as a drop-in replacement for MySQL. The talk focusses on differences between MySQL Community Edition and MariaDB … Weiterlesen →

EMC launches Greenplum HD. DataStax releases Brisk. And more.

# EMC launched its Greenplum HD Hadoop distribution, with the support of Jaspersoft, Pentaho, and SnapLogic, among others.

# DataStax …

So I’ve been doing a fair number of automated load tests these past six months. Primarily with Sysbench, which is a fine, fine tool. First I started using some simple bash based loop controls to automate my overnight testing, but as usually happens with shell scripts they grew unwieldy and I rewrote them in python. Now I have some flexible and easily configurable code for sysbench based MySQL benchmarking to offer the community. I’ve always been a fan of giving back to such a helpful group of people – you’ll never hear me complain about “my time isn’t free”. So, let me know what you want in an ideal testing environment (from a load testing framework automation standpoint) and I’ll integrate it into my existing framework and then release it via the BSD license. The main goal here is to have a standardized modular framework, based on sysbench, that allows anyone to compare their server performance via repeatable tests. It’s fun to see …

Novell sold to Attachmate. Barnes & Noble throws the book at Microsoft. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca, and daily at Paper.li/caostheory
“Tracking the open source news wires, so you don’t have to.”

# Novell closed its acquisition by Attachmate and its patent sale to CPTN.

# Attachmate’s CEO discussed the company’s plans for SUSE Linux.

# Barnes & Noble …

Linuxtag is likely one of the oldest and largest Linux/OSS events in Germany. I remember having been there to represent SuSE Linux while it still took place at the University of Kaiserslautern, using tables and chairs from the lecture rooms as exhibition stands (this must have been around 1998 or 1999). This year it will take place in Berlin again, and the session schedule looks very promising. I'll be there from Wednesday till Friday and I feel that I will have a hard time deciding which presentations I should attend...

I'll be speaking about What's new in MySQL 5.5 on Friday, 13th of May, at 15:00. If you haven't updated to MySQL 5.5 yet, stop by to hear what new …