UPDATE 2011-03-15 12:50 Pacific – This post may already be out of date, am testing with a fresh snapshot of the source and will update accordingly. (Thanks, Andy)

Several weeks ago at Percona Live 2011, I presented on HandlerSocket. Due to time constraints, I had to omit some more in-depth discussions in favor of being able to present a broad overview. One of those discussions was about how, exactly, HandlerSocket does not play nicely with auto increment columns. So I wanted to take the time here to show how they behave together versus how we might expect.

Let’s take, for example, a standard setup using a standard SQL_MODE (not using anything like …

[shameless plug] I’ll be at the next SF MySQL Meetup giving a talk on HandlerSocket called “NoSQL in MySQL: HandlerSocket plugin demystified”. We’ll ask, and answer, the following questions: What is HandlerSocket? Where does HandlerSocket fit in my application stack? Why would I want to use HandlerSocket? How do I use Handlersocket? We’ll walk through [...]

On March 29th, I’ll be giving a webinar whose title is “Understanding HandlerSocket – A NoSQL PlugIn For MySQL”. This is a continuation and extension of the talk I gave during the Percona Live Event in San Francisco back in February. We’ll ask, and answer, the following questions:

• What is HandlerSocket?
• Where does HandlerSocket fit in my application stack?
• Why would I want to use HandlerSocket?
• How do I use Handlersocket?

Description:

http://www.percona.com/webinars/2011-03-29-understanding-handlersocket-a-nosql-plugIn-for-mysql/

To register:

…

Hi Folks,

Now that we’re blogging again I thought I might as well continue to do so.

Today we’re reading data from MongoDB with Pentaho Data Integration.  We haven’t had a lot of requests for MongoDB support so there is no step to read from it yet.  However, it is surprisingly simple to do with the “User Defined Java Class” step.

For the following sample to work you need to be on a recent 4.2.0-M1 build.  Get it from here.

Then download mongo-2.4.jar and put it in the libext/ folder of your PDI/Kettle distribution.

Then you can read from a collection with the following “User Defined Java Class” code:

import java.math.*;
import java.util.*;
import …

A special extended edition of Tech Messages for 2011-01-27 through 2011-02-02:

• NetApp File Copy | A NetApp Technical Diary
  There's a lot of ways to copy files on a NetApp Filer.
• NoSQL at Netflix
• Netflix Performance on Top ISP Networks

…

Hudson developers vote for Jenkins. SugarCRM turns cash flow positive. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca, and daily at Paper.li/caostheory
“Tracking the open source news wires, so you don’t have to.”

# The Hudson developer community voted overwhelmingly to rename the project Jenkins, and will continue without Oracle.

# SugarCRM turned cash flow positive in 2010 as billings increased 52% year on year.

# BonitaSoft announced the release of version 5.4 of Bonita Open Solution.

# WANdisco …

When MySQL AB bought Sun Microsystems in 2008 (or did Sun buy MySQL?), most of the MySQL team merged with the existing Database Technology Group (DBTG) within Sun. The DBTG group had been busy working on JavaDB, Postgres and other DB related projects as well as 'High Availability DB' (HADB), which was Sun's name for the database formerly known as Clustra.

Clustra originated as a University research project which spun out into a startup company and was then acquired by Sun around the era of dot-com. A number of technical papers describing aspects of Clustra's design and history can be found online, and it is in many ways similar to Ndb Cluster, not just in their shared Scandinavian roots. Both are shared-nothing parallel databases originally aimed at the Telecoms market, supporting high availability and horizontal scalability. Clustra has an impressive feature set and …

Following a previous post using MySQL as a NoSQL store with the native Handler Interface, some  refactoring have now been coded in MariaDB-5.3 as described in the following worklog   On concurrency,  doing less work in HANDLER READ to put more caching on HANDLER OPEN is credited with a 7% performance gain.
Source code via bzr branch lp:~maria-captains/maria/5.3-handler
More, HANDLER READ can now be used with prepared statement to save precious CPU cycles on parsing.    

handler t1 open;
prepare stmt from 'handler t1 read a=(?)';
set @a=1000;
execute stmt using @a;
deallocate prepare …

I often wonder what's behind the increased trend behind Hadoop and other NoSQL technologies. I realize if you're Yahoo that such technology makes sense. I don't get why everyone else wants to use it.

Reading Stephen O'Grady's self-review of his predictions for 2010 for the first time gave me some insights into how such people think:

Democratization of Big Data

Consider that RedMonk, a four person analyst shop, has the technical wherewithal to attack datasets ranging from gigabytes to terabytes in size. Unless you’re making institutional money, budgets historically have not permitted this. The tools of Big Data have never been more accessible than they are today.

read more