The Channel logo


By | Phil Manchester 1st February 2008 21:15

Gurus answer MapReduce young turks

Database blues and grays

The two database gurus whose blog produced a storm of protest over their criticism of Google's MapReduce technology last month have hit back with a robust defense.

In their latest joint posting Michael Stonebraker and David DeWitt have respond to four specific issues raised by their critics: that MapReduce is not a database and, therefore, should not be judged as such, that MapReduce is scalable, that MapReduce is cheap, and - finally - that the two are merely "the old guard" defending traditional database management (DBMS) technology.

They claim that the original critique never said that MapReduce is a database - only that it is capable of performing some of the same tasks - specifically the analysis of large datasets. It is, therefore, legitimate to make the comparison between the two and conclude that "most things that are possible in MapReduce are also possible in a SQL engine".

On the scalability of MapReduce, Stonebraker and DeWitt note that the jury is still out on this and "as far as we are aware there are no published papers that study the scalability of MapReduce in a controlled scientific fashion". They also dismiss the claim that DBMS is expensive compared to MapReduce - pointing out open source alternatives to expensive commercial products.

Finally, they admit to being "gray beards" who "have seen a lot of ideas come and go" but add that gray beards and young turks should not be adversaries.

The initial response to Stonebraker and DeWitt's defense indicates that the argument looks set to continue. While a few commenters have reacted positively, the majority remain unconvinced.®

comment icon Read 5 comments on this article alert Send corrections


Frank Jennings

What do you do? Use manual typwriters or live in a Scottish croft? Our man advises
A rusty petrol pump at an abandoned gas station. Pic by Silvia B. Jakiello via shutterstock

Trevor Pott

Among other things, Active Directory needs an overhaul
Baby looks taken aback/shocked/affronted. Photo by Shutterstock

Kat Hall

Plans for 2 million FTTP connections in next four years 'not enough'
Microsoft CEO Satya Nadella


League of gentlemen poster - Tubbs and Edward at the local shop. Copyright BBC
One reselling man tells his tale of woe