"New Breed" Database Extensibility

At present, I can think of at least 5 "new breed" database vendors that you allow you to extend their SQL language in some form or another:

Netezza
ParAccel
Kognitio
Greenplum (I think)
DATAllegro/Microsoft

Of course, the old guard is well-represented in this category as well - Oracle, DB2, SQL Server, Teradata, etc. all allow language extension via custom functions, plug-ins, etc.

I don't know enough about it yet to know, but I think that Greenplum and AsterData might also belong on this list due to their support for Map/Reduce.

It wasn't all that long ago (3 or 4 years) that most of these vendors didn't even support the full SQL standard, never mind compiled-code extensions to their SQL language. Oh, the possibilities.

Why I Think Industry Consolidation is Years Away

Those who know me personally know that I have an almost-annoying habit of frequently quoting movies. They won't be surprised, then, when I sum up my thoughts on the MS/DATAllegro acquisition by quoting Jules Winnfield (played by Samuel L. Jackson) from Pulp Fiction:

Personality goes a long way.

I won't claim to be intimately familiar with DATAllegro - I was just getting to know them, after all - but if ever there was a database company whose personality fit with Microsoft's personality, they were it. Proprietary hardware? Nope. Radical new approach to data management that requires jumping mental hurdles? Nope. Established concepts and existing products that can be mimicked? Yup. Willingness to build one version, throw it out and get things right on the third try? Yup.

Those were all Microsoft traits I was listing there. The fact that they fit DATAllegro too, well... you get the point.

Now, as for what this acquisition means for the rest of the industry... Contrary to what others (1, 2) have said, I see no reason to think that consolidation in the database industry is imminent. Why? Well, once again, I think Jules had it right. It's all a matter of personality. Let's start with the potential acquirers.

The Potential Buyers (or Not)


Teradata has spent an awfully long time thinking, believing and preaching that they're the be-all end-all of data warehousing. Acquiring a new upstart vendor who did things differently would mean... well, maybe they weren't all that. Oops. I don't see Teradata realizing that until it's too late.

Oracle people will tell you that benchmarks are all marketing lies and that their system will outperform all others if properly configured and tuned. So why would they need to add anything to it? That aside, rumor has it that attempts are being made inside Oracle to build their own MPP data warehousing solution, so acquiring another company would mean first admitting defeat. I don't exactly see that fitting with Oracle's personality, at least as far as I know it.

Also, Oracle has a reputation for being a bottom-feeder when it comes to acquisitions. I wouldn't be surprised if they bought somebody 3-5 years from now when the small companies falter just for the cheap IP, but I doubt they'll buy anybody sooner than that for truly competitive purposes.

IBM already has something that competes with Teradata, and at least according to Gartner's magic quadrant does so more effectively than Oracle. Why they would add anything disruptive to that I have no idea. Backing an open-source data warehouse project would fit IBM's personality better than acquiring another database vendor. (I'm quasi-serious... )

Sybase, the red-headed step-child of the industry, already has established row- and column-oriented databases. If they follow their regular pattern they're more likely to develop the next generation of data warehousing products - e.g. their analytics appliance - and then have somebody copy it than they are to go buy another database vendor and integrate that into their product suite.

The Potential Sellers (or Not)


Now let's look at some of the potential acquisition targets.

Dataupia, which at least one analyst thinks would be a better fit for MS than DATAllegro, is led by "the father of data warehouse appliances", Foster Hinshaw. I dunno about anyone else who's had the pleasure of meeting Foster, but I don't see him selling to anyone. Especially not Oracle or Teradata.

Vertica has a similarly strong human personality element. Mike Stonebraker and the other guys at Vertica are really convinced that column-oriented databases are the future of analytics, and they're out to prove it. Maybe after they've done so they'll sell it to somebody else who can manage what they've built, but I don't get the "we're a small scrappy start-up hoping to get bought" vibe from anybody over there. Not for a second. To the contrary, I get a more Blues Brother's-esque "we're on a mission from God" kinda feel. Needless to say I don't see them going anywhere.

EXASOL, which uses a custom OS kernel, produces a memory-based database and is headquartered in Germany. Not a likely acquisition target, I don't think.

Calpont, from what little I know of them, is too new and different to fit nicely with any of the potential acquirers I can think of. I could be dead wrong about this one though, I admit, because a) I don't know much about them and b) sometimes new and different is more attractive rather than less. Who knows.

The Potential Sellers (Really)


Now, all that said, there are a few companies that I can see being acquired. I dunno by who, but...

ParAccel has a few strong personalities of its own that would make appealing additions to an organization looking to build credibility. The two different modes of operation allowed by the product – stand-beside and stand-alone – make acquisition by both other database companies (that could use an accelerator) and non-database companies (that could use a high-speed database) sensible.

Greenplum is, in my opinion, Teradata re-warmed, which is probably not coincidence given the bio of their Chief Architect. Though I could see somebody snapping them up a la MS/DATAllegro and using them to extend another existing database into the MPP realm, I never got the sense that the different layers of the database were as well separated with Greenplum as they are with DATAllegro. As such I'm not sure it'd be as easy to integrate Greenplum as I think it will be with DATAllegro, which in turns means they may not be as attractive to potential suitors as DATAllegro. But it's possible nonetheless.

Creative Ideas


Maybe I've just had too much time on my hands, but there do seem to be some possibilities for interesting product combinations involving database companies that might lead to acquisitions. For example...

EnterpriseDB provides Oracle compatibility with a PostgreSQL base, and Greenplum provides MPP scalability with a PostgreSQL base. Hmmm...

Netezza and Kognitio might go nicely together, given Kognitio's service background and my belief that Netezza's moving to blades (which Kognitio has already been through).

ParAccel plus Sun plus MySQL would make an interesting combination. It would provide a good MySQL scalability option, and we all know Sun loves to create ways to sell hardware...

Parting Thoughts


In summary: I don't see consolidation as imminent in the database industry. The pieces of the industry puzzle that are currently available just don't seem to fit together in enough sensible ways. One or two acquisitions here and there? Sure. Enough to constitute a consolidation? I don't think so. At least not for a few years, at which point some of the companies I've mentioned will be available for $1.99 and a bag of chips, simply as a matter of attrition.

Now, I must admit that it's possible that acquisitions may be made that don't make any sense, and that enough of those could result in an effective consolidation. Desperate companies sometimes do desperate things. I don't see any of the companies with enough money to buy another as being desperate enough to do anything dumb, however. At least not yet.

And I must also admit that the odds are against me. There are too many new database companies on the market right now, and not all of them can win. At least a couple of acquisitions in the next few years seems inevitable, statistically. But long term my money's on companies faltering and being fire-sold rather than companies being snapped up in any kind of rational consolidation. Especially given that I think that there's probably time before that happens for one or two more companies with new and different ideas to arrive and shake things up. InfoBright, for example, is sufficiently different to make you stop and re-think. More things of that nature are likely, I think.

Whether I'm right or wrong, however, it's been fun to think about. And it'll be even more fun to watch it unfold.

Belated Thoughts on the DATAllegro Acquisition

Ok, so, my previously announced comeback may have been a bit premature. Live and learn. But that doesn't mean that I haven't been thinking or reading about the acquisition of DATAllegro by Microsoft.

In short, I think this acquisition was a master stroke by Microsoft. Not only does it put MS in a much better position - specifically versus Oracle - it keeps DATAllegro out of the hands of Oracle. Given the modularity of the DATAllegro system, I think they probably represented the fastest way for Oracle to make the leap to MPP. And unless the folks at DATAllegro have gone out of their way to mislead me, I expect the DATAllegro/MS integration will happen fast enough to cause Oracle some serious heartburn.

It seems, then, that MS has killed two birds with one stone.

No, actually, I think they may have killed three birds. Not only has MS put itself in a much better position (1 bird) while simultaneously hurting Oracle (2 birds), it has left everyone else with no other options to boot (3 birds). I for one don't see consolidation in the database industry as a given, and I especially don't believe that it's "imminent", as others have predicted. So the icing on the cake may be that by taking DATAllegro off the market, MS may have left the other vendors with nowhere to turn.

Why? Tune in tomorrow for my thoughts on that. :-)

Microsoft to Acquire DATAllegro

As announced here and here, Microsoft is acquiring DATAllegro. Guess I called that one right... though I 'spose my time frame was a bit off.

One key quote:

“Integrating DATAllegro’s nonproprietary hardware platform and flexible software architecture into Microsoft SQL Server will provide customers with the strongest offering in the market,” said Stuart Frost, CEO of DATAllegro.


I look forward to seeing what "integrating into Microsoft SQL Server" means.

Playing Devil's Advocate: DATAllegro vs. Netezza

This recent article by DATAllegro CEO Stuart Frost is well worth reading (and not just because they quote me in it). If only because I love a good debate, I think there are a few counter-points worth making though.

Non-Proprietary Hardware


I love this section, particularly the quote from Intelligent Enterprise. Saying that DATAllegro has an "open, hardware-independent approach" reminds me of Henry Ford's opinion on available colors for the Model T: "You can have it any color you want as long as it's black". Yes, DATAllegro uses commodity hardware. Don't mistake that to mean that you have any say in what hardware will go into your DATAllegro system though.

Non-Proprietary Software


This section cracks me up too. If DATAllegro's software isn't proprietary, then what are their customers paying for?

Scalability


This section leaves me scratching my head a bit. Ok, DATAllegro systems scale to 400TB. Do they function well at that size, and what are they used for? For all we know, Netezza may be doing ad-hoc analysis at 200TB, while DATAllegro may be doing simple archiving at 400TB. I'm not sure the raw data size is ultimately what's important here.

Distributed DW


This section should get top billing. No, not because they quote me in it, but because this is where DATAllegro is set to clean house. Ok, so I guess that's an endorsement, not a counterpoint, but this concept will be huge, mark my words.

Parting Thoughts


Nit-picking aside, I think that it's really great that Mr. Frost is writing posts like this. They're admittedly biased, and a bit cheeky at times, but it's good to get some informed, inside perspective. I think DATAllegro would be better served to focus on their obvious strengths than to thumb-wrestle competitors on line items, but the verbal sparring is certainly more entertaining. As such, I eagerly look forward to more.