Jeff Hawkins’ Real-Time Big Data Bet

November 29th, 2012

Jeff Hawkins’ new company focuses on analyzing streaming data for patterns, rather than mining old datasets:

Data storage companies like EMC and Hewlett-Packard thrive on storing massive amounts of data cheaply. Data analysis companies including Microsoft, I.B.M., and SAS fetch that data and crunch the history to find patterns. They and others rely on both the traditional relational databases from Oracle, and newer “unstructured” databases like Hadoop.

Much of this will be a relic within a few years, according to Mr. Hawkins. “Hadoop won’t go away, but it will manage a lot less stuff,” he said in an interview at Numenta’s headquarters in Redwood City, Calif. “Querying databases won’t matter as much, as people worry instead about millions of streams of real-time data.” In a sensor-rich world of data feeds, he is saying, we will model ourselves more closely on the constant change that is the real world.

Interesting premise. I think this sort of thing is going be one of the next big frontiers for the technology industry.