This content is part of the Essential Guide: Complete guide to Hadoop technology and storage
News Stay informed about the latest enterprise technology news and product updates.

Hadoop Summit 2013: Where is Apache Hadoop heading?

In a podcast, SearchDataManagement News Editor Jack Vaughan shares his thoughts and observations on Hadoop developments from the Hadoop Summit.

Hadoop increasingly is becoming a key component of big data analytics applications, but it also has become much more than a single, uniform technology, according to SearchDataManagement News Editor Jack Vaughan, who covered the Hadoop Summit 2013 in San Jose, Calif. "The biggest thing I saw was that Apache Hadoop was moving beyond its original definition," Vaughan said in a podcast Q&A about the conference. "It is a lot about Java, and it is a lot about redoing data architectures as we have known them."

Vaughan said that with the development of related technologies such as Hive, Hadapt, Impala, Sqrrl, HBase, Knox and Pig, "Hadoop has spawned a gazillion open source tools that really make what you could call an ecosystem." And with a new resource management component called YARN set to supplement the Hadoop 2.0 release, users will be offered more flexibility on file systems and freedom from Hadoop's associated MapReduce programming framework. That's broadening the concept of what Hadoop is, Vaughan reports. "Just like Java came to stand for more than the language, I think Hadoop is coming to stand for a whole style of programming," he said.

As far as the enterprise story for Hadoop goes, Vaughan observed that a lot of people are hoping it eventually will be an alternative to the conventional data warehouse, at least in some cases. "We think it'll be a complement or a supplement, but sometimes it may be a replacement," he said. "It's fairly inexpensive to get going, but it is a very technical undertaking. So most of this stuff is still experimental."

In the 6-minute podcast, Vaughan further discussed his experiences at the Hadoop Summit 2013. Listeners will


Dig Deeper on Hadoop framework

Join the conversation

1 comment

Send me notifications when other members comment.

Please create a username to comment.

What's the status of Hadoop usage in your organization?