Essential Guide

Complete guide to Hadoop technology and storage

A comprehensive collection of articles, videos and more, hand-picked by our editors

Hadoop Summit 2013: Where is Apache Hadoop heading?

In a podcast, SearchDataManagement News Editor Jack Vaughan shares his thoughts and observations on Hadoop developments from the Hadoop Summit.

Hadoop increasingly is becoming a key component of big data analytics applications, but it also has become much more than a single, uniform technology, according to SearchDataManagement News Editor Jack Vaughan, who covered the Hadoop Summit 2013 in San Jose, Calif. "The biggest thing I saw was that Apache Hadoop was moving beyond its original definition," Vaughan said in a podcast Q&A about the conference. "It is a lot about Java, and it is a lot about redoing data architectures as we have known them."

Vaughan said that with the development of related technologies such as Hive, Hadapt, Impala, Sqrrl, HBase, Knox and Pig, "Hadoop has spawned a gazillion open source tools that really make what you could call an ecosystem." And with a new resource management component called YARN set to supplement the Hadoop 2.0 release, users will be offered more flexibility on file systems and freedom from Hadoop's associated MapReduce programming framework. That's broadening the concept of what Hadoop is, Vaughan reports. "Just like Java came to stand for more than the language, I think Hadoop is coming to stand for a whole style of programming," he said.

As far as the enterprise story for Hadoop goes, Vaughan observed that a lot of people are hoping it eventually will be an alternative to the conventional data warehouse, at least in some cases. "We think it'll be a complement or a supplement, but sometimes it may be a replacement," he said. "It's fairly inexpensive to get going, but it is a very technical undertaking. So most of this stuff is still experimental."

In the 6-minute podcast, Vaughan further discussed his experiences at the Hadoop Summit 2013. Listeners will


This was first published in July 2013



Find more PRO+ content and other member only offers, here.

Essential Guide

Complete guide to Hadoop technology and storage
Related Discussions

Emma Preslar asks:

What's the status of Hadoop usage in your organization?

1  Response So Far

Join the Discussion

1 comment


Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to: