Emerging database technologies: How Hadoop and MapReduce compare

Mark Whitehorn, Co-Founder, PenguinSoft Consulting Ltd.

I’m hearing a lot about Hadoop and MapReduce, but I’m still a little unclear as to how those two emerging database technologies relate to each other. Can you clarify?

Hadoop is a framework for distributed data and computing. In other words, it’s excellent for storing large sets of semi-structured data. (Whether a collection of semi-structured data can truly be considered to be a “set” is an interesting question, but you can probably guess what I mean). The data can be stored redundantly, so the failure of one disk doesn’t result in data loss. Hadoop is also very good at distributed computing – processing large sets of data rapidly across multiple machines.

MapReduce is a programming model for processing large sets of semi-structured data. What is a programming model, you ask? It’s a way of approaching and solving a given problem. For example, in a relational database, we perform queries using a set-based language – i.e., SQL. We tell the language the result we want and leave it to the system to work out how to produce it. With a more traditional language (C++, Java), we tend to spell out, step by step, how to solve the problem. Those are two different programming models. MapReduce is yet another.

MapReduce and Hadoop are independent of each other but, in practice, work well together – hence we often find them mentioned in the same breath.

View the next item in this Essential Guide: Hadoop Summit 2013: Where is Apache Hadoop heading? or view the full guide: Complete guide to Hadoop technology and storage

There are Comments. Add yours.

 
TIP: Want to include a code block in your comment? Use <pre> or <code> tags around the desired text. Ex: <code>insert code</code>

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
Sort by: OldestNewest

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to: