Big data management strategies and best practices are still evolving, but joining the big data movement has become an imperative for companies across a wide variety of industries. This guide delves into the experiences of early-adopter companies that have already deployed big data applications and technologies. IT professionals, C-level executives and industry analysts offer insights into what strategies work on big data projects and how to best integrate big data management initiatives with related processes such as data warehousing, data governance and data analytics.
The following stories explore the steps these companies took to set up big data systems and to update their approaches as needed. Readers will find practical information on implementing big data strategies, mixing Hadoop clusters and conventional data warehousing tools, incorporating big data analytics into the process and translating big data ideas into successful deployments.
1Big data strategy-
Advertising firm attracts clients with big data strategy
The search advertising company adMarketplace processes billions of ad requests daily in near real time using a pay-per-click platform. Due partly to the high level of data customization it offers to advertisers, adMarketplace processes 100 gigabytes of data per hour. The first article below explains how the company implemented a platform combining a traditional data warehouse and a NoSQL database to power the big data environment that feeds its search syndication system. Other stories in this section offer more insights into managing and using big data and how it fits into the data warehousing and data governance process.
Online advertising company adMarketplace uses a mix of NoSQL and SQL databases in a "big data" environment that feeds its search syndication system. Continue Reading
Wikibon.org analyst Jeff Kelly has a dire message for organizations that think they can ignore "big data": Your rivals might leave you in the dust. Continue Reading
As "big data" systems steal into organizations, the enterprise data warehouse is often depicted as a dinosaur. But it may not be doomed to extinction. Continue Reading
Effective governance can help companies get the most out of their "big data" environments. But at this point, there's no formula for how to do that. Continue Reading
2Successful big data projects-
Sprint's big data project highlighted at IBM conference
At IBM's most recent Information on Demand conference, an executive from Sprint presented information on the telecommunications company's efforts to harness big data to gain new insights on how customers are using its network. An IBM vice president also offered guidance for other companies interested in tackling big data initiatives. Below, find related articles that explore IBM's own use of big data tools and provide advice on developing and implementing big data strategies.
An IBM VP and a user from Sprint took to the stage at the vendor's Information on Demand conference to offer advice on how to make sense of big data. Continue Reading
Building a successful big data strategy takes discipline, imagination and a CIO who can work with the business. Here's how to do it. Continue Reading
3Big data tools-
Managing online data: comScore explains big data analytics move
In an effort to improve upon its big data analytics program, Web analytics and customer intelligence services provider comScore Inc. moved from one Hadoop distribution to a competing platform. The lead article below explores the reasons why and offers advice on big data analytics and management best practices. The other related stories offer additional insight and information on Hadoop and other big data technologies.
IT officials at Web intelligence firm comScore Inc. explain why they switched to a new Hadoop distribution for managing its vast pool of online data. Continue Reading
In a video interview, TechTarget's Wayne Eckerson discusses the benefits and challenges of deploying Hadoop-based systems in 'big data' environments. Continue Reading
Various software vendors have begun offering connectors designed to help users bridge the gap between Hadoop clusters and relational databases. Continue Reading
Many organizations are eyeing Hadoop, MapReduce and NoSQL databases for managing "big data." But there are issues to consider before using those technologies in place of a traditional data warehouse. Continue Reading
4Data warehouses & big data-
Big data applications create new opportunities -- and challenges
Catalina Marketing Corp., which tracks and analyzes the shopping activities of consumers, was managing huge data sets long before big data became a C-suite phrase. In the first article in this section, Catalina's now-retired CIO offers advice to organizations that are launching big data management and analytics strategies, highlighting the importance of using distributed systems to lighten the load on data warehouses. Other users and analysts weigh in as well. The related stories below further explore ideas for effectively combining data warehousing and big data management technologies.
IT pros and analysts offer guidance on how to cope with the complexities of "big data" installations in data warehouses and alternative data stores. Continue Reading
To make the most of different data assets, analysts say data warehouses and big data systems should be blended into logical or hybrid architectures. Continue Reading
The flood of "big data," particularly unstructured information, is pushing organizations to look beyond traditional data warehousing. That creates new opportunities but also new challenges. Continue Reading
Michael Whitehead, CEO and founder of WhereScape Software, discusses "big data" management challenges, gives tips on overcoming those obstacles and explains WhereScape's data warehousing strategy. Continue Reading
Big data terminology
Terms like "big data" are used in a variety of contexts. Check out the technical definitions here.