Big data management
Big data management is the organization, administration and governance of large volumes of both structured and unstructured data.. See complete definition.
New & Notable
Download: Why RDBMS Still Rules Database Roost
This exclusive 60-page guide explores why you shouldn’t get distracted by new DB technology, how Facebook is using a RDBMS to do the data slicing and dicing they can’t in Hadoop, and much more.
Big data management News
-
August 08, 2018
08
Aug'18
Confluent Platform 5.0 aims to mainstream Kafka streaming
Confluent Platform updates seek to bring data streaming with Apache Kafka to a wider audience. A new GUI and user-defined functions are part of the 5.0 release.
-
August 01, 2018
01
Aug'18
Alluxio adds connectors for multi-cloud data migration
Updated Alluxio open source storage software homes in on portability across multiple big data object stores. Applications access Alluxio as mountable file storage.
-
July 27, 2018
27
Jul'18
BigQuery ML moves machine learning into Google BigQuery
Google is enabling BigQuery users to build SQL-based machine learning models inside the cloud data warehouse via a BigQuery ML technology now out in beta.
-
July 25, 2018
25
Jul'18
Qlik-Podium acquisition aims to boost BI data management
With its acquisition of Podium Data, Qlik seeks to amplify its enterprise BI data management capabilities and raise the level of competition with Tableau and Power BI.
Big data management Get Started
Bring yourself up to speed with our introductory content
-
Apache Hive
Apache Hive is an open source data warehouse system for querying and analyzing large data sets that are principally stored in Hadoop files. Continue Reading
-
Labeled data brings machine learning applications to life
The types of data being collected for analytics use are increasing, but traditional structured data is a good match for machine learning. Gartner's Svetlana Sicular explains why. Continue Reading
-
GPU cloud tools take complexity out of machine learning infrastructure
While talk of AI on GPUs is abuzz, actually building a machine learning infrastructure remains a dark art. A startup's PaaS is looking to automate parts of the process. Continue Reading
Evaluate Big data management Vendors & Products
Weigh the pros and cons of technologies, products and projects you are considering.
-
Beyond the RDBMS: Data warehouse vs. data lake vs. data mart
There are many ways to store big data, but the choice of data warehouse vs. data lake vs. data mart comes down to who uses the data and how. Use this cheat sheet to compare. Continue Reading
-
eHarmony hooks up with Redis NoSQL database for hot storage
The Redis key-value store finds use in a system to match would-be romantic partners on dating site eHarmony, which employs a variety of NoSQL databases to make love click online. Continue Reading
-
Why Spark DataFrame, lazy evaluation models outpace MapReduce
Learn how the Spark DataFrame execution plan works and why its lazy evaluation model helps the processing engine to avoid the performance issues inherent in Hadoop MapReduce. Continue Reading
Manage Big data management
Learn to apply best practices and optimize your operations.
-
When to choose an S3 big data environment over HDFS storage
Selecting a storage service for big data in the cloud can be challenging. Expert David Loshin explains usage patterns that could lead organizations to Amazon Simple Storage Service. Continue Reading
-
IoT, edge computing spawn new security issues
As real-time big data increasingly hitches up to internet of things, edge computing power and fog nodes, a whole new layer of security threats emerges. Continue Reading
-
IT teams take big data security issues into their own hands
Data security needs to be addressed upfront in deployments of big data systems -- and users are likely to find they have to build some security capabilities themselves. Continue Reading
Problem Solve Big data management Issues
We’ve gathered up expert advice and tips from professionals like you so that the answers you need are always available.
-
Kubernetes container orchestration gets big data star turn
The new thing in big data is Kubernetes container orchestration. While it's still early, there are signs of activity, which are cited in this edition of the Talking Data podcast. Continue Reading
-
Seven steps to a successful data lake implementation
Flooding a Hadoop cluster with data that isn't organized and managed properly can stymie analytics efforts. Take these steps to help make your data lake accessible and usable. Continue Reading
-
Panera meets big data challenge of lunchtime operations
In the era of more and more digital orders, Panera Bread encountered big data challenges that led the restaurant chain to deploy a new cluster architecture with Hadoop, Spark and other technologies. Continue Reading