New & Notable
Big data management News
June 18, 2018
Hortonworks now supports Google Cloud Storage and has also broadened cloud deals with Microsoft and IBM, aiming to increase cloud uses of its big data platform.
April 17, 2018
Data warehouse pioneer Teradata looks to ease IoT data analysis with capabilities that address skills gaps on time series analytics techniques, which are coming more to the fore.
March 30, 2018
It wasn't the first in the cloud computing space, but Oracle is all in now. Key to the effort is a new Autonomous Database service, initially available for data warehousing uses.
March 21, 2018
Big data vendors and users are looking to Kubernetes-managed containers to help accelerate system and application deployments and enable more flexible use of computing resources.
Big data management Get Started
Bring yourself up to speed with our introductory content
To create a cloud payment processing system, Global Payments first had to deploy a data lake in the Google Cloud. Getting quick user feedback was another early step. Continue Reading
Hadoop is an open source distributed processing framework that manages data processing and storage for big data applications running in clustered systems. Continue Reading
An entity relationship diagram (ERD), also known as an entity relationship model, is a graphical representation of an information system that depicts the relationships among people, objects, places, concepts or events within that system. Continue Reading
Evaluate Big data management Vendors & Products
Weigh the pros and cons of technologies, products and projects you are considering.
Learn how the Spark DataFrame execution plan works and why its lazy evaluation model helps the processing engine to avoid the performance issues inherent in Hadoop MapReduce. Continue Reading
Relational databases may have hit a wall of late, but the SQL query engine seems poised for wider growth. Starburst, a retro startup of sorts, is among those looking to take it wider still. Continue Reading
Data journalism reporters need tools that deliver quick context for stories on deadline. A data collaboration platform from data.world helps the Associated Press meet such needs. Continue Reading
Manage Big data management
Learn to apply best practices and optimize your operations.
As real-time big data increasingly hitches up to internet of things, edge computing power and fog nodes, a whole new layer of security threats emerges. Continue Reading
Data security needs to be addressed upfront in deployments of big data systems -- and users are likely to find they have to build some security capabilities themselves. Continue Reading
New technologies challenge data professionals, but taking a step back helps with hurdles. In this interview, consultant William McKnight takes a measured look at data streaming, GDPR and AI. Continue Reading
Problem Solve Big data management Issues
We’ve gathered up expert advice and tips from professionals like you so that the answers you need are always available.
The new thing in big data is Kubernetes container orchestration. While it's still early, there are signs of activity, which are cited in this edition of the Talking Data podcast. Continue Reading
Flooding a Hadoop cluster with data that isn't organized and managed properly can stymie analytics efforts. Take these steps to help make your data lake accessible and usable. Continue Reading
In the era of more and more digital orders, Panera Bread encountered big data challenges that led the restaurant chain to deploy a new cluster architecture with Hadoop, Spark and other technologies. Continue Reading