News, Analysis and Opinion for Data Management

February 26, 2019 26 Feb'19

Hazelcast grid tunes for data scalability tradeoffs

An in-memory data grid (IMDG) from Hazelcast lets designers tune subsystems to support consistency over availability, or the reverse, depending on what designers want.

February 14, 2019 14 Feb'19

Originators form group to boost Presto SQL query engine

The Presto engine arose as an alternative to Hive for big data queries. Now, the Presto Software Foundation has formed to promote the SQL query software's virtues.

February 11, 2019 11 Feb'19

Web integration platform eases way to machine learning models

StoryFit data scientists employ machine learning algorithms to gauge film script scenarios' prospects. They use Import.io tools to make data preparation easier.

February 01, 2019 01 Feb'19

Open source cloud databases battle software 'strip mining'

Cloud giants like AWS have adopted open source databases, causing Confluent, MongoDB and others to guard their assets the best way they know how: licensing.

January 22, 2019 22 Jan'19

New Teradata CEO pursues cloud-based architecture

Cloud architecture, analytics and AI data processing are top innovation priorities for new Teradata CEO Oliver Ratzesberger. He talks about his goals in this Q&A.

January 21, 2019 21 Jan'19

Data.gov shutdown shows limits of open data

The Data.gov shutdown shows that, as open data can be turned off, data professionals may need to consider alternative sources for the kinds of data the government offers.

January 15, 2019 15 Jan'19

Cloudera and Hortonworks combo to push CDP, machine learning

Two wunderkinds of Hadoop have formalized their merger. Cloudera and Hortonworks say they will place special focus on AI as they chart the stand-alone vendor's future.

January 10, 2019 10 Jan'19

IBM Weather Channel location data use spurs privacy concerns

IBM CEO Ginni Rometty pushed real-time weather data mining for travel and other uses, even as the Los Angeles city attorney is suing IBM's Weather Company unit over its sharing of location data with business partners.

December 28, 2018 28 Dec'18

Data management trends for 2019: Governance, DataOps, cloud

Better data governance, increased cloud use and wider DataOps adoption head the list of trends for data management teams to plan for in 2019, IT analysts say.

December 18, 2018 18 Dec'18

Datawatch Swarm on path to combine data prep, analytics

Datawatch plans to add analytics and data visualization tools to its Swarm data preparation platform, starting with integration capabilities in a Swarm 2.2 release.

December 14, 2018 14 Dec'18

Data companies vie to fill spots in AWS cloud data lineup

Third-party vendors that offer data platforms to AWS users tout hedges against cloud lock-in. But they must both compete and collaborate with the cloud leader.

November 30, 2018 30 Nov'18

Amazon Timestream, QLDB aim to grab more DBMS users for AWS

Built-for-purpose databases target general ones, especially in the cloud. At re:Invent 2018, AWS added time-series and transaction ledger databases to expand its line.

November 27, 2018 27 Nov'18

Microsoft Azure SQL Database and Oracle 19c start to rev

A new Microsoft Azure SQL Database Managed Instance service seeks to span the gap between cloud and on-premises systems. Meanwhile, Oracle also has cloud plans of the data kind.

November 06, 2018 06 Nov'18

IBM-Red Hat deal highlights changes due in data processing

The IBM acquisition of Red Hat marks a watershed in computer architecture. The duo says it can rebuild data applications in new ways. This news analysis explores what's coming.

October 12, 2018 12 Oct'18

MarkLogic Data Hub Service aims to ease cloud use of NoSQL DBMS

MarkLogic rolled out a cloud-service version of its NoSQL database management system, a move designed to make the technology more cost-effective for cloud users.

October 04, 2018 04 Oct'18

Cloudera-Hortonworks merger narrows Hadoop users' options

Hadoop users will have fewer choices as big data rivals Cloudera and Hortonworks unite. But the new company may be more competitive with AWS and Google.

September 26, 2018 26 Sep'18

Mining equipment maker uses BI on Hadoop to dig for data

BI on Hadoop is still new, but moving BI to data is trending. A data scientist working with IoT data at Komatsu sees the importance of getting big data to the right people.

September 13, 2018 13 Sep'18

Containers key for Hortonworks alliance on big data hybrid

Hortonworks is joining with Red Hat and IBM to work together on a hybrid big data architecture format that will run using containers both in the cloud and on premises.

September 07, 2018 07 Sep'18

Big data tooling rolls with the changing seas of analytics

Hadoop data tooling is expanding. A view holds that Hadoop is moving from alternate data warehousing to a full-fledged big data analytics offering.

September 04, 2018 04 Sep'18

Graph processing gives credit analysis firms an edge

A graph database startup's parallel loading, processing and querying combine to deliver real-time data for fintech firms that offer fast credit evaluations online.

August 08, 2018 08 Aug'18

Confluent Platform 5.0 aims to mainstream Kafka streaming

Confluent Platform updates seek to bring data streaming with Apache Kafka to a wider audience. A new GUI and user-defined functions are part of the 5.0 release.

July 19, 2018 19 Jul'18

Focus, scope and spotting opportunity are key to role of CDO

Chief data officers and experts see the CDO role as changing to a more strategic orientation -- especially finding key opportunities in vast troves of data.

July 16, 2018 16 Jul'18

Chief data officer role: Searching for consensus

The chief data officer role is about many things -- regulations, innovation, AI and more. Consultant Randy Bean discussed the matter ahead of an MIT symposium on the topic.

July 02, 2018 02 Jul'18

Hadoop data governance services surface in wake of GDPR

GDPR influence is touching a Hadoop big data world that was immune to many privacy considerations until now. This podcast features the rise of Hadoop data governance for data lakes.

June 27, 2018 27 Jun'18

MongoDB 4.0, Stitch aim to grow NoSQL apps in cloud, on-prem

NoSQL vendor MongoDB upgraded its database software with ACID support, while also releasing a serverless platform intended to simplify application development.

June 25, 2018 25 Jun'18

Hadoop data lake architecture tests IT on data integration

Hortonworks users talk about building Hadoop data lakes to support new applications -- and the challenges their teams face on ingesting and refining data for end users.

June 18, 2018 18 Jun'18

Hortonworks cloud options grow via Google, Microsoft, IBM

Hortonworks now supports Google Cloud Storage and has also broadened cloud deals with Microsoft and IBM, aiming to increase cloud uses of its big data platform.

March 21, 2018 21 Mar'18

Kubernetes gains momentum in big data implementation process

Big data vendors and users are looking to Kubernetes-managed containers to help accelerate deployments and enable more flexible use of computing resources.

March 15, 2018 15 Mar'18

Streaming tool from StreamSets eyes data in motion for GDPR

StreamSets software for inspecting big data brings governance to data in motion. Such capabilities may find more use as the European Union's GDPR deadline looms.

February 22, 2018 22 Feb'18

Google TPUs open up on cloud; LinkedIn intros Hadoop Dynamometer

In big data news, we find Google TPUs, or Tensor Processing Units, offered as a cloud service, while LinkedIn is open sourcing a Hadoop test simulator called Dynamometer.

February 16, 2018 16 Feb'18

MongoDB 4.0 takes ACID transactions to multi-document level

MongoDB is taking a deeper step into SQL-style processing waters with a 4.0 update that brings increased support for ACID-compliant transactions to its NoSQL database.

January 03, 2018 03 Jan'18

Apache Hadoop 3.0 goes GA, adds hooks for cloud and GPUs

Is this the post-Hadoop era? Not in the eyes of Hadoop 3.0 backers, who see the latest update to the big data framework succeeding in machine learning applications and cloud systems.

September 26, 2017 26 Sep'17

Bank sees ETL processes evolve from IT to front-line users

ETL jobs -- once the sole province of IT -- take on a new form as data wrangling and self-service gain greater traction with business users of analytics.

July 24, 2017 24 Jul'17

Chief data officer jobs call for nurturing data ethos in companies

In many organizations, chief data officer jobs centered on defense against risk are giving way to ones emphasizing innovation. To do so, CDOs must nurture a data culture, MIT panelists said.

September 15, 2016 15 Sep'16

HPE sells Vertica analytics, thanks to the growth of open source software

HPE is paring down its software holdings, including analytical database software in the Vertica line and other big data tools. A sale to Micro Focus is due to close next year, leaving users in some limbo for now.

March 25, 2016 25 Mar'16

Unstructured data is a misnomer

Nowadays, the term unstructured data pops up everywhere. It owes its popularity for a large part to the success of big data, to successful technologies such as NoSQL and Hadoop, and to formats such ...

January 29, 2016 29 Jan'16

Data quality metrics a governance must, managers say

Data governance managers who spoke during an online conference said that tracking business-oriented metrics on data quality improvement is a key to success in governance efforts.

July 02, 2015 02 Jul'15

Convergence of Data Virtualization Servers and SQL-on-Hadoop Engines?

Hadoop has become a popular and powerful platform for data storage and data processing. Data stored in Hadoop can be used by a wide range of applications and tools and for a wide range of use ...

June 04, 2014 04 Jun'14

Apache Spark goes 1.0, looks to improve on MapReduce performance

The Apache Software Foundation released Version 1.0 of Spark, a processing framework aimed at outpacing MapReduce for machine learning and other uses.

May 22, 2014 22 May'14

Former shadow IT worker helps bring analytics data into the light

Ryan Fenner worked in a shadow IT unit at Union Bank for years. Now he's helping lead an IT effort to better manage BI data created in those shadows.

May 08, 2014 08 May'14

Big data charge could turn data management profession on its head

Discussed at DAMA's EDW 2014 were more flexible approaches to the data management profession. That's in response to growing mountains of diverse data.

August 19, 2012 19 Aug'12

Make communication, purpose priorities in a data governance program

Data governance can be all bureaucracy and no benefit. To avoid that, managing the process effectively is a must, says consultant Danette McGilvray.

August 08, 2012 08 Aug'12

Mission impossible? Data governance process takes on 'big data'

Effective governance can help companies get the most out of their "big data" environments. But at this point, there's no formula for how to do that.

March 28, 2012 28 Mar'12

IBM users reveal five data governance best practices to remember

IBM customers Nationwide Insurance and Cardinal Health reveal five rules of thumb they learned while implementing highly ambitious data governance programs.

March 08, 2012 08 Mar'12

Data governance programs expose hills to climb on path to success

IT professionals from Sallie Mae and Fannie Mae offered insight on data governance challenges and tips on how to overcome them in separate sessions at two recent conferences.

February 27, 2012 27 Feb'12

Categorizing 'big data' processing systems

In the past, analytics applications typically were powered by relational databases. Now the options are more varied and less straightforward, says TechTarget's Wayne Eckerson.

July 29, 2011 29 Jul'11

Sallie Mae exec: Meetings, metrics spur data governance best practices

In an interview, Michele Koch discusses the data governance program she leads at Sallie Mae and provides insight on key governance best practices.

April 21, 2011 21 Apr'11

Disney discovers a whole new world of data warehouse best practices

The director of data warehousing and analytics at Walt Disney Parks and Resorts shares some important BI and data warehouse best practices.

April 13, 2011 13 Apr'11

From the Editors: Database consolidation and standardization 101

If you’re thinking about embarking on a database consolidation or standardization project, make sure you know the technical, cultural and skill-set issues that can arise.

March 23, 2011 23 Mar'11

Capacity planning for the data warehouse environment

Capacity planning is essential for all data warehouse environments. Data warehouses grow at high rates and must be managed to keep budgets under control.

March 23, 2011 23 Mar'11

Gartner Magic Quadrant ranks data warehouse appliance vendors

EMC-Greenplum is a new "leader" in the latest Gartner Magic Quadrant report on data warehouse software and appliance vendors. Find out who else tops Gartner's rankings.

March 17, 2011 17 Mar'11

From the Editors: Analytical MDM sets up enterprise MDM, but plan well

An analytical master data management project can be a great way to start an enterprise MDM program, but with certain conditions. Get tips for starting an analytical MDM project at your company.

December 30, 2010 30 Dec'10

Creating a database strategy that can adapt to changing business needs

Crafting a successful database strategy requires technology flexibility, the right skill sets and a strong focus on application requirements, according to IT pros and analysts.

November 10, 2010 10 Nov'10

Emerging database technologies hit DBMS mainstream, add to choices

Emerging database technologies such as column-based database software, NoSQL databases and Database as a Service (DaaS) platforms are starting to make a splash in the IT market.

November 05, 2010 05 Nov'10

Data governance roles and responsibilities call for diverse skill sets

Learn about data governance roles and responsibilities, and get advice on the management and technical skills that a successful data governance strategy and program requires.

August 27, 2010 27 Aug'10

Increase the success of data governance programs from the bottom up

Data governance programs are often overlooked, pushed aside and just plain ignored through a lack of executive interest and funding. But some technology professionals are making the most of the situation.

December 14, 2009 14 Dec'09

Tips for a master data management (MDM) requirements gathering process

Embarking on a master data management (MDM) project? Get an expert's tips for the MDM requirements gathering process and ensure MDM implementation success.

July 21, 2008 21 Jul'08

Creating successful data stewardship programs, with Jill Dyché

Learn how data stewardship fits into data governance and data quality management programs, from Jill Dyché.

April 10, 2008 10 Apr'08

Why Are Data Warehouses Growing So Fast?

Richard Winter provides observations on the causes and effects of the explosion of digital information.

January 22, 2008 22 Jan'08

Active data warehousing explained and examined

Active data warehousing brings business intelligence to more operational decision-making processes. Find out how, and why, active data warehouses enable competitive advantages.

January 06, 2005 06 Jan'05

Data warehousing for government

Surprisingly, Data Warehouses have been slow to be adopted in the government circles.