Features

Features

• Information Builders exec talks data management ethics

  In this Q&A, James Cotton, director of the Data Management Centre of Excellence at Information Builders, offers advice on how organizations can carry out ethical data management.  Continue Reading

• Key components of an effective data virtualization architecture

  Experts break down which elements -- both technical and nontechnical -- are most crucial to successfully deploying and managing a data virtualization architecture.  Continue Reading

• 11 real-time data streaming roadblocks and how to overcome them

  Experts detail common challenges that IT teams encounter when deploying and managing real-time data streaming platforms and offer advice on how to address them.  Continue Reading

• Container technologies promise more agility for big data apps

  Along with the ability to provide greater agility and flexibility for big data applications, containers can play a role in IT strategy that drives real-time decision-making.  Continue Reading

• Explore data integration products for your organization

  Browse through the current data integration products currently available to help you determine which tool best suits your organization's needs.  Continue Reading

• Data modeling techniques to overcome common business challenges

  In this interview, author and data modeling instructor Steve Hoberman discusses techniques for dealing with challenges that may arise in the data modeling process.  Continue Reading

• How 4 organizations are breaking down data silos

  Siloed data continues to inhibit enterprise efficiency. Here, IT professionals discuss problems their organizations are facing around data silos -- and how they're solving them.  Continue Reading

• A comparison of open source, real-time data streaming platforms

  With so many real-time data streaming tools, how do you know which is right for your organization? Experts compare Spark Streaming, Kafka Streams, Flink and others.  Continue Reading

• Data virtualization use cases cover more integration tasks

  In a Q&A, Gartner analyst Mark Beyer discusses user adoption of data virtualization software and the wider data integration uses that the technology is now handling.  Continue Reading

• Microservices and big data start to get closer

  Microservices are riding a wave of user interest, leading to changes in IT operations. ThoughtWorks expert Zhamak Dehghani discusses what that means for big data.  Continue Reading

• The main picks for Hadoop distributions on the market

  Check out the current top Hadoop distribution vendors in the market to help you determine which product is best for your company.  Continue Reading

• Inside view of Tibco integration architecture planning

  Tibco's acquisitions of well-regarded, small software specialists such as SnappyData are part of a drive toward what it calls 'connected intelligence.' CTO Nelson Petracek provides background.  Continue Reading

• Advice on enterprise data cleansing from an SAP VP

  SAP's Kristin McMahon details data cleansing best practices and explains why a good data cleanse needs continual communication, collaboration and oversight.  Continue Reading

• Data virtualization layer feeds logical data warehouse, Agile BI

  Indiana University is using data virtualization to combine data from various source systems for analysis, as part of an initiative to improve strategic decision-making.  Continue Reading

• Data modeling software tackles glut of new data sources

  Data modeling platforms are starting to incorporate features to automate data-handling processes, but IT must still address entity resolution, data normalization and governance.  Continue Reading

• Find the best data integration tools for your organization

  Read analysis and comparisons of data integration tools to help you select the right platform from the leading commercial and open source products currently on the market.  Continue Reading

• Data model design tips to help standardize business data

  Data models should be understandable to business users and kept to a reasonable scope, say the leaders of a data modeling initiative at England's Environment Agency.  Continue Reading

• Wayfair charts open source components course to growth

  Teams at Wayfair mix new open source tools to power customer-facing apps. In such shops, tech leaders like Ben Clark must deftly maneuver an obstacle course of data components.  Continue Reading

• 4 factors to consider in a Hadoop distributions comparison

  Examine the key characteristics necessary to evaluate in a Hadoop distribution comparison, focusing on enterprise features, subscription options and deployment models.  Continue Reading

• USAA adds data engineering skills to speed data science work

  When the United Services Automobile Association's data science team wasn't getting data in the right format, the team lead realized the USAA needed more data engineers.  Continue Reading

• How data staging helped Walgreens transform its supply chain

  Walgreens built a centralized data warehouse to give supply chain partners a better view into its data -- but analytics were slow. That's where a data staging tier came in.  Continue Reading

• Evaluate the features of data integration tools and software

  Before you evaluate and select data integration tools and software, assess which must-have, should-have and nice-to-have features match your organization's needs.  Continue Reading

• Data integration platforms take users beyond ETL software

  Discover how commercial data integration platforms help organizations manage and simplify the process of combining and sharing their increasing volumes of data.  Continue Reading

• Augmented data management draws more enterprise interest

  With AI and machine learning, organizations are starting to augment their data management. This is changing the way enterprise users capture, govern and integrate data.  Continue Reading

• How to navigate the challenges of the data modeling process

  Data modeling and curation can help businesses more efficiently use data they've collected. There are challenges, however -- beginning with ensuring data quality.  Continue Reading

• 8 tips to improve the data curation process

  A data curation and modeling strategy can ensure accuracy and enhance governance. Experts offer eight best practices for curating data. First, start at the source.  Continue Reading

• Explore Hadoop distributions to manage big data

  Discover the uses of Hadoop distributions and the first steps in evaluating these products, as well as how the merger of rivals Cloudera and Hortonworks affects the market.  Continue Reading

• DataOps is more than DevOps for data, Delphix CTO says

  Data operations is young compared to DevOps, but it is increasingly used as part of projects that put data at the center of development. Here, Delphix CTO Eric Schrock makes observations about the trend.  Continue Reading

• 5 best practices for managing real-time data integration

  Real-time data integration isn't like traditional data integration -- "it's moving, it's dirty and it's temporal," cautions one data pro. Experts offer up some best practices.  Continue Reading

• Cloud data warehouse makes inroads as users spurn admin tasks

  Overlooked in the run-up to Hadoop, data warehouses have found new life off premises. Cloud-based data warehouses find favor with teams that want to reduce warehouse administration.  Continue Reading

• 5 data management infrastructure technologies to evaluate

  It's the start of a new year -- is your organization ready to face the data management challenges ahead? Here are five technologies to consider adopting.  Continue Reading

• Advantages of graph databases: Easier data modeling, analytics

  Graph databases are finding a place in analytics applications at organizations that need to be able to map and understand the connections in large and varied data sets.  Continue Reading

• FaunaDB distributed cloud database hunts transactional NoSQL

  Startup Fauna has built a "relational NoSQL" database for distributed transaction processing. Data consistency and speedy builds attracted early user ShiftX.  Continue Reading

• Don't let blockchain complexity bog down business applications

  Enterprise blockchain applications that run in a controlled environment don't require some of the components of cryptocurrency networks, explains expert David Teich.  Continue Reading

• Neo4j graph database targets AI use cases, performance

  The Neo4j graph database is poised for use in AI applications, in which understanding data can stymie efforts. Recent updates target AI needs and performance issues.  Continue Reading

• Cloud buoys data microservices -- for on-premises systems, too

  Data in a microservices architecture is percolating anew. This news analysis looks at IBM Cloud Private for Data and other means to harmonize data in public and private locations.  Continue Reading

• Mining equipment maker uses BI on Hadoop to dig for data

  BI on Hadoop is still new, but moving BI to data is trending. A data scientist working with IoT data at Komatsu sees the importance of getting big data to the right people.  Continue Reading

• Open source RDBMS uses spurred by lower costs, cloud options

  Open source technologies have become more capable alternatives to mainstream relational databases for cost-conscious users -- and the cloud makes them more accessible.  Continue Reading

• Open source DBMS software gains foothold in enterprise IT

  Open source databases are increasingly making their way into corporate IT environments, says Gartner analyst Merv Adrian in a Q&A. But some care is required.  Continue Reading

• How to manage data and the GDPR right to be forgotten

  The General Data Protection Regulation requires organizations to delete personally identifiable information if customers ask -- which can be a challenge. Experts offer four tips.  Continue Reading

• eHarmony hooks up with Redis NoSQL database for hot storage

  The Redis key-value store finds use in a system to match would-be romantic partners on dating site eHarmony, which employs a variety of NoSQL databases to make love click online.  Continue Reading

• Google Cloud data lake fuels cloud payment processing flow

  To create a cloud payment processing system, Global Payments first had to deploy a data lake in the Google Cloud. Getting quick user feedback was another early step.  Continue Reading

• AP uses data.world platform to spread data journalism

  Data journalism reporters need tools that deliver quick context for stories on deadline. A data collaboration platform from data.world helps the Associated Press meet such needs.  Continue Reading

• GPU databases bring greater parallelism to big data processing

  GPU databases offer a new way to process data. 451 Research analyst James Curtis discusses where they fit in big data applications, particularly for parallel processing.  Continue Reading

• CockroachDB database wagered on for scalability boost, GDPR

  CockroachDB is an open source distributed database designed for processing on a global scale, a need that online gambling company Kindred Group hopes it can meet.  Continue Reading

• Data integrity protection spurs greater security spending

  As hacking, ransomware and malware attacks mount, companies place big data protection and integrity among the primary reasons for increased spending on security software.  Continue Reading

• GDPR requirements put focus on data ethics, governance

  The General Data Protection Regulation makes privacy paramount and reinforces the practice of good data governance. Will a new focus on data ethics be an important side effect?  Continue Reading

• IT teams take big data security issues into their own hands

  Data security needs to be addressed upfront in deployments of big data systems -- and users are likely to find they have to build some security capabilities themselves.  Continue Reading

• Information architecture applied to big data streaming, AI

  New technologies challenge data professionals, but taking a step back helps with hurdles. In this interview, consultant William McKnight takes a measured look at data streaming, GDPR and AI.  Continue Reading

• Cloud workloads, data lakes challenge information architecture

  Data management options are expanding; cloud workloads are an example. That means changing your approach to information architecture, says data management expert William McKnight.  Continue Reading

• Kubernetes gains momentum in big data implementation process

  Big data vendors and users are looking to Kubernetes-managed containers to help accelerate deployments and enable more flexible use of computing resources.  Continue Reading

• Data expert: GDPR deadline is an opportunity, not a burden

  There is stress as the EU's General Data Protection Regulation compliance deadline nears, but the GDPR privacy movement is a good thing for data policies, advises consultant Daragh O Brien.  Continue Reading

• Hyperledger Fabric offers path to enterprise blockchain future

  Blockchain arose from bitcoin, but it's looking to find a place in the enterprise. Frameworks like Hyperledger Fabric could smooth out the technology's rough side for business uses.  Continue Reading

• Data catalog software takes open data initiative to the streets

  Data catalog software from Alation helped San Diego's chief data officer open up the city's data to residents, as well as city planners and other government workers.  Continue Reading

• Expert: For BI, you must know the data integration process

  Understanding the data integration process is central to self-service BI and data architecture design, consultant Rick Sherman says in an end-of-year look at data management trends.  Continue Reading

• Amazon Neptune database validates graph technology, rivals say

  Amazon's Neptune database may change the status quo in the graph technology world. But it could also introduce a wider base of possible users to graph databases, existing vendors say.  Continue Reading

• Panera meets big data challenge of lunchtime operations

  In the era of more and more digital orders, Panera Bread encountered big data challenges that led the restaurant chain to deploy a new cluster architecture with Hadoop, Spark and other technologies.  Continue Reading

• NewSQL databases rise anew -- MemSQL, Spanner among contenders

  The NewSQL database was almost hidden when Hadoop and NoSQL arose. Now, as more big data teams move toward production uses, MemSQL, Cloud Spanner and similar products may get a second look.  Continue Reading

• Cloud big data clusters test users on migration, management

  There are good reasons to move big data systems to the cloud, but doing so also poses challenges for IT teams on migrating workloads and then managing clusters and system instances.  Continue Reading

• Cloud database services get stronger push from Microsoft, Oracle

  Using cloud databases is now more a matter of when than if at many companies. There's also the question of how, as Microsoft, Oracle and AWS square off against one another.  Continue Reading

• Big data systems help companies build new business strategies

  Organizations hungry for more revenue are using Hadoop and other big data technologies to break their existing business molds and pursue new strategies and product offerings.  Continue Reading

• Machine learning algorithms meet data governance

  Machine learning algorithms may change computing, but they're a bit of a black box. Still, there are ways to tame them with flexible data governance, according to tech startup exec Andrew Burt.  Continue Reading

• Bank sees ETL processes evolve from IT to front-line users

  ETL jobs -- once the sole province of IT -- take on a new form as data wrangling and self-service gain greater traction with business users of analytics.  Continue Reading

• Database security issues shadow distributed data architectures

  As companies distribute data across various platforms, they may need to pay more attention to securing it in databases and other repositories where security is far from baked in.  Continue Reading

• Data management processes take on a new tenor in analyst's view

  Changes in data management processes -- including self-service data preparation, data lakes and real-time analytics -- create a new landscape in companies, according to analyst Matt Aslett.  Continue Reading

• Rising database security threats require attention -- and action

  Data management teams are asking more questions about data security, Gartner analyst Merv Adrian says in a Q&A. But new factors are complicating the process of securing databases, he adds.  Continue Reading

• Former LinkedIn tech lead now charts Kafka streaming wave at Confluent

  It started as a messaging bus, handling LinkedIn's big data. Now, Kafka underpins wider efforts. In a Q&A, Confluent CTO Neha Narkhede marks Kafka's path to a data streaming platform.  Continue Reading

• Big data teams get proactive on data preparation for analytics users

  Organizations are starting to prepare sets of big data for analysis before making the data available to data scientists and other users, instead of leaving the work to them.  Continue Reading

• DMBOK2 eyes evolving data management best practices, challenges

  In a Q&A, DAMA president Sue Geuens talks about the second edition of the group's DMBOK reference book and how data management trends and processes have changed since the first version.  Continue Reading

• High-level tools help Hadoop data lake go to school

  Moving relational data into Hadoop isn't a slam dunk. To avert programming complexities, a major Texas university turned to commercial tools to stock its Hadoop data lake.  Continue Reading

• Data monetization takes three routes to turn data into dollars

  Data monetization is not monolithic. Instead, it takes several forms, according to MIT researcher Barbara Wixom. Each approach has its own unique traits.  Continue Reading

• Data lake management, governance a hands-on job for big data teams

  Deploying big data systems is just the first step for IT and data management teams. The next big challenge is setting up systems and processes for governing data lakes.  Continue Reading

• Data governance tools for Hadoop infiltrate the enterprise

  Be it open source or commercial technology, software designed to ensure proper data governance in Hadoop data lakes is proliferating. But like many big data systems, these tools are still maturing.  Continue Reading

• Big data queries eyed to head off Hadoop performance problems

  Processing in big data systems can slow to a crawl if queries are not properly tuned or workloads not well balanced -- issues that call for careful monitoring of clusters.  Continue Reading

• Hadoop data governance takes hold in companies as data gets 'bigger'

  LinkedIn, Cleveland Clinic and fitness company Beachbody are examples of organizations that have increased their data governance efforts in connection with big data applications.  Continue Reading

• Four data management conferences on big data, governance and more

  It's not too late to consider signing up for data management conferences in June. Here's a quick rundown of four events focused on Hadoop, Spark, data governance and other topics.  Continue Reading

• Mixed metadata, master data management process a must for mobile apps

  The growing use of mobile devices by business users broadens the risk of data inconsistencies, a hazard that an integrated process for managing metadata and master data can help address.  Continue Reading

• Building a data lake takes meticulous planning -- and flexibility

  Data lakes offer a more expansive alternative to data warehouses for analytics uses. TDWI analyst Philip Russom offers advice on how to get things right in a data lake architecture.  Continue Reading

• Q&A: Big data leads to bad insights without a data governance plan

  Big data holds the potential to provide invaluable insights for business growth, but only if data governance is part of the plan.  Continue Reading

• TDWI finds big data approaches that move jobs from POC to production

  Big data approaches outlined in a TDWI maturity model help bridge the chasm between proof of concept and production. One finding: Stick-to-itiveness is a key to success.  Continue Reading

• Data ingestion capabilities augur greater role for NoSQL in IoT

  Verizon's ThingSpace IoT platform uses a Couchbase NoSQL system to help provide reliable data ingestion and flexible development. That is key as IoT devices proliferate.  Continue Reading

• McKesson looks to simplify big data ecosystem for healthcare analytics

  The big data ecosystem has many twists and turns. A McKesson data manager saw Splice Machine's database as a means to straighten the path by putting analytics and operations data in one place.  Continue Reading

• A look at the leading operational database management systems

  The market for operational DBMS products can be confusing, especially with so many choices. But knowing your application requirements can help point you in the right direction.  Continue Reading

• Preparing data for analysis helps JTV find predictive gold

  Predictive models help Jewelry Television's on-air hosts sell its wares, thanks to data integration and preparation processes that funnel a mix of data into the analytics applications.  Continue Reading

• Data preparation steps increase to meet predictive analytics needs

  Data scientists building predictive models and machine learning algorithms often have to do more data preparation work upfront than is necessary in conventional analytics applications.  Continue Reading

• Fast-moving big data changes data preparation process for analytics

  Increased automation of data pipelines and more flexibility for data scientists through self-service software are taking hold as big data deployments change data preparation practices.  Continue Reading

• With better scaling, semantic technology knocks on enterprise's door

  Cambridge Semantics CTO Sean Martin says better scalability can lead to richer representations of data. Such advances are behind the renewed interest in semantic technology.  Continue Reading

• Embedded analytics to feel widest impact of machine learning projects

  Ovum analyst Tony Baer discusses machine learning tools, IoT-driven streaming analytics and Hadoop in the cloud, all of which gained attention in 2016, with more likely in store for 2017.  Continue Reading

• Microsoft SQL Server 2016 relational DBMS overview

  Microsoft SQL Server 2016 for Windows comes in four editions, with updates that include a new stretch database feature, Polybase, dynamic data masking and more.  Continue Reading

• A look at the EnterpriseDB Postgres data management platform

  The EDB Postgres platform, which is based on the PostgreSQL open source relational database, is offered as a subscription service for production and nonproduction systems.  Continue Reading

• Inside the Amazon DynamoDB NoSQL cloud database as a service

  The DynamoDB NoSQL cloud database supports both document and key-value store models, providing flexibility for development of web, gaming, IoT and many other applications.  Continue Reading

• Data trust gap confronts analytics -- time to open the 'black box'

  C-suite honchos sign off on analytics tool purchases and then wonder what they've wrought. But data trust can build if practitioners make the analytics process more transparent, consultant Bill Nowacki says.  Continue Reading

• Following a notion for SQL, architect creates NoSQL data modeling notation

  Ted Hills, an enterprise architect at LexisNexis and the author of a recent book on NoSQL data modeling, discusses the ins and outs of database schema design in an era of big data disruption.  Continue Reading

• Functionality gaps not stopping Spark usage from growing fast

  Organizations aren't letting ongoing Apache Spark development, functionality holes or issues deter them from ramping up usage of the technology. Find out why.  Continue Reading

• Spark architecture finds place at center of big data environments

  Spark's draw has gone beyond its batch processing speed. Find out why more than 500 organizations, including Webtrends and Synchronoss Technologies, have turned to the technology.  Continue Reading

• Reltio master data management architecture rides graph analytics wave

  An onslaught of unstructured data, social and otherwise may change the nature of master data management platforms. Reltio Cloud may stand as an indicator.  Continue Reading

• Inside the Informatica Master Data Management portfolio

  Informatica Master Data Management is aimed at helping sales, marketing and customer service teams ensure they're working from the most relevant and accurate data available.  Continue Reading

• Hadoop tool finds low-hanging fruit for migrating data warehouse jobs

  It's still hard to move existing data warehouse jobs to Hadoop, but emerging tools can help. Cloudera Navigator Optimizer is one such Hadoop tool tapped by digital marketing company Conversant.  Continue Reading

• Big data governance steps into IT spotlight as architectures expand

  Effectively governing the data stored in different systems across big data architectures is emerging as one of the keys to a successful deployment of Hadoop and related technologies.  Continue Reading

• Big data architectures face big hurdles with technology integration

  Hadoop and all the related technologies surrounding it enable organizations to design big data environments that meet their specific needs. But putting everything together isn't easy.  Continue Reading