Tips

Tips

• 6 best practices on data governance for big data environments

  Efforts to govern big data must corral a mix of structured and unstructured data. That's a challenge for most organizations. These six action items will help.  Continue Reading

• 5 benefits of building a strong data governance strategy

  Effective data governance provides a variety of benefits to organizations, including improvements in operational efficiency, data quality and business decision-making.  Continue Reading

• Data governance roles and responsibilities: What's needed

  Data governance requires a team effort. Experts offer advice on how to structure and implement data governance roles that engage business users across the enterprise.  Continue Reading

• Should you host your data lake in the cloud?

  On premises or in the cloud: What's the better place for your data lake? Here are some things to consider before deciding where to deploy a data lake.  Continue Reading

• How data lineage tools boost data governance policies

  Organizations can bolster data governance efforts by tracking the lineage of data in their systems. Get advice on how to do so and key features in data lineage tools.  Continue Reading

• 5 steps to an improved data quality assurance plan

  Consultant David Loshin offers tips on developing a data quality strategy that can help identify data errors before they cause big business problems.  Continue Reading

• 7 steps to a successful data lake implementation

  Flooding a Hadoop cluster with data that isn't well organized and managed can stymie analytics efforts. Take these steps to help make your data lake accessible and usable.  Continue Reading

• 10 cloud database migration mistakes to avoid

  Database expert Chris Foot lists the top 10 oversights IT teams commonly make when undertaking a cloud database migration and offers tips on how to avoid them.  Continue Reading

• Cloud database comparison: AWS, Microsoft, Google and Oracle

  IT expert Chris Foot evaluates the leading cloud databases from AWS, Google, Microsoft and Oracle based on their product offerings and migration capabilities.  Continue Reading

• Building leaner, meaner BI data sources

  As business intelligence analysis and reporting platforms become increasingly important in the enterprise, so does the data that feeds them. Are your BI data sources up to par?  Continue Reading

• Data virtualization benefits seen in unified views, IT agility

  Through in-place integration, data virtualization platforms can provide wider access to data and simplify security and governance. But they come with some limitations.  Continue Reading

• The evolution of the data preparation process and market

  Organizations have long struggled with inconsistent data and other issues. Expert Andy Hayler explores how that has led to the rise of the data preparation tools market.  Continue Reading

• 5 things to know about deploying big data systems in data containers

  Planning for security and container APIs, and watching out for infrastructure sprawls are some issues to be aware of before deploying big data in containers.  Continue Reading

• Google Cloud Spanner overview: 4 features to consider

  Cloud Spanner's ability to offer data consistency and horizontal scalability has helped the relational database service gain traction. Learn more about its architecture.  Continue Reading

• Why data silos matter: Settling ownership of data issues

  Data management is often still seen as an IT task, but that can lead to data silos. Find out why the business should be in charge of its data as part of a governance process.  Continue Reading

• Why organizations need a solid data governance strategy

  The flood of data flowing into data warehouses, data lakes and other systems makes effective data governance a must for successful business analytics initiatives.  Continue Reading

• Trifacta data prep tool helps blend disparate data sources

  Handling diverse data sources usually consumes precious developer time. That led healthcare CRM company SymphonyRM to hand the data prep task to business analysts.  Continue Reading

• How data duplication in healthcare is diagnosed

  Electronic health record systems have helped reduce duplicate patient data in hospitals -- but they haven't cured the problem. Find out how organizations are addressing the issue.  Continue Reading

• How to build a master data index: Static vs. dynamic indexing

  Expert David Loshin explores the differences between static and dynamic indexing in master data management systems, and which queries each approach can support.  Continue Reading

• How deterministic and probabilistic matching work

  Expert David Loshin explores the benefits and challenges of the two classes of record matching in master data management systems: deterministic matching vs. probabilistic matching.  Continue Reading

• 11 features to look for in data quality management tools

  As the need for quality data has increased, so have the capabilities of data quality tools. Learn how collaboration, data lineage and other features enable data quality.  Continue Reading

• The gradual evolution of master data management software

  Master data management began with a bang, then hit roadblocks due to complexity. Now, MDM is shifting toward more pragmatic projects tied to data governance.  Continue Reading

• Why data quality tools matter in today's organizations

  Data is everywhere -- but is it good? Data quality tools could answer that question and help save time and money. So why don't more organizations use the technology?  Continue Reading

• GDPR checklist items data managers might have overlooked

  Now that the General Data Protection Regulation has been implemented, it's a good time for organizations to make sure they haven't missed any GDPR best practices.  Continue Reading

• Good data quality for machine learning is an analytics must

  As companies add machine learning applications, they need to really understand -- and be able to improve -- their data. That's where data quality initiatives come in.  Continue Reading

• How graph data modeling can help evaluate database tools

  Mapping data to a graph model can be challenging, but these steps can help you create prototype applications -- which then can aid in evaluating graph databases.  Continue Reading

• When to choose an S3 big data environment over HDFS storage

  Selecting a storage service for big data in the cloud can be challenging. Expert David Loshin explains usage patterns that could lead organizations to Amazon Simple Storage Service.  Continue Reading

• The benefits of columnar storage and the Parquet file format

  What's behind Apache Parquet's growing popularity? It may be the file format's columnar storage orientation, which leads to benefits including improved query performance.  Continue Reading

• Four first steps for customer data management

  Forrester's Mike Gualtieri details how to develop a unified plan to manage customer data that gives business users what they need to manage CRM programs.  Continue Reading

• Three factors for protecting sensitive data in the GDPR era

  Data privacy is a hot topic nowadays thanks to GDPR and the Facebook data scandal. But how do data security, access control and data protection differ?  Continue Reading

• What goes into a customer analytics data integration framework

  Customer data integration is a minefield for IT teams to navigate. But incorporating a set of core technical functions into an integration architecture can ease the process.  Continue Reading

• Data integration techniques to help keep BI data consistent

  Data integration processes that aren't managed properly can create inconsistent data in BI and analytics applications. Here are some steps to avoid that problem.  Continue Reading

• Why Spark DataFrame, lazy evaluation models outpace MapReduce

  Learn how the Spark DataFrame execution plan works and why its lazy evaluation model helps the processing engine to avoid the performance issues inherent in Hadoop MapReduce.  Continue Reading

• Six data risk management steps for GDPR compliance

  By layering data risk management processes into your data governance framework, you can ensure the personally identifiable information your company stores meets GDPR compliance rules.  Continue Reading

• GDPR rules can spur broader steps to protect sensitive data

  Companies need to make compliance with GDPR's requirements on managing personal data a priority, but they should also work to implement wider data protection efforts in the future.  Continue Reading

• GDPR mandates push data quality improvement into IT spotlight

  Data quality issues cost companies significant amounts of money in lost revenue and added expenses, and their impact will only get bigger when the EU starts enforcing its GDPR law.  Continue Reading

• Data analytics architecture must break down higher ed silos

  Siloed data isn't only a problem for businesses. It's also a big issue for many large universities -- one that their data infrastructures need to resolve for effective analytics.  Continue Reading

• Three ways to turn old files into Hadoop data sets in a data lake

  Hadoop data lakes offer a new home for legacy data that still has analytical value. But there are different ways to convert the data for use in Hadoop depending on your analytics needs.  Continue Reading

• Database architecture design has to guard against DBMS chaos

  The proliferation of database technologies gives organizations more options to meet data processing needs. However, a strong architecture strategy is a must to avoid a DBMS free-for-all.  Continue Reading

• Make data usability a priority on data quality for big data

  To help make big data analytics applications more effective, IT teams need to augment conventional data quality processes with measures aimed at improving data usability for analysts.  Continue Reading

• Database protection methods expand to shield data from attackers

  Database vendors have beefed up the security tools in their software -- and that's a good thing because attackers are increasingly targeting database systems to steal sensitive data.  Continue Reading

• Ingesting data into a data lake may give you data indigestion

  Big data vendors routinely push the notion of ingesting all of your data into a data lake. But in many cases, doing so is an unnecessary step that could cause data ingestion problems.  Continue Reading

• Blooming of master data sources complicates customer MDM efforts

  As companies collect customer data and other types of information from more and more sources, the master data management process is becoming even more complex than it already was.  Continue Reading

• NoSQL data stores offer a mixed menu for managing diverse data sets

  NoSQL databases provide alternatives to relational software for managing pools of big data. But prospective buyers need to discern between the various types of NoSQL technologies.  Continue Reading

• Data governance initiatives get more reliant on data lineage info

  Agile development and big data applications complicate efforts to govern data, but a sharper focus on tracking and managing data lineage can help smooth the governance process.  Continue Reading

• Metadata management tools help data lake users stay on course

  Effective metadata management processes can prevent analytics teams working in data lakes from creating inconsistencies that skew the results of big data analytics applications.  Continue Reading

• Streaming, connectivity new keys to data integration architecture

  The growing use of the cloud, big data and data from outside sources has complicated data integration, making the addition of data streaming and broader connectivity a must.  Continue Reading

• Top issues for data management programs include big data, IoT, cloud

  It's time for big data systems to prove their business value, consultant Andy Hayler says. He also sees growing roles for IoT, the cloud and machine learning in the data management process.  Continue Reading

• Cross-platform integration, data preparation process grows in cloud

  While cloud computing may be convenient and more cost-effective for users, it can also lead to new challenges and requirements in regard to integrating and processing data.  Continue Reading

• Graph data model cements tight relationships between data elements

  Graph databases can help define and discover relationships between entities -- and offer increased flexibility and better usability than relational database management systems.  Continue Reading

• SQL vs. NoSQL database design debate isn't even a real fight

  Consultant David A. Teich says the SQL programming language remains the best means for accessing and querying data, whether it's in relational databases, NoSQL systems or Hadoop clusters.  Continue Reading

• SQL-on-Hadoop platforms open brave new analytics world

  Hadoop has been slowly plodding through the big data jungle, but SQL's integration may put a spring in the elephant's step.  Continue Reading

• New data preparation tools open up more info to analysts

  Consultant David Loshin says self-service data preparation software helps give data analysts broader access to business information than they typically can get in a data warehouse.  Continue Reading

• Relational database design tips to boost performance

  As relational database management systems handle more and more data, a strategic approach to data modeling has become vital.  Continue Reading

• Hadoop data lake not a place for just lounging around

  A new Gartner report says the storage repository isn’t the trouble-free panacea many observers hail it to be. New data governance practices -- and new skills -- are critical.  Continue Reading

• CDO should take lead on data governance process, info strategy

  A chief data officer should take charge of an organization's efforts to develop an enterprise data strategy and institute data governance policies, consultant David Loshin says.  Continue Reading

• Applying data quality rules is a job for users -- and data virtualization

  Consultant David Loshin outlines a strategy for ensuring data is suitable to use: Make business units responsible for applying data quality policies and use data virtualization tools to help manage the process.  Continue Reading

• Expect programming overhead when you pursue dimensional modeling

  Dimensional modeling can boost ad hoc reports, but may entail hidden development overhead, a data practitioner told EDW 2014 conference attendees.  Continue Reading

• Virtual assistant technology: More than just IBM Watson

  It might be all over the news, but IBM's megacomputer Watson isn't the be-all and end-all in virtual assistant technology.  Continue Reading

• Don't get distracted by new database technology

  Today's post-relational databases have sleek designs and promise fast performance -- but if they don't suit your business needs, they're not worth it.  Continue Reading

• Using data profiling techniques -- and estimating the effort required

  Data profiling is a key part of data quality efforts. Here's a simple formula for calculating the amount of time needed to profile a data set.  Continue Reading

• Integrating big data tools starts with effective project planning

  Big data systems often are augmenting data warehouses, not replacing them. Bringing the sides together takes bridge-building, based on a solid plan.  Continue Reading

• Data steward role needs some shepherding itself

  Consultant David Loshin gives suggestions for building and managing a data stewardship program that can effectively support data governance.  Continue Reading

• Data governance tools: Part, but not all, of the governance puzzle

  While tools designed for data governance are helpful, organizations must also implement best practices and standard processes to be effective.  Continue Reading

• Database administration best practice: Balance DBA team skills

  Balancing development and operations skills is a first step to achieving database administration best practices in-house.  Continue Reading

• Cloud databases less of a leap for users now, but some hurdles remain

  Cloud database software and services have proliferated, making deployments more feasible. There are plenty of pluses -- but issues to consider too.  Continue Reading

• Hadoop helps bring big data into a data warehouse environment

  Hadoop emerged primarily to handle unstructured big data. Now it can help IT teams looking to efficiently mix big data systems and data warehouses.  Continue Reading

• Misconceptions holding back use of data integration tools

  Integration software has matured in recent years, but consultant Rick Sherman writes that many IT managers aren't aware of the increased capabilities.  Continue Reading

• Why IT departments should consider a large data warehouse system

  Find out how a large data warehouse system can benefit companies. Learn how enterprise data warehouses help meet business needs. Get tips on operational considerations for a central data warehouse.  Continue Reading

• Understanding the latest data integration strategies and technologies

  Learn about new data integration strategies and technologies that can improve data integration for enterprise IT and departmental data in your organization.  Continue Reading

• Understanding key data integration trends and business drivers

  New data integration trends are shaping integration projects at many organizations. Find out about important data integration business drivers in this article by Rick Sherman.  Continue Reading

• How to improve data quality on a tight budget -- a guide

  Many organizations may be tempted to forgo data quality management to save money, but it's important to assess the ROI of high-quality data, according to consultant David Loshin.  Continue Reading

• Data quality management tips and best practices

  Get data quality management tips and best practices with expert advice and book excerpts. Learn about academic sources for data quality, key steps and common mistakes of data quality implementations, how much you should spend for data cleansing and ...  Continue Reading

• Data governance success: No pain, no gain

  Data governance isn't easy, but it is necessary for success in data-centric projects. Rick Sherman commiserates and offers expert advice for getting started with data governance.  Continue Reading

• I've been a good data warehouse manager, Santa

  Even data warehouse managers make holiday wishlists. Expert Rick Sherman shares a letter to Santa, with data warehouse-oriented wishes, hopes and desires for the coming year.  Continue Reading

• Data warehousing appliances: Are they market breakers?

  Data warehousing (DW) appliances are being touted as potential market-changing technology by technology and financial analysts alike.  Continue Reading

• Is data integration the Achilles heel of Software as a Service?

  Software as a Service applications can create serious enterprise data integration challenges. Expert Rick Sherman discusses the problem and potential solutions.  Continue Reading

• Enterprise data integration software: EDI definitions you need to know

  Get concise definitions of enterprise data integration (EDI) software terms -- including customer data integration (CDI), enterprise information integration (EII), enterprise application integration (EAI), master data management (MDM), service ...  Continue Reading

• Five steps for weaving data quality management into your enterprise data integration processes

  Data quality management is critical for effective enterprise data integration (EDI). Expert Rick Sherman shares five strategic steps (and potential pitfalls) of data quality management.  Continue Reading

• Data quality management: Follow the doctor's orders

  Get expert recommendations for data quality management in business intelligence and data warehousing projects.  Continue Reading

• Why data governance projects fail

  Expert Rick Sherman discloses the top reasons why 90% of data governance projects are doomed for failure. Read his advice to make sure that your projects are not!  Continue Reading

• Data and the enterprise architecture framework

  Using a detailed data model, Hay discusses data and the enterprise architecture framework with a focus on the business owner, architect, designer and the functioning system. He also examines business terms, concepts and fact types in relation to his...  Continue Reading

• How to define business requirements for data warehousing projects

  Using the Business Requirements Definition, the authors define the process of gathering business requirements, which begins with interviewing IT and business professionals, in order to organize and analyze data into a DE/BI system strategy to make ...  Continue Reading

• IBM iSeries (AS/400) DB2 UDB: Top 10 expert questions

  IBM iSeries/i5 DB2 invokes alot of questions. Here, find the top ten iSeries questions that have been answered by our IBM iSeries/i5 DB2 UDB expert, Kent Milligan.  Continue Reading

• EDA software: Event-driven architecture and DB2

  Oracle is now coming out with an event-driven architecture based on the EDA's ability to communicate between software and support business rules. How could DB2 help users to achieve the full benefits of an EDA?  Continue Reading

• XQuery and XML data: DB2 helps manage the era of unstructured data

  The arrival of IBM XQuery and XML data is simplifying users' decisions in this era of unstructured data, just as the arrival of the relational database and SQL simplified IT buyers' decisions twenty years ago.  Continue Reading

• Rogue data management

  Every company or organization has some of its key data assets managed outside of its business systems. While most companies are permeated with "rogue data", this type data is often difficult to find, and even harder to manage.  Continue Reading

• 'Low IT' databases: DB2 for the low IT user

  Wayne Kernochan examines the 'Low-IT' database needs of what he terms 'Low-IT' users, as well as how IBM's DB2 Express is proving itself to be a highly useful alternative in the Low-IT market.  Continue Reading

• Enterprise information integration (EII) delivers information on demand

  Because IBM's WebSphere Information Integrator is such a strong EII tool, DB2 as its natural complement can play a key role in the success of an information-on-demand initiative. Therefore, information-on-demand implementers should consider setting ...  Continue Reading

• The new need for speed to value: How DB2 plays a role

  Today, as never before, IT and ISVs can cut the time to create a high-value application from 2 years (or never!) to 6-9 months, simply by choosing a different development solution.  Continue Reading

• Enterprise data integration (EDI): A critical piece in a service-oriented architecture

  This article discusses the importance of a data services layer built upon an enterprise data integration (EDI) platform for service-oriented architecture (SOA).  Continue Reading

• Data manager best practices: Dear Santa, I've been a good data management manager

  T'was the night before Christmas, when all through the database, guest columnist Rick Sherman was asking Santa to make the world of data management a better place...  Continue Reading

• SQL Server freebie: TOAD for SQL Server

  When you use SQL Server's built-in tools for database development, you may find that each has its imperfections. Contributor Serdar Yegulalp spotlights a 90-day free SQL Server tool that can act as your development environment, object explorer, ...  Continue Reading

• Saving lives with Oracle

  Thanks to rapidly falling disk costs, companies can now afford to store trillions of bytes of valuable information. However, data professionals know that the real challenge is making sense from these huge data stores and mining them for ...  Continue Reading

• Data warehouse architecture: Extreme makeover

  When it comes to data warehouse architecture, there's no need to reinvent the wheel, says guest columnist Rick Sherman. There's always something to be learned from your DW predecessors.  Continue Reading

• Sarbanes-Oxley compliance tips

  Tips for leading SOX compliance efforts in the enterprise.  Continue Reading

• Data warehousing strategy: Is training necessary?

  Project teams need training in order to keep their data warehousing strategy up-to-date. By refusing, says guest columnist Rick Sherman, companies could be undermining their data warehousing efforts.  Continue Reading

• Complying with multiple regulations and contending with conflicts

  This tip reviews how to comply with multiple regulations and what to do when they conflict.  Continue Reading

• Worst practices for SQL Server backup and recovery

  In the event of a SQL Server failure, wouldn't it feel good knowing you have a well-tested and reliable backup and restore process to protect your data? The success of your efforts depends more on seemingly small oversights or mistakes you make than...  Continue Reading

• Passing a SOX audit: Lessons learned from an information security professional

  While the ambiguity of the Sarbanes-Oxley Act can be frustrating, the regulation encourages organizations to create partnerships with their auditors and make compliance work for them. In this column, an information security analyst from PNM ...  Continue Reading