Home > Data management / BI News > The real deal on data integration for business intelligence
Data management / BI News:
EMAIL THIS

The real deal on data integration for business intelligence

By Jeff Kelly, News Editor
19 Feb 2008 | SearchDataManagement.com

News on data management trends and technology
Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us    Add to Google

There are various ways to sabotage a business intelligence (BI) initiative, but perhaps none is more effective than ignoring key data-integration considerations at the outset.

Data integration -- connecting data sources with data consumers -- lies at the very foundation of BI, according to experts. But successful data integration is no easy task. Poorly labeled data fields and siloed data sources, among other obstacles, see to that. BI done right requires carefully selected data sources, particular attention to data quality, and an understanding of the ultimate business uses of data.

"Business intelligence is all about data integration," said William McKnight, senior vice president of information management at East Hanover, N.J.-based consulting firm Conversion Services International. "You can't have effective BI without good data integration or else you'll be running off different sets of books and encountering various semantic and other cultural -- and very real – [obstacles] to success."

Ensuring a successful BI initiative requires attention to some key data integration considerations, according to McKnight and Rick Sherman, founder of Stow, Mass.-based business intelligence consulting firm Athena IT Solutions.

Get a grip on data granularities

BI users often want to drill down deep into data to gain better insights on the business. The first step in any BI data integration project is to understand the granularities of an organization's data in order to agree upon definitions, McKnight said. That way, when users delve into the data, they are all working off a common framework.

More on data integration
See who made the cut in Gartner's latest data integration Magic Quadrant

Explore three paths to real-time data integration

Balance the costs and benefits of data integration software vs. hand coding

In a retail company, for instance, what exactly defines a customer? Is it a single person or the entire household? If another member of that household makes a purchase, is he or she a new customer or part of the existing household customer account? Questions like these must be addressed before integrating data into a BI system, McKnight said. How they are answered will largely depend on a company's business model and corporate culture.

Not all data sources are created equal

The next step is to take an inventory of data sources – databases, data warehouses, spreadsheets, etc. It is important to realize that different departments often have their own internal databases and spreadsheets that contain overlapping information, which can lead to problems with data quality.

"A lot of companies have grown up in silos and now are looking to integrate data to get a holistic view of the business," McKnight said. "That means there are different cuts of the data taken off in different departments, sometimes with their own IT departments or their own rogue IT departments." Before data can be integrated, he said, these various data sources must be reconciled.

Athena's Sherman also stressed the importance of data quality in any integration initiative. Prior to the implementation of a BI system, he said, users in separate departments probably routinely make changes to data to suit their purposes -- changes that are not relayed to other business units. That's fine when the data never leaves a given department, but can wreak havoc on BI systems that access enterprise-wide data.

"They massage the data to make up for data quality issues, or gaps in the data, or things they don't think are right in the data," Sherman said. "Once you [undertake] a BI initiative, then you want to look at more detailed data, from across different systems. That's when you start to see data quality issues."

Foster buy-in from BI stakeholders

In conjunction with addressing data quality issues, executives and analysts should also be consulted to determine how they plan to use the resulting BI reports, analytics and dashboards.

"You need to pick data sources appropriately for the stakeholders of BI," McKnight said. "And they should understand the choices that they have to pick from within the organization."

Understanding how data will be used is essential to successful BI data integration, Sherman agrees, but understanding data lifecycles is equally important.

"The lifecycle of your data is very closely related to your business processes," Sherman said. Data used by a manufacturing company, for instance, undergoes very different processes throughout its lifetime than data used by a retailer. Even within industries, data lifecycles often vary. Both Sherman and McKnight said knowing when to integrate data for BI purposes during its lifecycle is a key success factor.

Only after data source options are clear, data quality issues have been addressed, and BI business uses determined, can an organization actually begin integrating data with BI systems, McKnight and Sherman agreed.

The reason why some BI projects take so long, sometimes nine months to a year or longer, "is due to getting business users to determine how they're going to define and use the data, plus assuring data quality and writing data governance rules," Sherman said. "Business intelligence really raises the bar for data integration."



Tags: Business intelligence best practicesEnterprise data integration (EDI) softwareEnterprise information integration and data federationProduct information management softwareCustomer data integration softwareVIEW ALL TAGS

Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us    Add to Google



RELATED CONTENT
Business intelligence best practices
Five technology trends for improved business intelligence performance
In-database analytics demystified
Choosing BI software: Use your ERP vendor or go with third-party BI?
Understanding in-database analytics technology: Benefits, uses and ROI
Is in-database analytics an emerging business intelligence (BI) trend?
Trends and tips for using business intelligence and analytics in retail
Trends and tips for using business intelligence in financial services
BT taps open source BI software, homegrown DW to unlock customer data
Data integration for Software as a Service business intelligence software evolves
The importance and benefits of operational decision making

Enterprise data integration (EDI) software
Data integration for Software as a Service business intelligence software evolves
Yearbook publisher finds BI reporting, data integration tools from same vendor
Efficiencies can be gained at the intersection of middleware and data integration
Data warehouse project leads to data mashups in D.C.
Understanding the latest data integration strategies and technologies
Interest in open source data integration technologies growing
Understanding key data integration trends and business drivers
Informatica acquires complex event processing vendor Agent Logic
Informatica offers data integration software by the hour on Amazon EC2
Oracle's GoldenGate acquisition underlines demand for real-time data integration capabilities

Enterprise information integration and data federation
Handling project management issues for a proprietary ownership conflict
Understanding the latest data integration strategies and technologies
Interest in open source data integration technologies growing
Understanding key data integration trends and business drivers
Data federation technology complements fragmented data warehouses
Data integration costs hurting companies with poor negotiation skills
Wholesaler turns to data integration adapters for mainframe to Oracle migration
Enterprise-wide customer data quality still elusive at most organizations
Exec explains IBM's Information On Demand (IOD) initiative
SaaS-based data quality and integration tools gaining momentum

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary



Data Management: Business Intelligence, Data Integration, Data Compliance
About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
SEARCH 
TechTarget provides technology professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective purchase decisions and managing their organizations' technology projects - with its network of technology-specific websites, events and online magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Site Map




All Rights Reserved, Copyright 2005 - 2009, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts