Essential Guide

Building an effective data governance framework

A comprehensive collection of articles, videos and more, hand-picked by our editors

data profiling

Data profiling, also called data archeology, is the statistical analysis and assessment of the quality of data values within a data set for consistency, uniqueness and logic.  

Data profiling, also called data archeology, is the statistical analysis and assessment of data values within a data set for consistency, uniqueness and logic.  

The data profiling process cannot identify inaccurate data; it can only identify  business rules violations and anomalies.The insight gained by data profiling can be used to determine how difficult it will be to use existing data for other purposes.  It can also be used to provide metrics to assess data quality and help determine whether or not metadata accurately describes the source data. 

Profiling tools evaluate the actual content, structure and quality of the data by exploring relationships that exist between value collections both within and across data sets. For example, by examining the frequency distribution of different values for each column in a table, an analyst can gain insight into the type and use of each column. Cross-column analysis can be used to expose embedded value dependencies and inter-table analysis allows the analyst to discover overlapping value sets that represent foreign key relationships between entities.  

See also:data modeling, data dictionary, data deduplication

 

 

This was first published in December 2014

Continue Reading About data profiling

Pro+

Features

Enjoy the benefits of Pro+ membership, learn more and join.

Essential Guide

Building an effective data governance framework

0 comments

Oldest 

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to:

-ADS BY GOOGLE

File Extensions and File Formats

Powered by:

SearchBusinessAnalytics

SearchAWS

SearchContentManagement

SearchOracle

SearchSAP

SearchSOA

SearchSQLServer

Close