Home > Ask the Data Management Experts > Questions & Answers > Custom development versus ETL tool
Ask The Data Management Expert: Questions & Answers
EMAIL THIS

Custom development versus ETL tool

Ian Abramson EXPERT RESPONSE FROM: Ian Abramson

Pose a Question
Other Data Management Categories
Meet all Data Management Experts
Become an Expert for this site


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


>
QUESTION POSED ON: 19 July 2002
What are the pros/cons of custom development vs. an ETL tool?

>
EXPERT RESPONSE

The question of custom code versus the use an ETL tool is one that we are faced with each time we need to create a data warehouse. Each has its advantages and disadvantages, but for me it comes down to how serious is an organization about the care and feeding of the warehouse.

Creating custom code is a nice solution, it provides organizations with the ability to code exactly what and how they would like their transformation programs to be structured. Let's summarize both side of the custom-code option:

Advantages:

  • Low cost (usually have language/compiler in-house e.g.: C++, PL/SQL, Java)
  • Code is built just for your needs
  • Optimization of programs
  • Build what you want, when you want.
  • Large knowledgebase of programmers
Disadvantages:
  • Difficult to manage and maintain programs
  • Changes to warehouse could have large impact to many programs
  • No centralized repository of code
  • Limited metadata capabilities
  • Longer development cycle
  • Debugging is more difficult
  • Limited auditing capabilities
Using an ETL tool is the other side of the loading equation. An ETL tool usually provides a nice interface for users to create and manage transformations, let's look at the advantages and disadvnatges of these tools:

Advantages:

  • Nice visual interface to create and maintain programs
  • Centralized storage of programs
  • Version control of programs
  • Customization of transforms is relatively simple
  • Usually provides good metadata support
  • Quick deployment of transformations
  • Debugging built into most products
  • Transform scheduling
  • Transform auditing
Disadvantages:
  • High cost
  • Limited user knowledge of most products
  • Optimization sometimes is limited due to generic programming methods
The bottom line is can you afford not to get an ETL tool at some point in your data warehouse lifecycle? I think not.

For More Information


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


RELATED CONTENT
Database management systems (DBMS)
Worst practices: How not to choose a database engine
Database selection 101: How to choose a database engine
The difference between data definition language (DDL) and data manipulation language (DML)
Can a dimension table be a fact table for another data mart?
Top three database management system (DBMS) trends
DB2 looks to enterprise information management to fend off Microsoft
Database administrator job roles: Organizing the DBAs
Data migration planning: Key things to remember
Logical database design
Data migration evolves from scripts to software

RELATED GLOSSARY TERMS
Terms from Whatis.com − the technology online dictionary
data classification  (SearchDataManagement.com)
OLAP  (SearchDataManagement.com)

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary



Search and Browse the Expert Answer Center
Search and browse more than 25,000 question and answer pairs from more than 250 TechTarget industry experts.
Browse our Expert Advice

About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
SEARCH 
TechTarget provides enterprise IT professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective IT purchase decisions and managing their organizations' IT projects - with its network of technology-specific Web sites, events and magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Reprints  |  Site Map




All Rights Reserved, Copyright 2005 - 2008, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts