Q
Problem solve Get help with specific problems with your technologies, process and projects.

Parallel processing against a DB2 table

I have a table that stores Order data (master) and its associated data is stored in various other DB2 tables. I have a need to download all this data -- from 15 different tables -- every morning through a COBOL program with a lot of cursors and SELECT statements of various types in flat files and FTP them to the another server so that it can be loaded into the SQL Server on a Windows machine.

To make the data processing faster, I am proposing 10 parallel jobs so that each one is pulling data for a range of orders. The data files are combined together and sent to the other server later through a JCL. The Order table is not partitioned as of now -- can be based on the need though -- but some of the associated tables are partitioned into 10 partitions.

The question raised by the architects on the customer side is that by running 10 parallel jobs on a non-partitioned table it may not be of any help because they all are hitting the same table/partition. My opinion on this is different. I feel that we can take advantage of parallel processing through multiple jobs with this approach.

I would like your opinion on this. Can we take advantage of parallel processing even if the DB2 table is not partitioned? Should I do something else to ensure this? The requirement is only to read the DB2 tables. No updates.
You should be able to reduce the overall elapsed time by running multiple jobs in parallel against the data even if the table spaces are not partitioned. You may get some minor read contention in the jobs when they need to access data on the same page, but I would guess that the impact should not be too major.

My advice to you is to mock up your job and test it out.

Editor's note: Do you agree with this expert's response? If you have more to share, post it in one of our .VO7aaqqaAFk.0@/search390>discussion forums.

This was last published in June 2004

Dig Deeper on IBM DB2 management

PRO+

Content

Find more PRO+ content and other member only offers, here.

Have a question for an expert?

Please add a title for your question

Get answers from a TechTarget expert on whatever's puzzling you.

You will be able to add details on the next page.

Start the conversation

Send me notifications when other members comment.

By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Please create a username to comment.

-ADS BY GOOGLE

SearchBusinessAnalytics

SearchAWS

SearchContentManagement

SearchOracle

SearchSAP

SearchSQLServer

Close