Thursday, January 29, 2015

DataStage Oracle Connector Bulk Load performance improvements

Improve oracle loading performance using bulk load options.

--> Set APT_PM_PLAYER_TIMING to true find our if the oracle conncetor is taking More CPU cycles.

--> Disable the oracle triggers / indexes & Constraints on this table. ( can use before and after SQL statement to disable load and enable).

--> Use oracle data cache for faster handling of Date and Timestamp columns.

--> Disabe redo logging while Bulk upload

--> Ensure the array size and buffer size are set to optimal.

--> Load data if possible using Partitioned tables.

--> Proper Handing of datatype, as datatype conversions can be costly.

--> Proper setting of NLS_LANG setting from oracle database and Environment variables.

--> Set CC_MSG_LEVEL to lowest possible value.

Further readings

http://www.ibm.com/developerworks/data/library/techarticle/dm-1304datastageoracleconnector2/

No comments:

Post a Comment