IBM Infosphere Master Data Management Incremental Load script

IBM Information Management has Master Data Management as part of Suit. Inherited originally from a Initiate company. This product has evolved over a great time and as of today it provides a lot more integration capabilities with other suit of IBM products.

This article describes one aspect of the IBM Master Data Management tool which is not document on IBM website.

Problem Statement:

Initial load of data into MDM server can done using various method. Jobs sets , Web services etc .. but problem would come when it is required to add additional data source without impacting existing Enterprise ID's in Virtual Implementation style. Even though IBM document says that it can be done in IXM mode, but very less documentation is provided around on how to implement the solution.

The below script is provided to load data from background using IXM mode and not impacting existing enterprise ID's.

Solution Script & Explanation.

export DATABASE_HOME=<Path of Bin directory for your specific database implementation>

export DATABASE_NAME=<Database Instance Name>

export DATABASE_HOST=<Database Login ID for MDM>

export WAS_CELL=<WAS cell described during implementation>

export WAS_PROFILE=<Was profile described during implemetation>

export MAD_DBNAME=$DATABASE_NAME

export MAD_DBUSER=md<DB username>

export MAD_DBPASS=<DB password>

export MAD_DSNNAME=<DNS Name provided in MDM configuration file>

export WAS_HOME=/opt/IBM/WebSphere/AppServer

export JAVA_HOME=$WAS_HOME/java/jre

export WAS_SECURITY=1

export MAD_TIMER=1

export MAD_ROOTDIR=<MDM Application Root Directory>

export MAD_HOMEDIR=$MAD_ROOTDIR/<Directory path for Configuration Project>

export MAD_WORKDIR=$MAD_HOMEDIR/work

export MAD_UNLDIR=$MAD_WORKDIR/unl

export MAD_BXMDIR=$MAD_WORKDIR/bxm

export MAD_DDLFILE=$MAD_HOMEDIR/sql/mpihub.ddl

export MAD_STOFILE=$MAD_HOMEDIR/sql/mpihub.sto

export MAD_LOGDIR=$MAD_WORKDIR

export MAD_CONNSTR="DSN=MDM11DB_E001;UID=mdmins11;PWD=mdmins11;"

export MAD_CTXLIB=ODBC

export MAD_DBTYPE=DB2

export PATH=$PATH:$MAD_ROOTDIR/bin

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$MAD_ROOTDIR/lib

export CLASSPATH=$JAVA_HOME:$CLASSPATH

export CLASSPATH=$WAS_HOME/runtimes/com.ibm.ws.admin.client_8.5.0.jar:$WAS_HOME/runtimes/com.ibm.ws.ejb.thinclient_8.5.0.jar:$CLASSPATH

export CLASSPATH=$JAVA_HOME:$CLASSPATH

export CLASSPATH=$WAS_HOME/runtimes/com.ibm.ws.admin.client_8.5.0.jar:$WAS_HOME/runtimes/com.ibm.ws.ejb.thinclient_8.5.0.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/j2ee.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/naming.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/ras.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/wsexception.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/bootstrap.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/emf.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/ecutils.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/iwsorb.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/idl.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/ffdc.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/namingclient.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/lib/ejbcontainer.jar:$CLASSPATH

export CLASSPATH=$WAS_HOME/properties:$CLASSPATH

mpxprep -entType mdmper -bxmOutDir $MAD_HOMEDIR/work/dev_config/work/bxm -ixmMode -nbktparts 1  -srcRecno 292

mpxrule -entType mdmper -bxmOutDir $MAD_HOMEDIR/work/dev_config/work/bxm

mpxxeia -entType mdmper -bxmOutDir $MAD_HOMEDIR/work/dev_config/work/bxm

mpxxtsk -entType mdmper -bxmOutDir $MAD_HOMEDIR/work/dev_config/work/bxm

mpxcomp -entType mdmper -bxmInpDir $MAD_HOMEDIR/work/dev_config/work/bxm -bxmOutDir $MAD_HOMEDIR/work/dev_config/work/bxm -ixmMode -nbktParts 1 -nthreads 2