Configuring the MDM server for bulk load operations - 7.0

Talend Data Fabric Installation Guide for Linux

EnrichVersion
7.0
EnrichProdName
Talend Data Fabric
task
Installation and Upgrade
EnrichPlatform
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend DQ Portal
Talend ESB
Talend Identity and Access Management
Talend Installer
Talend JobServer
Talend Log Server
Talend MDM Server
Talend MDM Web UI
Talend Repository Manager
Talend Runtime
Talend SAP RFC Server
Talend Studio
When bulk loading large volumes of data into MDM, you may encounter the transaction and deadlock issues since too many threads on the server side are trying to obtain database connections.

Procedure

  1. Browse to the file <$INSTALLDIR>/conf/mdm.conf and open it.
  2. Configure the following two parameters according to your needs:
    #To avoid connection pool and database overload, default value is 25
    bulkload.concurrent.database.requests=30
    
    #Control how many milliseconds to wait before retry, default value is 200
    bulkload.concurrent.wait.milliseconds=300
    In this example, we set the maximum number of concurrent database requests to 30 and the request retry wait time to 300 milliseconds.
  3. Save your changes into the file.