Configuring the MDM server for bulk load operations - 8.0

Talend Installation Guide for Linux

Version
8.0
Language
English
EnrichDitaval
Linux
EnrichSubscriptionType
Subscription
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend ESB
Talend Identity and Access Management
Talend Installer
Talend JobServer
Talend LogServer
Talend MDM Server
Talend MDM Web UI
Talend Runtime
Talend SAP RFC Server
Talend Studio
Content
Installation and Upgrade
Available in...

Data Fabric

MDM Platform

When bulk loading large volumes of data into MDM, you may encounter the transaction and deadlock issues since too many threads on the server side are trying to obtain database connections.

Procedure

  1. Browse to the file <$INSTALLDIR>/conf/mdm.conf and open it.
  2. Configure the following two parameters according to your needs:
    #To avoid connection pool and database overload, default value is 25
    bulkload.concurrent.database.requests=30
    
    #Control how many milliseconds to wait before retry, default value is 200
    bulkload.concurrent.wait.milliseconds=300
    In this example, the maximum number of concurrent database requests is set to 30 and the request retry wait time to 300 milliseconds.
  3. Save your changes into the file.