Configuring the MDM server for bulk load operations - 8.0

Talend Installation Guide

Version
8.0
Language
English
Operating system
Windows
Subscription type
Subscription
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend ESB
Talend Identity and Access Management
Talend Installer
Talend JobServer
Talend LogServer
Talend MDM Server
Talend MDM Web UI
Talend Runtime
Talend SAP RFC Server
Talend Studio
Content
Installation and Upgrade
Last publication date
2022-10-30
Available in...

Data Fabric

MDM Platform

When bulk loading large volumes of data into MDM, you may encounter the transaction and deadlock issues since too many threads on the server side are trying to obtain database connections.

Procedure

  1. Browse to the file <$INSTALLDIR>\conf\mdm.conf and open it.
  2. Configure the following two parameters according to your needs:
    #To avoid connection pool and database overload, default value is 25
    bulkload.concurrent.database.requests=30
    
    #Control how many milliseconds to wait before retry, default value is 200
    bulkload.concurrent.wait.milliseconds=300
    In this example, the maximum number of concurrent database requests is set to 30 and the request retry wait time to 300 milliseconds.
  3. Save your changes into the file.