Recommendations about environment and configuration for the Talend Administration Center - 6.5

Recommended minimal CPU (*) number for each Talend Administration Center host

2

4

8

Recommended minimal memory for each Talend Administration Center host

>= 3000 MB

>= 4000 MB

>= 8000 MB

Recommended minimal memory for each Talend Administration Center JVM (-Xmx)

>= 1500 MB

>= 3000 MB

>= 6000 MB

Recommended minimal CPU (*) number for database(**) host

2

4

6

Recommended minimal memory for database(**) host

>= 1500 MB

>= 3000 MB

>= 6000 MB

Recommended minimal number of remote JobServers

1

2

2

Recommended minimal CPU (*) number for each JobServer host

(apart from CPU needed for JVM of executed jobs)

1

2

2

Recommended minimal memory for each JobServer host

(apart from memory needed for JVM of executed jobs)

>= 1000 MB

>= 2500 MB

>= 5000 MB

Recommended minimal memory for each JobServer JVM (-Xmx)

>= 250 MB

>= 500 MB

>= 1000 MB

Maximum number of database connections in the Quartz connection pool

Talend Administration Center configuration file

"WEB-INF/classes/quartz.properties" :

org.quartz.dataSource.QRTZ_DS.maxConnections

30

MAX_CONCURRENT_TASK_EXECUTIONS + MAX_CONCURRENT_PLAN_EXECUTIONS

Maximum number of concurrent Jobs handled by the Scheduler

Talend Administration Center configuration file

"WEB-INF/classes/quartz.properties" :

org.quartz.threadPool.threadCount

30

MAX_CONCURRENT_TASK_EXECUTIONS + MAX_CONCURRENT_PLAN_EXECUTIONS

Maximum database connections for Talend Administration Center (apart from Quartz)

Talend Administration Center configuration file

"WEB-INF/classes/configuration.properties" :

hibernate.c3p0.max_size

32

MAX_CONCURRENT_TASK_EXECUTIONS + MAX_CONCURRENT_PLAN_EXECUTIONS + MAX_CONCURRENT_LOGGED_USERS

It defines the period between each remote Job check

Talend Administration Center database table configuration

scheduler.conf.taskStatusRefreshTime

1

MAX_CONCURRENT_TASK_EXECUTIONS / 500

Defines the size of thread pool which checks the latest executions at startup

Talend Administration Center database table configuration

dashboard.conf.taskExecutionsHistory.threadPoolSize

10

( MAX_CONCURRENT_TASK_EXECUTIONS + MAX_CONCURRENT_PLAN_EXECUTIONS ) / 25

Defines the size of thread pool which checks all the tasks at startup

Talend Administration Center database table configuration

scheduler.conf.simultaneousThreadsForStatusRefresh

5

MAX_CONCURRENT_TASK_EXECUTIONS / 50

Defines the number of maximum opened files for database process

Host of database server

Maximum opened files:

For example, under Linux set the Mysql configuration property "open_files_limit" and ensure that the system file limit is >= to the formula on the right

(depends on operating system)

( MAX_CONCURRENT_TASK_EXECUTIONS + MAX_CONCURRENT_PLAN_EXECUTIONS + MAX_CONCURRENT_LOGGED_USERS ) x 3

Defines the number of maximum connections allowed to the database

Database server

Max connections:

For example, set the Mysql configuration property "max_connections = 10000"

(depends on database vendor)

( MAX_CONCURRENT_TASK_EXECUTIONS + MAX_CONCURRENT_PLAN_EXECUTIONS + MAX_CONCURRENT_LOGGED_USERS ) x 3

Defines the maximum number of concurrent connections accepted by the JobServer

JobServer configuration file

"conf/TalendJobServer.properties" :

org.talend.remote.server.MultiSocketServer.

MAX_CONCURRENT_CONNECTIONS

1000

MAX_CONCURRENT_JOBS_EXECUTIONS x 2