TPS-4889 (cumulative patch) - 7.2

Introduction

This patch is cumulative. It includes all previous generally available patches for Talend Jobserver 7.2.1.

NOTE: For information on how to obtain this patch, reach out to your Support contact at Talend.

Fixed issues

This patch contains the following fixes:

• TPS-3311: USAF Case/Jira Status- Case 00144616 (TPSVC-10365)
• TPS-3332: Remove hard coded keys used for encryption from JobServer(TPSVC-10892)
• TPS-3382: Default context is generated in children job folder falsely (TPSVC-11101)
• TPS-3445: Not able to overwrite context param through TAC using BigData jobs(TPSVC-11563)
• TPSVC-12049: Tasks are intermittently failed with jobserver connection issue jobs(TAC-13365)
• TPSVC-10197: The connection from TAC to a Windows job server has been permanently lost (TAC-12713)
• TPS-3739: TAC issue connecting to Jobserver's JMX and command server (TPSVC-12997)
• TPS-4319: JobServer memory leak related to ZeroMQ mailbox (TPSVC-12728)
• TPS-4431: Cannot stop jobserver gracefully using stop_rs.bat (TPSVC-8886)(TPSVC-15803)
• TPSVC-15923 TAC / Jobserver resiliency issue with flaky network
• TPS-4657: Tasks redeployed after each restart of the jobserver (TPSVC-13658)(TPSVC-16974)
• TPS-4889: Backport 'Allow passing predefined execution ids to JobServer' to 7.2.1 (TPRUN-1489)

Prerequisites

Consider the following requirements for your system:

• Talend Jobserver 7.2.1 must be installed.

Installation

1. Create a backup for the patched files in <jobserver_home>/lib, <jobserver_home>/keystores/SSLKeystore,
   and <TalendHome>\jobserver\TalendServices\conf\wrapper.conf and backup <jobserver_home>/stop_rs.*
2. Stop Jobserver.
3. Remove files

'daikon-signature-verifier-0.27.0.jar' 'daikon-0.27.0.jar' 'crypto-utils-1.2.0.jar' 'commons-io-2.2.jar'

from folder <jobserver_home>/lib

1. Copy & replace patch files

'org.talend.remote.jobserver.server.standalone-7.2.1.jar' 'org.talend.remote.server-7.2.1.jar' 'org.talend.remote.jobserver.commons-7.2.1.jar' 'org.talend.remote.commons-7.2.1.jar' 'org.talend.monitoring.server-7.2.1.jar' 'org.talend.monitoring-7.2.1.jar' 'daikon-signature-verifier-0.27.1.jar' 'daikon-0.27.1.jar' 'crypto-utils-0.27.1.jar' 'commons-io-2.6.jar'

into folder <jobserver_home>/lib 5. Delete /keystores/SSLKeystore 6. In case you observe ZMQ related memory leaks set org.talend.remote.jobserver.server.TalendJobServer.ENABLED_PROCESS_MESSAGE=false in conf/TalendJobServer.properties. 7. Copy stop.* to <jobserver_home> 8. Set org.talend.remote.jobserver.commons.config.JobServerConfiguration.RESTORE_JOBTABLE=true in conf/TalendJobServer.properties if you want JobServer to retrieve the job table from cache after restart to avoid redeployment of already deployed jobs. 9. Start Jobserver

Installation of the Windows Service

1. Stop the Jobserver Windows service.
2. Adapt <TalendHome>\jobserver\TalendServices\conf\wrapper.conf ... wrapper.java.classpath.13 = ./lib/daikon-0.27.1.jar wrapper.java.classpath.14 = ./lib/daikon-signature-verifier-0.27.1.jar ... wrapper.java.classpath.27 = ./lib/crypto-utils-0.27.1.jar
3. Start the windows service

Uninstallation

1. Stop Jobserver.
2. Copy & replace the following files from your saved copy

'org.talend.remote.jobserver.server.standalone-7.2.1.jar' 'org.talend.remote.server-7.2.1.jar' 'org.talend.remote.jobserver.commons-7.2.1.jar' 'org.talend.remote.commons-7.2.1.jar' 'org.talend.monitoring.server-7.2.1.jar' 'org.talend.monitoring-7.2.1.jar' 'daikon-signature-verifier-0.27.0.jar' 'daikon-0.27.0.jar' 'crypto-utils-1.20.0.jar' 'commons-io-2.2.jar'

1. Remove

'daikon-signature-verifier-0.27.1.jar' 'daikon-0.27.1.jar' 'crypto-utils-0.27.1.jar' 'commons-io-2.6.jar'

from <jobserver_home>/lib 3. Restore the file 'SSLKeystore' into folder '/keystores' 4. Restore <TalendHome>\jobserver\TalendServices\conf\wrapper.conf 5. Restore <jobserver_home>/stop_rs.* 6. Start Jobserver

Uninstallation from the Windows Service

1. Stop the Jobserver Windows service.
2. Adapt <TalendHome>\jobserver\TalendServices\conf\wrapper.conf wrapper.java.classpath.6 = ./lib/commons-io-2.2.jar ... wrapper.java.classpath.13 = ./lib/daikon-0.27.0.jar wrapper.java.classpath.14 = ./lib/daikon-signature-verifier-0.27.0.jar ... wrapper.java.classpath.27 = ./lib/crypto-utils-1.20.0.jar
3. Start the windows service

Affected files for this patch

The following files are installed by this patch:

• 'org.talend.remote.jobserver.server.standalone-7.2.1.jar'
• 'org.talend.remote.server-7.2.1.jar'
• 'org.talend.remote.jobserver.commons-7.2.1.jar'
• 'org.talend.remote.commons-7.2.1.jar'
• 'org.talend.monitoring.server-7.2.1.jar'
• 'org.talend.monitoring-7.2.1.jar'
• 'daikon-signature-verifier-0.27.1.jar'
• 'daikon-0.27.1.jar'
• 'crypto-utils-0.27.1.jar'
• 'commons-io-2.6.jar'
• 'stop_rs.*'

The following files have to be removed when installing this patch: - '/keystores/SSLKeystore' - '/lib/crypto-utils-1.20.0.jar' - '/lib/daikon-signature-verifier-0.27.0.jar' - '/lib/daikon-0.27.0.jar' - '/lib/commons-io-2.2.jar'

New configuration parameters

• org.talend.remote.jobserver.commons.config.JobServerConfiguration.SECURE_CONTEXTS=true

Set to false to avoid the creation of a temporary context file - useful for big data jobs where the default context is inside the job jar. Note that if the default context is not found JS automatically uses the command line to transfer context parameters even if org.talend.remote.jobserver.commons.config.JobServerConfiguration.SECURE_CONTEXTS=true.

• org.talend.remote.jobserver.commons.config.JobServerConfiguration.RESTORE_JOBTABLE=true

Set to true to retrieve the job table from cache after restart to avoid redeployment of already deployed jobs. Set to false to ignore cache contents after restart.