TPS-4966 (cumulative patch)

Info	Value
Patch Name	Patch_20211022_TPS-4966_v1-7.3.1
Release Date	2021-10-22
Target Version	20200219_1130-V7.3.1
Product affected	Talend Administration Center

Introduction

This patch is cumulative. It includes all previous generally available patches for Talend Administration Center 7.3.1.

NOTE: To download this patch, liaise with your Support contact at Talend.

Fixed issues

This patch is cumulative and contains the following fixes:

TPS-3836 [7.3.1] LDAPs connection failure on TAC Coinfiguration page,LDAP user can not login(TAC-14109)
TPS-3977 [7.3.1] Not possible to assign authorizations beyond 127 projects in TAC. (TAC-14177)
TPS-4016 [7.3.1] After migrate from 6.4.1 to 7.3.1,login 7.3.1 TAC failed(TAC-14196)
TPS-4088 [7.3.1] Studio doesn't fetch Use SSL for remote jobserver from TAC(TAC-14085)
TPS-4100 [7.3.1] SaveESBTask command fails with error {"returnCode": 1} on metaservlet while publishing route.(TAC-14301)
TPS-4075 [7.3.1] TAC is not response, when modified the project description then clicked save (TAC-14269)
TPS-4119 [7.3.1] content of boolean Variables in Tac has not the expected values (TAC-14283)
TPS-4122 [7.3.1] Not possible to assign authorizations beyond 127 projects in TAC for usergroup users (TAC-14315)
TPS-4171 [7.3.1] Cross migration doesn't work (TAC-13970)
TPS-4148 [7.3.1] Issue with context list during Task creation not showing all contexts (TAC-13776)
TPS-4168 [7.3.1] tRestClient - base64 - metaServlet : Input byte array has wrong 4-byte ending unit (TAC-14339)
TPS-4174 [7.3.1] taskexecutionhistory table cleaning is not triggered automatically for a specific TAC DB(TAC-14375)
TPS-4203 [7.3.1] org.talend.administrator.common.exception.DBException: !!!Cannot flush and commit transaction.!!! (TAC-13204)
TPS-4214 [7.3.1] Cannot upgrade the TAC DB 6.1.1 to TAC DB 7.3.1 (TAC-14400)
TPS-4251 [7.3.1] After migration from 6.4->7.3.1(MSSQL), metaservlet command listTasks returns NullPointerException.(TAC-14403)
TPS-4127 [7.3.1] The realtime statistics of a job run in TAC are visible in real time statastics page with a delay (TAC-14308)
TPS-4313 [7.3.1] "Read" user can commit changes to git server (TAC-14485)
TPS-4345 [7.3.1] Context issue with double-quotes in custom value if the original value is enclosed in double quotes (TESB-28908)
TPS-4258 [7.3.1] Users page goes blank after removing some columns from the view (TAC-14457)
TPS-4288 [7.3.1] TAC login is case sensitive for regular and ldap users (TAC-14230)
TPS-4315 [7.3.1] TAC is not sending out notifications when task fails or user is created (TAC-14274)
TPS-4350 [7.3.1] TAC is hanging when modify project description field or any other fields in TAC project (TAC-14565)
TPS-4376 [7.3.1] TAC begins to hang / frozen (TAC-14369)
TPS-4451 [7.3.1] "associatePreGeneratedJob" response time issue (TAC-14660)
TPS-4395 [7.3.1] libraries migrations : error with filename containing whitespace (TAC-11721)
TPS-4406 [7.3.1] Nexus 3 with "nexus-context-path=/nexus" is not functioning (TAC-14509)
TPS-4423 [7.3.1] Context Parameters are reset during updateTask using MetaServlet (TAC-14656)
TPS-4463 [7.3.1] 401 Authentication credentials were missing or incorrect
TPS-4474 [7.3.1] Context variables in TAC not updated after re-importing from Nexus(TAC-14695)
TPS-4492 [7.3.1] DB migration issue with TAC in 7.3.1(TAC-14496)
TPS-4508 [7.3.1] Restart job option does not work when it is configured in TAC (TAC-14726)
TPS-4528 [7.3.1] Swap of original values and custom value in TAC (TESB-31017)
TPS-4451 [7.3.1] "associatePreGeneratedJob" response time issue (TAC-14660) (fix version 2)
TPS-4537 [7.3.1] Retrieve Virtual Servers from TAC to Studio (TAC-14742)
TPS-4540 [7.3.1] Metaservlet Create tag via metaservlet not working when branch not whitelisted (TAC-14782)
TPS-4545 [7.3.1] [ESB conductor] can't create task with snapshots version (TESB-31136)
TPS-4576 [7.3.1] Update studio certificates for signing of job zip (TAC-14816)
TPS-4557 [7.3.1] Setting "Use https (SSL/TLS)" Parameter via TAC Metaservlet API (TAC-14813)
TPS-4579 [7.3.1] JVM Parameters Issue in 7.3 TAC (TAC-14823)
TPS-4594 [7.3.1] Error happened while reading contexts from the source file!!!,"returnCode":5 (TAC-14841)
TPS-4588 [7.3.1] The Console logs in TAC is not visible after applying the patch Latest 7.3 TAC Patch (TAC-14840)
TPS-4619 [7.3.1] Job Conductor page UI issues (TAC-14853)
TPS-4634 [7.3.1] there is not the notification email received when the task failed (TAC-14783)
TPS-4665 [7.3.1] Artifactory - Not able to select context in ESB conductor(TESB-31816)
TPS-4660 [7.3.1] Catalina log is filing up with lot of debugs(TAC-14901)
TPS-4662 [7.3.1] TAC-DB migration problem 6.4 to 7.3 (oracle 12c to 19c)(TAC-14920)
TPS-4658 [7.3.1] TAC7.3.1 when adding artefact through normal task, issue with context variable type (TAC-14864)
TPS-4690 [7.3.1] Smtp fails with TLS error on 7.3(TAC-14892)
TAC-14737 [7.3.1] Github Renaming the default branch from master
TPS-4750 [7.3.1] Contexts of ESB Task not updated when ESB Task is updated with new artifact version (TESB-32442)
TPS-4745 [7.3.1] Trigger context fileName, filePath and folderPath not passed to the job (TAC-15017)
TPS-4749 [7.3.1] Able to see/run tasks in projects not having authorization when only using custom roles (TAC-15038)
TAC-14549 [7.3.1] Metaservlet: cannot delete project without authorization
TAC-13187 [7.3.1] Can't send email notifications when running Java11
TESB-28187 [7.3.1] SaveEsbTask metaservlet command does not set context as active.
TAC-14218 [7.3.1] "/nexus" is hardcoded in NexusBrowserBusiness.class.
TESB-29552 [7.3.1] TAC: StringIndexOutOfBoundsException when creating ESB Conductor Tasks
TAC-14039 [7.3.1] Intermittent issue of StringIndexOutOfBoundsException for TaskExecutionHistoryLogge
TAC-14391 [7.3.1] TAC: Option to remove "Rights Management" from 'Administrative Use' role
TAC-14634 [7.3.1] Metaservlet "associatePreGeneratedJob" API is taking Default as context group
TAC-14766 [7.3.1] TAC(MariaDB 10.1) -> Timeline page throws error after installing patch TPS-4322
TAC-14860 [7.3.1] Metaservlet call to createUserGroup fails with {"returnCode":5}
TAC-13817 [7.3.1] Support Cache-Control attributes (No-store, No-cache)
TAC-13761 [7.3.1] Tooo long time to complete the Job server status check
TAC-14670 [7.3.1] TAC resiliency issue with statistics port
TAC-14896 [7.3.1] TAC Errors after installing TAC Patch_20201218_TPS-4556_v2
TAC-14968 [7.3.1] TAC-ESB is not able to deploy routes / nor displays runtimes
TAC-14960 [7.3.1] Failed to deploy artifacts: Could not find artifact error when trying to publish jobs
TPS-4626 [7.3.1] Viewer role do not have access to view Execution logs under Job conductor(TAC-14796)
TPS-4724 [7.3.1] Roles for download an artifact from Nexus in TAC Job Conductor view (TAC-14316)
TAC-15097 [7.3.1] project does not show in UI after executing CreateProject metaservlet command
TAC-15054 [7.3.1] Execute update project by MetaServlet failed with {"returnCode":1}
TAC-15124 [7.3.1] metaservlet listTrigger fails
TAC-14924 [7.3.1] Displaying order is not consistent at Job Conductor screen
TAC-14229 [7.3.1] Add functionality to display the actual TAC version to know the installed PATCH
TAC-14811 [7.3.1] Zero byte job execution log issue on TAC
TAC-14964 [7.3.1] Jobs stuck in RUNNING status (recovery mechanism for tasks and plans)
TPS-4659 [7.3.1] the pause button on trigger does not work perfectly (TAC-14871)
TPS-4689 [7.3.1] Cannot reach svn server(TAC-14843)
TPS-4765 [7.3.1] Metaservlet associatePreGeneratedJob error: This job doesn't have context: 'Default' (TAC-15086)
TAC-15219 [7.3.1] not able to migrate mssql database from 6.1.1 to 7.3.1 (TAC-14697)
TAC-15128 [7.3.1] TAC - GIT configuration
TAC-14666 [7.3.1] TAC migration failed with h2 DB
TAC-14973 [7.3.1] Execution Plans fails with status: INTERRUPTED, RUNNING_ERROR, PLAN_LAUNCHED, RUNNING_ERROR and ENDED_WITH_WARNING (fixed interrupted plan status issue
TAC-15165 [7.3.1] select nexus job should display "Select artifact from Nexus" when if I use nexus as my artifactory repository type
TAC-15265 [7.3.1] TAC / JOB CONDUCTOR : Error: Connection to server failed when deploying a job - jobserverClient.port.timeout (default timeout increased to 5 seconds)
TPS-4784 [7.3.1] ERROR TalendRemoteServiceServlet - Expected to find an object with property ['items'] in path $ but found 'java.lang.String' (TAC-15016)
TPS-4785 [7.3.1] OutofMemory issue caused by RemoteDataRetreiver - Java heap space (TAC-14970)
TPS-4786 [7.3.1] job conductor error : History for task 'undefined' when an artifact is changed from an artifact task (TAC-15158)
TPS-4796 [7.3.1] "Save failed: No more DP (2) user available with this license" when updating an existing DP user. (TAC-15009)
TPS-4800 [7.3.1] The metaservlet 'updatetask' action does not update the new context variable of a new version of job in TAC (TAC-15037)
TPS-4813 [7.3.1] Add group field in Nexus Artifact selection to avoid search list can not be retrieved (TAC-13164)
TAC-15127 [7.3.1] The response for createTrigger metaservlet is not as expected when task id doesn't exist
TAC-15235 [7.3.1] ImportExecutionPlan command for Metaservlet not working in TAC
TAC-14108 [7.3.1] Need a RELIABLE way to identify if 2 or more TAC instances (not clusters) are using one DB schema
TAC-15257 [7.3.1] Not able to save edited plan after added
TAC-14939 [7.3.1] Provide a mechanism to collect the information about TPS patch installed on customer
TAC-14898 [7.3.1] Pop for cloud migration in TAC upon login
TAC-15307 [7.3.1] Newly added execution plan can't be displayed on UI if there is no task
TAC-15204 [7.3.1] RCA for TAC blank page / stuck at license check
TAC-14674 [7.3.1] download patch failed when use artifacotry for talend-updates
TAC-15214 [7.3.1] Correct metaServlet documentation
TAC-15244 [7.3.1] If "Use Latest Version" checkbox is checked when saving an Artifact Task with JFrog Artifactory 6.10.9, an exception is encountered
TAC-15255 [7.3.1] The status icon is always spinning for LDAP configuration
TAC-15322 [7.3.1] Sort on "Time left before next triggering" failed with error on oracle 12c
TAC-15133 [7.3.1] Root task status is not as same as before when killed due to timeout for plan
TAC-15378 [7.3.1] "nullpointer exception" in the TAC page : PROJECT AUTHORIZATIONS
TAC-14735 [7.3.1] audit of users who are updating contexts from TAC
TAC-15398 [7.3.1] NPE on 7.3.1 when select sort on next trigger time on JobConductor
TPS-4853 [7.3.1] Checking connection' warning after adding GIT project (TAC-15090)
TPS-4857 [7.3.1] Incorrect EP status when tasks fails during EP run with parallel execution and Cron trigger (TAC-15362)
TPS-4870 [7.3.1] Request patch for issue Authorization page can't retrieve user from IAM(TAC-15403)
TAC-15403 [7.3.1] Authorization page can't retrieve user from IAM
TAC-15394 [7.3.1] Customized processMessagePort not reflecting in TAC UI
TAC-15439 [7.3.1] Delete user failed for custom role is disabled.
TAC-14240 [7.3.1] Metaservlet API listUsers : Add field to show if user logged in, similar to UI securityadmin users list
TAC-11581 [7.3.1] Customer would like to be able to limit accress more granularly and create new roles
TAC-14615 [7.3.1] Role with job conductor author + job conductor view can modify the triggers
TAC-14681 [7.3.1] TAC Role Granularity - role where user can RUN and VIEW jobs, but cannot create trigger.
TAC-13816 [7.3.1] Support for HTTP Strict Transport Security (HSTS) in TAC
TAC-15427 [7.3.1] H2 DB migration failed from 721 to 731
TPS-4866 [7.3.1] Cannot migrate the TAC DB from H2 to MySQL in 7.3.1 (TAC-15372)
TPS-4881 [7.3.1] issue with the update of the password page when French language is chose (TAC-15466)
TAC-15332 [7.3.1] after TAC restart, one particular job can't be triggered (fixed NPE-s)
TAC-15492 [7.3.1] Migrated datatypes don't match the non-migrated datatypes
TAC-15524 [7.3.1] Click on "Recipients" will show error !!!Cannot flush and commit transaction.!!!
TPS-4860 [7.3.1] MetaServlet command "requestDeployEsbTask" causes "All bundles are not active" even though all bundles are active in Runtime (APPINT-33143)
TPS-4886 [7.3.1] Context variables in TAC 7.3.1 not updated after re-importing task from nexus (TAC-15426)
TPS-4898 [7.3.1] Task not changing to "Ready to deploy" state in Job Conductor (TAC-15379)
TPS-4900 [7.3.1] TAC throws NotificationExec NPE and fails sending task-failure notification mail (TAC-15461)
TAC-15240 [7.3.1] Remove truncated "digests" of AWS credentials
TAC-15456 [7.3.1] Update the parameter 'contextparamsrefresh' to 'contextParamsRefresh' for metaservlet 'updatetask' action
TPS-4905 [7.3.1] .cfg file doesn't contain all the info (TAC-15541)
TPS-4907 [7.3.1] "failed to lazily initialize a collection of role: org.talend.model.conductor.ExecutionVirtualServer.executionServers" (TAC-15565)
TAC-15314 [7.3.1] Need assistance on siteminder configuration for customer
TAC-15361 [7.3.1] unable to use TLS 1.2 only smtp server with JDK 8_292 and TAC
TAC-14449 [7.3.1] Support of auth with Tokens in TAC
TAC-15627 [7.3.1] TAC patch install notes regarding schema migration with liquibase
TAC-15566 [7.3.1] TAC goes to hang state, problem is in LOCKS on the "dbo.taskexecutionhistory" table
TAC-15388 [7.3.1] Exhausted DB connections from DB pool
TAC-15343 [7.3.1] job conductor slow to open / display execution logs
TPS-4913 [7.3.1] Artifact task stuck in TASK_LAUNCHED status (TAC-15518)
TPS-4966 [7.3.1] throw java.sql.SQLException: READ_COMMITTED and SERIALIZABLE when switching to executionhistory with oracle DB (TAC-15697)

Security fixes

This patch includes the security fixes:

TPS-4255 [7.3.1] Security fix cross site script vulnerability in Project section (ulr field)(TAC-14300)
TPS-4698 [7.3.1] Stored Cross Site Scripting (XSS) (TAC-14821)
TAC-14921 [7.3.1] External library updates
TAC-14806 [7.3.1] TAC Web UI cookie contains version information
TAC-14167 [7.3.1] Fix OS commands injection issues
TAC-15110 [7.3.1] Security method SecurityUtils.isSafePath() doesn`t work correctly on windows env
TAC-15259 [7.3.1] TAC vulnerability - "Auto-complete-enabled"
TAC-15032 [7.3.1] VULN ID - 53109575 - Insufficient Authentication
TAC-15026 [7.3.1] VULN ID - 53109573 - Session Fixation
TAC-15030 [7.3.1] VULN ID - 53109571 -Insufficient session expiration
TAC-15305 [7.3.1] Vulnerability is in a direct dependency XStream Core
TAC-15478 [7.3.1] Vulnerability found in json-smart lib
TAC-15517 [7.3.1] This vulnerability is in a direct dependency Maven Core was found
TAC-15589 [7.3.1] Vulnerability found in maven-compat lib

Deprecated items

From TPS-4913, below features are deprecated:

Activity Monitoring Console(AMC)
Publisher
SVN for project storage

Prerequisites

Consider the following requirements for your system:

Talend Administration Center 7.3.1 must be installed.

Installation

Logon TAC and switch to Configuration-> Software Update, then enter the correct values and save referring to the documentation: https://help.talend.com/r/en-US/7.3/installation-guide-big-data-linux/config-update-repo
Switch to Software update page, where the new patch will be listed. The patch can be downloaded from here into the nexus repository.
Login to local Nexus, and download the patch file.
Stop the TAC.
Create a patch directory (eg: <Talend>/TAC_Patch).
Unzip patch file you received from support into this directory, then unzip the org.talend.administrator.war file as org.talend.administrator folder. (Note: Please rename org.talend.administrator-7.3.1.war if your old tac application folder has a different name. Set the name as same as your old TAC application name).
Create a backup directory (eg: <Talend>/TAC_Backup).
Copy folder <Tomcat>/webapps/org.talend.administrator into the backup directory.
In <Tomcat>/webapps/ directory, remove the previous org.talend.administrator folder, then copy the org.talend.administrator folder from step6 and paste in the current directory.
Restore TAC configuration by replacing <Tomcat>/webapps/org.talend.administrator/WEB-INF/classes/configuration.properties and quartz.properties with ones from your backup directory.

Note:
- If your TAC db is H2 db and embedded in TAC web folder (<Tomcat>/webapps/org.talend.administrator/WEB-INF/database by default), don't forget to restore H2 db by replacing this folder with the exact corresponding folder from your backup directory.
- If your TAC works with SSO, you should restore the IDP Metadata file (<Tomcat>/webapps/org.talend.administrator/WEB-INF/classes/IDPMetadata.xml) from your backup directory.
- <TOMCAT>/endorsed/talend-url-mvn-1.0.0.jar is not needed any more, you can delete this jar.
Restart the TAC.

Note:
- It's recommended to clear browser cache after TAC patch were applied.
- Added the Jobserver client connection timeout param: jobserverClient.port.timeout, please update the value in DB when met the SocketTimeoutException error(unit is millisecond): UPDATE UPDATE configuration SET configuration.value = "8000" WHERE configuration.key = "jobserverClient.port.timeout";;