TPS-4989 (cumulative patch) - 7.3

Version
7.3
Language
English (United States)
Product
Talend Data Fabric
Module
Talend Administration Center

TPS-4989 (cumulative patch)

Info Value
Patch Name Patch_20211105_TPS-4989_v1-7.3.1
Release Date 2021-11-05
Target Version 20200219_1130-V7.3.1
Product affected Talend Administrator Center

Introduction

This patch is cumulative. It includes all previous generally available patches for Talend Administrator Center 7.3.1.

NOTE: To download this patch, liaise with your Support contact at Talend.

Fixed issues

This patch is cumulative and contains the following fixes:

  • TPS-3836 [7.3.1] LDAPs connection failure on TAC Coinfiguration page,LDAP user can not login(TAC-14109)
  • TPS-3977 [7.3.1] Not possible to assign authorizations beyond 127 projects in TAC. (TAC-14177)
  • TPS-4016 [7.3.1] After migrate from 6.4.1 to 7.3.1,login 7.3.1 TAC failed(TAC-14196)
  • TPS-4088 [7.3.1] Studio doesn't fetch Use SSL for remote jobserver from TAC(TAC-14085)
  • TPS-4100 [7.3.1] SaveESBTask command fails with error {"returnCode": 1} on metaservlet while publishing route.(TAC-14301)
  • TPS-4075 [7.3.1] TAC is not response, when modified the project description then clicked save (TAC-14269)
  • TPS-4119 [7.3.1] content of boolean Variables in Tac has not the expected values (TAC-14283)
  • TPS-4122 [7.3.1] Not possible to assign authorizations beyond 127 projects in TAC for usergroup users (TAC-14315)
  • TPS-4171 [7.3.1] Cross migration doesn't work (TAC-13970)
  • TPS-4148 [7.3.1] Issue with context list during Task creation not showing all contexts (TAC-13776)
  • TPS-4168 [7.3.1] tRestClient - base64 - metaServlet : Input byte array has wrong 4-byte ending unit (TAC-14339)
  • TPS-4174 [7.3.1] taskexecutionhistory table cleaning is not triggered automatically for a specific TAC DB(TAC-14375)
  • TPS-4203 [7.3.1] org.talend.administrator.common.exception.DBException: !!!Cannot flush and commit transaction.!!! (TAC-13204)
  • TPS-4214 [7.3.1] Cannot upgrade the TAC DB 6.1.1 to TAC DB 7.3.1 (TAC-14400)
  • TPS-4251 [7.3.1] After migration from 6.4->7.3.1(MSSQL), metaservlet command listTasks returns NullPointerException.(TAC-14403)
  • TPS-4127 [7.3.1] The realtime statistics of a job run in TAC are visible in real time statastics page with a delay (TAC-14308)
  • TPS-4313 [7.3.1] "Read" user can commit changes to git server (TAC-14485)
  • TPS-4345 [7.3.1] Context issue with double-quotes in custom value if the original value is enclosed in double quotes (TESB-28908)
  • TPS-4258 [7.3.1] Users page goes blank after removing some columns from the view (TAC-14457)
  • TPS-4288 [7.3.1] TAC login is case sensitive for regular and ldap users (TAC-14230)
  • TPS-4315 [7.3.1] TAC is not sending out notifications when task fails or user is created (TAC-14274)
  • TPS-4350 [7.3.1] TAC is hanging when modify project description field or any other fields in TAC project (TAC-14565)
  • TPS-4376 [7.3.1] TAC begins to hang / frozen (TAC-14369)
  • TPS-4451 [7.3.1] "associatePreGeneratedJob" response time issue (TAC-14660)
  • TPS-4395 [7.3.1] libraries migrations : error with filename containing whitespace (TAC-11721)
  • TPS-4406 [7.3.1] Nexus 3 with "nexus-context-path=/nexus" is not functioning (TAC-14509)
  • TPS-4423 [7.3.1] Context Parameters are reset during updateTask using MetaServlet (TAC-14656)
  • TPS-4463 [7.3.1] 401 Authentication credentials were missing or incorrect
  • TPS-4474 [7.3.1] Context variables in TAC not updated after re-importing from Nexus(TAC-14695)
  • TPS-4492 [7.3.1] DB migration issue with TAC in 7.3.1(TAC-14496)
  • TPS-4508 [7.3.1] Restart job option does not work when it is configured in TAC (TAC-14726)
  • TPS-4528 [7.3.1] Swap of original values and custom value in TAC (TESB-31017)
  • TPS-4451 [7.3.1] "associatePreGeneratedJob" response time issue (TAC-14660) (fix version 2)
  • TPS-4537 [7.3.1] Retrieve Virtual Servers from TAC to Studio (TAC-14742)
  • TPS-4540 [7.3.1] Metaservlet Create tag via metaservlet not working when branch not whitelisted (TAC-14782)
  • TPS-4545 [7.3.1] [ESB conductor] can't create task with snapshots version (TESB-31136)
  • TPS-4576 [7.3.1] Update studio certificates for signing of job zip (TAC-14816)
  • TPS-4557 [7.3.1] Setting "Use https (SSL/TLS)" Parameter via TAC Metaservlet API (TAC-14813)
  • TPS-4579 [7.3.1] JVM Parameters Issue in 7.3 TAC (TAC-14823)
  • TPS-4594 [7.3.1] Error happened while reading contexts from the source file!!!,"returnCode":5 (TAC-14841)
  • TPS-4588 [7.3.1] The Console logs in TAC is not visible after applying the patch Latest 7.3 TAC Patch (TAC-14840)
  • TPS-4619 [7.3.1] Job Conductor page UI issues (TAC-14853)
  • TPS-4634 [7.3.1] there is not the notification email received when the task failed (TAC-14783)
  • TPS-4665 [7.3.1] Artifactory - Not able to select context in ESB conductor(TESB-31816)
  • TPS-4660 [7.3.1] Catalina log is filing up with lot of debugs(TAC-14901)
  • TPS-4662 [7.3.1] TAC-DB migration problem 6.4 to 7.3 (oracle 12c to 19c)(TAC-14920)
  • TPS-4658 [7.3.1] TAC7.3.1 when adding artefact through normal task, issue with context variable type (TAC-14864)
  • TPS-4690 [7.3.1] Smtp fails with TLS error on 7.3(TAC-14892)
  • TAC-14737 [7.3.1] Github Renaming the default branch from master
  • TPS-4750 [7.3.1] Contexts of ESB Task not updated when ESB Task is updated with new artifact version (TESB-32442)
  • TPS-4745 [7.3.1] Trigger context fileName, filePath and folderPath not passed to the job (TAC-15017)
  • TPS-4749 [7.3.1] Able to see/run tasks in projects not having authorization when only using custom roles (TAC-15038)
  • TAC-14549 [7.3.1] Metaservlet: cannot delete project without authorization
  • TAC-13187 [7.3.1] Can't send email notifications when running Java11
  • TESB-28187 [7.3.1] SaveEsbTask metaservlet command does not set context as active.
  • TAC-14218 [7.3.1] "/nexus" is hardcoded in NexusBrowserBusiness.class.
  • TESB-29552 [7.3.1] TAC: StringIndexOutOfBoundsException when creating ESB Conductor Tasks
  • TAC-14039 [7.3.1] Intermittent issue of StringIndexOutOfBoundsException for TaskExecutionHistoryLogge
  • TAC-14391 [7.3.1] TAC: Option to remove "Rights Management" from 'Administrative Use' role
  • TAC-14634 [7.3.1] Metaservlet "associatePreGeneratedJob" API is taking Default as context group
  • TAC-14766 [7.3.1] TAC(MariaDB 10.1) -> Timeline page throws error after installing patch TPS-4322
  • TAC-14860 [7.3.1] Metaservlet call to createUserGroup fails with {"returnCode":5}
  • TAC-13817 [7.3.1] Support Cache-Control attributes (No-store, No-cache)
  • TAC-13761 [7.3.1] Tooo long time to complete the Job server status check
  • TAC-14670 [7.3.1] TAC resiliency issue with statistics port
  • TAC-14896 [7.3.1] TAC Errors after installing TAC Patch_20201218_TPS-4556_v2
  • TAC-14968 [7.3.1] TAC-ESB is not able to deploy routes / nor displays runtimes
  • TAC-14960 [7.3.1] Failed to deploy artifacts: Could not find artifact error when trying to publish jobs
  • TPS-4626 [7.3.1] Viewer role do not have access to view Execution logs under Job conductor(TAC-14796)
  • TPS-4724 [7.3.1] Roles for download an artifact from Nexus in TAC Job Conductor view (TAC-14316)
  • TAC-15097 [7.3.1] project does not show in UI after executing CreateProject metaservlet command
  • TAC-15054 [7.3.1] Execute update project by MetaServlet failed with {"returnCode":1}
  • TAC-15124 [7.3.1] metaservlet listTrigger fails
  • TAC-14924 [7.3.1] Displaying order is not consistent at Job Conductor screen
  • TAC-14229 [7.3.1] Add functionality to display the actual TAC version to know the installed PATCH
  • TAC-14811 [7.3.1] Zero byte job execution log issue on TAC
  • TAC-14964 [7.3.1] Jobs stuck in RUNNING status (recovery mechanism for tasks and plans)
  • TPS-4659 [7.3.1] the pause button on trigger does not work perfectly (TAC-14871)
  • TPS-4689 [7.3.1] Cannot reach svn server(TAC-14843)
  • TPS-4765 [7.3.1] Metaservlet associatePreGeneratedJob error: This job doesn't have context: 'Default' (TAC-15086)
  • TAC-15219 [7.3.1] not able to migrate mssql database from 6.1.1 to 7.3.1 (TAC-14697)
  • TAC-15128 [7.3.1] TAC - GIT configuration
  • TAC-14666 [7.3.1] TAC migration failed with h2 DB
  • TAC-14973 [7.3.1] Execution Plans fails with status: INTERRUPTED, RUNNING_ERROR, PLAN_LAUNCHED, RUNNING_ERROR and ENDED_WITH_WARNING (fixed interrupted plan status issue
  • TAC-15165 [7.3.1] select nexus job should display "Select artifact from Nexus" when if I use nexus as my artifactory repository type
  • TAC-15265 [7.3.1] TAC / JOB CONDUCTOR : Error: Connection to server failed when deploying a job - jobserverClient.port.timeout (default timeout increased to 5 seconds)
  • TPS-4784 [7.3.1] ERROR TalendRemoteServiceServlet - Expected to find an object with property ['items'] in path $ but found 'java.lang.String' (TAC-15016)
  • TPS-4785 [7.3.1] OutofMemory issue caused by RemoteDataRetreiver - Java heap space (TAC-14970)
  • TPS-4786 [7.3.1] job conductor error : History for task 'undefined' when an artifact is changed from an artifact task (TAC-15158)
  • TPS-4796 [7.3.1] "Save failed: No more DP (2) user available with this license" when updating an existing DP user. (TAC-15009)
  • TPS-4800 [7.3.1] The metaservlet 'updatetask' action does not update the new context variable of a new version of job in TAC (TAC-15037)
  • TPS-4813 [7.3.1] Add group field in Nexus Artifact selection to avoid search list can not be retrieved (TAC-13164)
  • TAC-15127 [7.3.1] The response for createTrigger metaservlet is not as expected when task id doesn't exist
  • TAC-15235 [7.3.1] ImportExecutionPlan command for Metaservlet not working in TAC
  • TAC-14108 [7.3.1] Need a RELIABLE way to identify if 2 or more TAC instances (not clusters) are using one DB schema
  • TAC-15257 [7.3.1] Not able to save edited plan after added
  • TAC-14939 [7.3.1] Provide a mechanism to collect the information about TPS patch installed on customer
  • TAC-14898 [7.3.1] Pop for cloud migration in TAC upon login
  • TAC-15307 [7.3.1] Newly added execution plan can't be displayed on UI if there is no task
  • TAC-15204 [7.3.1] RCA for TAC blank page / stuck at license check
  • TAC-14674 [7.3.1] download patch failed when use artifacotry for talend-updates
  • TAC-15214 [7.3.1] Correct metaServlet documentation
  • TAC-15244 [7.3.1] If "Use Latest Version" checkbox is checked when saving an Artifact Task with JFrog Artifactory 6.10.9, an exception is encountered
  • TAC-15255 [7.3.1] The status icon is always spinning for LDAP configuration
  • TAC-15322 [7.3.1] Sort on "Time left before next triggering" failed with error on oracle 12c
  • TAC-15133 [7.3.1] Root task status is not as same as before when killed due to timeout for plan
  • TAC-15378 [7.3.1] "nullpointer exception" in the TAC page : PROJECT AUTHORIZATIONS
  • TAC-14735 [7.3.1] audit of users who are updating contexts from TAC
  • TAC-15398 [7.3.1] NPE on 7.3.1 when select sort on next trigger time on JobConductor
  • TPS-4853 [7.3.1] Checking connection' warning after adding GIT project (TAC-15090)
  • TPS-4857 [7.3.1] Incorrect EP status when tasks fails during EP run with parallel execution and Cron trigger (TAC-15362)
  • TPS-4870 [7.3.1] Request patch for issue Authorization page can't retrieve user from IAM(TAC-15403)
  • TAC-15403 [7.3.1] Authorization page can't retrieve user from IAM
  • TAC-15394 [7.3.1] Customized processMessagePort not reflecting in TAC UI
  • TAC-15439 [7.3.1] Delete user failed for custom role is disabled.
  • TAC-14240 [7.3.1] Metaservlet API listUsers : Add field to show if user logged in, similar to UI securityadmin users list
  • TAC-11581 [7.3.1] Customer would like to be able to limit accress more granularly and create new roles
  • TAC-14615 [7.3.1] Role with job conductor author + job conductor view can modify the triggers
  • TAC-14681 [7.3.1] TAC Role Granularity - role where user can RUN and VIEW jobs, but cannot create trigger.
  • TAC-13816 [7.3.1] Support for HTTP Strict Transport Security (HSTS) in TAC
  • TAC-15427 [7.3.1] H2 DB migration failed from 721 to 731
  • TPS-4866 [7.3.1] Cannot migrate the TAC DB from H2 to MySQL in 7.3.1 (TAC-15372)
  • TPS-4881 [7.3.1] issue with the update of the password page when French language is chose (TAC-15466)
  • TAC-15332 [7.3.1] after TAC restart, one particular job can't be triggered (fixed NPE-s)
  • TAC-15492 [7.3.1] Migrated datatypes don't match the non-migrated datatypes
  • TAC-15524 [7.3.1] Click on "Recipients" will show error !!!Cannot flush and commit transaction.!!!
  • TPS-4860 [7.3.1] MetaServlet command "requestDeployEsbTask" causes "All bundles are not active" even though all bundles are active in Runtime (APPINT-33143)
  • TPS-4886 [7.3.1] Context variables in TAC 7.3.1 not updated after re-importing task from nexus (TAC-15426)
  • TPS-4898 [7.3.1] Task not changing to "Ready to deploy" state in Job Conductor (TAC-15379)
  • TPS-4900 [7.3.1] TAC throws NotificationExec NPE and fails sending task-failure notification mail (TAC-15461)
  • TAC-15240 [7.3.1] Remove truncated "digests" of AWS credentials
  • TAC-15456 [7.3.1] Update the parameter 'contextparamsrefresh' to 'contextParamsRefresh' for metaservlet 'updatetask' action
  • TPS-4905 [7.3.1] .cfg file doesn't contain all the info (TAC-15541)
  • TPS-4907 [7.3.1] "failed to lazily initialize a collection of role: org.talend.model.conductor.ExecutionVirtualServer.executionServers" (TAC-15565)
  • TAC-15314 [7.3.1] Need assistance on siteminder configuration for customer
  • TAC-15361 [7.3.1] unable to use TLS 1.2 only smtp server with JDK 8_292 and TAC
  • TAC-14449 [7.3.1] Support of auth with Tokens in TAC
  • TAC-15627 [7.3.1] TAC patch install notes regarding schema migration with liquibase
  • TAC-15566 [7.3.1] TAC goes to hang state, problem is in LOCKS on the "dbo.taskexecutionhistory" table
  • TAC-15388 [7.3.1] Exhausted DB connections from DB pool
  • TAC-15343 [7.3.1] job conductor slow to open / display execution logs
  • TPS-4913 [7.3.1] Artifact task stuck in TASK_LAUNCHED status (TAC-15518)
  • TPS-4966 [7.3.1] throw java.sql.SQLException: READ_COMMITTED and SERIALIZABLE when switching to executionhistory with oracle DB (TAC-15697)
  • TAC-15648 [7.3.1] Task with 'Ready to run' status is converted back to 'Ready to deploy' when changing attribute
  • TAC-15540 [7.3.1] Failed to migrate from 7.2.1, 7.1.1 to 7.3.1, 8.0.1 (MySql 8.x)
  • TAC-15323 [7.3.1] Job getting deployed every time when Use latest version box checked
  • TAC-15674 [7.3.1] Trigger does not work after migration sometimes
  • TAC-13980 [7.3.1] After applying TPS-3642_v2 - Artifact task with latest version is not updating the latest version on running the job.
  • TAC-15681 [7.3.1] Context is not loaded after checked 'Use Latest Version'
  • TAC-15326 [7.3.1] job started twice by TAC
  • TAC-15678 [7.3.1] Creating ESB Task causes "can't be found with the matching properties" error
  • TAC-14603 [7.3.1] Add changes due to race condition item, in TPSVC-15569
  • TAC-15438 [7.3.1] Changing License from Talend Integration to Talend Data Service Platform blocks all DI users
  • TAC-15372 [7.3.1] Cannot migrate the TAC DB from H2 to MySQL in 7.3.1
  • TAC-15796 [7.3.1] ERROR: Data truncation: Data too long for column 'value' at row 1
  • TAC-15756 [7.3.1] TAC: a source error message and its JA equivalent need to be modified
  • TAC-15810 [7.3.1] Artifact task using latest version is converted back to 'Ready to deploy' when changing attribute
  • TAC-15767 [7.3.1] Clarify metaservlet commands for pause Triggers
  • TAC-15820 [7.3.1] unable to deploy mutiple artifact tasks in job conductor
  • TAC-15507 [7.3.1] Incorrect Error log - shows "in nexus" repository although "artifactory" is used
  • TPS-4942 [7.3.1] TAC to support LDAP Groups(TAC-11690)
  • TPS-4944 [7.3.1] Updating ESB Task doesn't update list of bundles in "Bundles" tab (TAC-15677)
  • TPS-4954 [7.3.1] migration mssql from v6.5.1 to v7.3.1 failed(TAC-15713)
  • TPS-4960 [7.3.1] Comprehensive Log is needed for TAC-14735 Audit Context change regarding the TASK/PLAN (TAC-15751)
  • TPS-4977 [7.3.1] Print Saml Response to the log (TAC-15687)
  • TPS-4984 [7.3.1] NullPointerException when save changes of artifact tasks's setting in job conductor (TAC-15798)
  • TPS-4989 [7.3.1] ESB tasks are stuck in Deploying or Requesting_Undeploy status (TAC-15841)

Security fixes

This patch includes the security fixes:

  • TPS-4255 [7.3.1] Security fix cross site script vulnerability in Project section (ulr field)(TAC-14300)
  • TPS-4698 [7.3.1] Stored Cross Site Scripting (XSS) (TAC-14821)
  • TAC-14921 [7.3.1] External library updates
  • TAC-14806 [7.3.1] TAC Web UI cookie contains version information
  • TAC-14167 [7.3.1] Fix OS commands injection issues
  • TAC-15110 [7.3.1] Security method SecurityUtils.isSafePath() doesn`t work correctly on windows env
  • TAC-15259 [7.3.1] TAC vulnerability - "Auto-complete-enabled"
  • TAC-15032 [7.3.1] VULN ID - 53109575 - Insufficient Authentication
  • TAC-15026 [7.3.1] VULN ID - 53109573 - Session Fixation
  • TAC-15030 [7.3.1] VULN ID - 53109571 -Insufficient session expiration
  • TAC-15305 [7.3.1] Vulnerability is in a direct dependency XStream Core
  • TAC-15478 [7.3.1] Vulnerability found in json-smart lib
  • TAC-15517 [7.3.1] This vulnerability is in a direct dependency Maven Core was found
  • TAC-15589 [7.3.1] Vulnerability found in maven-compat lib
  • TAC-15689 [7.3.1] Vulnerability found in commons-compress, apache shiro, jsoup Java html parser, xstream-core lib
  • TAC-15242 [7.3.1] All remaining SQL Injection flaws
  • TAC-15085 [7.3.1] Hibernate SQL Injection vulnerability in Embedded H2 backup mechanism
  • TAC-15746 [7.3.1] This vulnerability is in a transitive dependency maven shared utils

Deprecated items

From TPS-4913, below features are deprecated:

  • Activity Monitoring Console(AMC)
  • Publisher
  • SVN for project storage

Prerequisites

Consider the following requirements for your system:

  • Talend Administrator Center 7.3.1 must be installed.

Installation

  1. Logon TAC and switch to Configuration-> Software Update, then enter the correct values and save referring to the documentation: https://help.talend.com/reader/f7Em9WV_cPm2RRywucSN0Q/j9x5iXV~vyxMlUafnDejaQ
  2. Switch to Software update page, where the new patch will be listed. The patch can be downloaded from here into the nexus repository.
  3. Login to local Nexus, and download the patch file.
  4. Stop the TAC.
  5. Create a patch directory (eg: <Talend>/TAC_Patch).
  6. Unzip patch file you received from support into this directory, then unzip the org.talend.administrator.war file as org.talend.administrator folder. (Note: Please rename org.talend.administrator-7.3.1.war if your old tac application folder has a different name. Set the name as same as your old TAC application name).
  7. Create a backup directory (eg: <Talend>/TAC_Backup).
  8. Copy folder <Tomcat>/webapps/org.talend.administrator into the backup directory.
  9. In <Tomcat>/webapps/ directory, remove the previous org.talend.administrator folder, then copy the org.talend.administrator folder from step6 and paste in the current directory.
  10. Restore TAC configuration by replacing <Tomcat>/webapps/org.talend.administrator/WEB-INF/classes/configuration.properties and quartz.properties with ones from your backup directory.

    Note:

    • If your TAC db is H2 db and embedded in TAC web folder (<Tomcat>/webapps/org.talend.administrator/WEB-INF/database by default), don't forget to restore H2 db by replacing this folder with the exact corresponding folder from your backup directory.
    • If your TAC works with SSO, you should restore the IDP Metadata file (<Tomcat>/webapps/org.talend.administrator/WEB-INF/classes/IDPMetadata.xml) from your backup directory.
    • <TOMCAT>/endorsed/talend-url-mvn-1.0.0.jar is not needed any more, you can delete this jar.
  11. Restart the TAC.

    Note:

    • It's recommended to clear browser cache after TAC patch were applied.
    • Added the Jobserver client connection timeout param: jobserverClient.port.timeout, please update the value in DB when met the SocketTimeoutException error(unit is millisecond): UPDATE UPDATE configuration SET configuration.value = "8000" WHERE configuration.key = "jobserverClient.port.timeout";;