TPS-4417 (cumulative patch) - 7.1

author
Talend Documentation Team
EnrichVersion
7.1
EnrichProdName
Talend Data Fabric
EnrichPlatform
Talend Studio

TPS-4417 (cumulative patch)

Info Value
Patch Name Patch_20201113_TPS-4417_v1-7.1.1
Release Date 2020-11-13
Target Version 20181026_1147-7.1.1
Product affected Talend Studio

Introduction

This patch is cumulative. It includes all previous generally available patches for Talend Studio 7.1.1.

NOTE: To download this patch, liaise with your Support contact at Talend.

Fixed issues

This patch contains the following fixes:

  • TPS-4506 [7.1.1] Compilation error on the job with project references (TUP-24623)
  • TPS-4462 [7.1.1] Job build error (TESB-30572)
  • TPS-4488 [7.1.1] Null Value Treated as in Subjob (TDI-43619)

This patch also includes the following patches:

  • TPS-4437 [7.1.1] Talend Data Quality Profiling Performance Issues (TDQ-18701)
  • TPS-4421 [7.1.1] Unable to build a project with a project reference(TUP-27447)
  • TPS-4303 [7.1.1] Studio re synchronizing jars with Nexus every time when logged into remote project(TUP-28076)
  • TPS-4254 [7.1.1] Illegal Conversion on tHiveInput Component with Date Field in Schema (TBD-10269)
  • TPS-4159 [7.1.1] org.talend.commons.exception.CommonExceptionHandler - java.util.ConcurrentModificationException (TUP-25961)
  • TPS-4178 [7.1.1] Unable to merge to different branches. (TUP-24608)
  • TPS-4246 [7.1.1] Jenkins build fails when compiling job from Reference project (TUP-27888)
  • TPS-4245 [7.1.1] Cannot build DS job as a microservice via CI builder (TESB-29729)
  • TPS-4247 [7.1.1] Build as Microservice not working when swagger is enabled in Rest service (TESB-29577)
  • TPS-4234 [7.1.1] Specifying a SimpleAuthorizingFilter in a cRest component does not work anymore (TESB-29126)
  • TPS-4190 [7.1.1] the different behavior after migration when the response code is 202(TESB-29457)
  • TPS-3972 [7.1.1] Pulling and Merging a branch should automatically account for the branch name in various properties (TUP-26569)
  • TPS-4111 [7.1.1] Studio freezes on job importing/loading (TUP-27179)
  • TPS-4140 [7.1.1] Studio upload the libraries (jar files) into the Artifactory Server at each start (TUP-27078)
  • TPS-4162 [7.1.1] tDataPrepRun does not enforce studio proxy settings (outside a job) to connect to https://tdp.eu.cloud.talend.com (TUP-27592)
  • TPS-3767 [7.1.1] Prompt users for new password in Studio Connection when AD/LDAP credentials (TUP-16546)
  • TPS-3973 [7.1.1] When TPS-3709 and TPS-3313 are installed, job with tRunJob throws compilation error(TESB-28762)
  • TPS-4058 [7.1.1] Generate Doc as HTML" Inputs label in documentation not the same as FlowDiagram(TUP-26683)
  • TPS-3983 [7.1.1] Sqoop job failing with exception Unknown dataset URI pattern (TBD-10285)
  • TPS-4094 [7.1.1] [20200605] Cannot connect to hive against CDH 5.16.2 (TBD-10374)
  • TPS-4045 [7.1.1] metadata connection with proxy may not select proxy properly (TUP-26189)
  • TPS-3982 [7.1.1] Artifacts are published to a wrong folder in nexus when published from command line (TESB-28825)
  • TPS-4032 [7.1.1] Add support of Nexus 3.19.1 to the 7.1 studio version (TUP-22469, TUP-26081)
  • TPS-3927 [7.1.1][20200430] Sqoop issue with parquet/avro format with EMR 5.15(2.8.3) (with Java API + Parquet) (TBD-10095)
  • TPS-3923 [7.1.1][20200430] [Spark]Compilation errors on tKuduInput and tMap components (TBD-8474)
  • TPS-3929 [7.1.1] "org.apache.camel.blueprint.BlueprintCamelContext cannot be cast to org.apache.camel.spring.SpringCamelContext" (TESB-28496)
  • TPS-3911 [7.1.1]High Memory Consumption by Studio with GIT (TUP-26539)
  • TPS-3829 [7.1.1] [20200403] Sqoop issue with parquet/avro format with EMR 5.15(2.8.3) (TBD-10095)
  • TPS-3835 [7.1.1] jar referenced in bat/sh classpath missing in "build" ZIP file folder lib (TUP-26165)
  • TPS-3848 [7.1.1] tdynamoDBInput ignores the column names containing '-' (TDI-43198)
  • TPS-3859 [7.1.1] [20200403] tHiveOutput components doesn't create a schema with both date & timestamp datatype (TBD-10209)
  • TPS-3834 [7.1.1] tSAPBapi happen NullPointerException when call customer Bapi Function (TUP-24942)
  • TPS-3786 [7.1.1] java.lang.StackOverflowError exception when opening the job in studio (TUP-22620)
  • TPS-3732 [7.1.1][20200306] tfileoutput parquet components doesn't create a schema with both date & timestamp datatype (TBD-9850)
  • TPS-3801 [7.1.1] CI-Builder fails to publish a ESB job due to "src\main\resources\feature\feature.xml not found"(TESB-28166)
  • TPS-3812 [7.1.1] AWS role is not working for Dynamodb update/insert/delete in the tDynamodbOutput component (TDI-41634)
  • TPS-3779 [7.1.1]Exception when integer field is Null in MongoDb with Generate JSON document enabled(TDI-43631)
  • TPS-3721 [7.1.1]Publish Route with cTalendJob adds Import package with static project name(TESB-27159)
  • TPS-3782 [7.1.1]tELTPostgresqlMap lost its "DB Type" column for which the value should be "BPCHAR"(TUP-26059)
  • TPS-3754 [7.1.1] Losing the date type format of field while using it in an array (TDI-43418)
  • TPS-3631 [7.1.1]SOAPAction missing even with TPS-3458 (TESB-27583)
  • TPS-3691 [7.1.1]Command Line Publishing is not overriding the artifact type of the job/route (TESB-27587)
  • TPS-3712 [7.1.1]Customer getting 'java.lang.ClassCastException: org.springframework.beans.factory.xml.SimplePropertyNamespaceHandler' exception in runtime (TESB-27030)
  • TPS-3713 [7.1.1]tMatchGroup works very slowly after migrating from 6.5 to 7.1(TDQ-17851)
  • TPS-3632 [7.1.1] Not able to download some additional jar via https proxy (TUP-24749)
  • TPS-3692 [7.1.1] Schema order changes on tFileOutputDelimited (TUP-25472)
  • TPS-3662 [7.1.1] Issue in Talend Job when deployed as Microservice (TESB-27602)
  • TPS-3687 [7.1.1] javax.mail cannot be resolved to a type at Studio Runtime (TUP-25237)
  • TPS-3696 [7.1.1] Improvement based on TPS-3555(TUP-25035)
  • TPS-3661 [7.1.1] Warn in CosmosDB: Customer would like to remove the Warn in Component in cumulative studio patch(TDI-42659)
  • TPS-3604 [7.1.1] Childjobs are missing for some jobs after migrating project from 6.3.1 to 7.1.1 (TUP-25257)
  • TPS-3609 [7.1.1] Uncommitted files found /Commit => java.lang.NullPointerException (TUP-25197)
  • TPS-3580 [7.1.1] tparallelize error - ORA-01861: literal does not match the string with dynamic schema (TDI-42325)
  • TPS-3461 [7.1.1] Redundant appearance of update detection dialogue box (TUP-24355)
  • TPS-3481 [7.1.1] [20191213] Missing "hive.exec.dynamic.partition.mode" properties in v7 Spark jobs (TBD-9226)
  • TPS-3553 [7.1.1] changeMavenVersion throws a NullPointerException (TUP-25066)
  • TPS-3555 [7.1.1] Implicit tContextLoad feature (with selection from file) uses a hardcoded encoding of ISO-8859-15(TUP-25035)
  • TPS-3541 [7.1.1] context value doesn't update after publishing the job to release repository(TUP-23322)
  • TPS-3485 [7.1.1] [20191115] tELTHiveMap doesn't pass context variable properly (TUP-24955)
  • TPS-3514 [7.1.1] CI-Builder: "Missing the reference project for..." (TUP-24910)
  • TPS-3516 [7.1.1] Spark Joblets cannot be built within Parent DI job (TUP-24884)
  • TPS-3455 [7.1.1] Route - Beans package not visible to test cases (TESB-26696)
  • TPS-3458 [7.1.1] SOAP Action missing while calling a SOAP WebService through tESBConsumer (TESB-27081)
  • TPS-3436 [7.1.1] Created a new test case and run it, can not show up the test result on the right panel (TUP-24273)
  • TPS-3456 [7.1.1] Migration issue with tReplaceList when importing jobs from 611 to 711 (TUP-24733)
  • TPS-3437 [7.1.1]Child job does not get updated when (TUP-24429)
  • TPS-3477 [7.1.1]Studio fails to sync jars with Artifactory if password has '@' character in it (TUP-24735)
  • TPS-3488 [7.1.1]Context encrypted password value is incorrect in context properties file(TUP-23528)
  • TPS-3443 [7.1.1] bean called in routelet not found by main route (TESB-26789)
  • TPS-3381 [7.1.1] routines is duplicated in the reactor (TUP-24310)
  • TPS-3427 [7.1.1]Unable to access remote project after applying TPS-3363 (TUP-24579)
  • TPS-3365 [7.1.1]JSON with accented characters is not being recognized when creating a new JSON file in Metadata. (TUP-23914)
  • TPS-3349 [7.1.1][20190913] tMapROjaiOutput error(TBD-9121)
  • TPS-3376 [7.1.1]Projects are switched to read only mode while reconnecting the session (TUP-24272)
  • TPS-3363 [7.1.1]Cannot publish Route with Routelet to snapshots when project has a ref project defined (TESB-26415)
  • TPS-3362 [7.1.1]Studio doesn't load latest jar for TCOMPv0 update site patch (TUP-24226)
  • TPS-3361 [7.1.1]Profiling Error for Snowflake - For more number of fields selected(TDQ-17301)
  • TPS-3329 [7.1.1]SFTP proxy bean not recognized in runtime only (TESB-24354)
  • TPS-3302 [7.1.1]Error on Job with multiple tRunJob calling Call another Child job with tESBConsumer (TESB-26174)
  • TPS-3251 [7.1.1] ERROR when Job in MDM project calling Job in Reference DI project: import routines. DataQuality cannot be resolved (TUP-23743)
  • TPS-3255 [7.1.1] Problem of display in the tMap with Mojave(TUP-21075)
  • TPS-3274 [7.1.1][20190823] tImpalaClose component not closing the connection (TBD-8989)
  • TPS-3339 [7.1.1]XML Meta data wizard showing inconsistent view on V711 comparing with V6 Studio (TUP-24159)
  • TPS-3265 [7.1.1] Pom files are not generated sometimes for the jobs in 7.1.1 (TUP-23789)
  • TPS-3289 [7.1.1]Route persists error even after resolving the issue(TESB-26300)
  • TPS-3313 [7.1.1] command changeMavenVersion not work (TUP-20601)
  • TPS-3286 [7.1.1] Unable to push code from Studio to Bitbucket Server if hook is enabled in Bitbucket Repository(TUP-23610)
  • TPS-3147 [7.1.1] tHiveInput component with Orc file(Spark1.4+) option doesn't work in hortworks 2.6(TBD-8565)
  • TPS-3238 [7.1.1] Migration issues in the Studio after migrating the jobs from 6.5 to 7.1(TDI-42380)
  • TPS-3275 [7.1.1] Services no longer accessible ( NPE) after route deployment (TESB-24730)
  • TPS-3292 [7.1.1] Talend Studio User Defined Indicators Invalid Row Count(TDQ-17316)
  • TPS-3245 [7.1.1] Published artifact does not have context files (TESB-26086)
  • TPS-3184 [7.1.1] tHiveInput and tHiveOutput components are not support spark local mode in studio 7.1.1 (TBD-8646, TBD-8789)
  • TPS-3280 [7.1.1] After applying the patch TPS-3180, it missed CAST / AND etc from the WHERE Clause
  • TPS-3214 [7.1.1] Unable to retrieve the schema from Synonym (TUP-21086)
  • TPS-3221 [7.1.1] Guess Schema error - SLF4J: Defaulting to no-operation (NOP) logger implementation (TUP-23230)
  • TPS-3224 [7.1.1] NullPointerException when using the build job wizard.(TUP-23594)
  • TPS-3248 [7.1.1] Regression caused by TUP-21532 for ESB use case using tRunJob (TUP-23755)
  • TPS-3186 [7.1.1] Not all bundles available in Nexus when publishing webservice (TESB-25769)
  • TPS-3192 [7.1.1] Build jobs doesn't creates the java source file(.java) for the child jobs(TUP-22986)
  • TPS-3203 [7.1.1] tMap - cannot edit schema (TUP-23389)
  • TPS-3220 [7.1.1] Hive on Spark does not work with Spark 2+ if not using default database (TBD-8096)
  • TPS-3212 [7.1.1] Unable to transfer JAR file to Nexsus 3 due to repository version policy: SNAPSHOT does not allow version (TUP-22490)
  • TPS-3230 [7.1.1] Missing context files in Service's assigned jobs (TESB-25376)
  • TPS-3223 [7.1.1] Duplicated libraries in private & import packages of the build manifest file (TESB-26293)
  • TPS-3227 [7.1.1] COMPUTE_DEPENDENCIES_FAILED:{path=META-INF/maven/org.talend.components/components-salesforce-runtime/dependencies.txt (TUP-23452)
  • TPS-3187 [7.1.1] Big Data - No Data Mapper functions(TUP-23190)
  • TPS-3180 [7.1.1] Context is not recognized as context variable in ELT Map components and is not separated with string concat from SQL code (TUP-21164)
  • TPS-3189 [7.1.1] Context value of joblet cannot load into main job if delete joblet then add it back (TUP-23353)
  • TPS-3182 [7.1.1] New branch with name "/" will lead job with reference joblet build failure (TUP-23170)
  • TPS-3145 [7.1.1] job working in 6.3.1 fails to generate in 7.1.1 : Failed to generate code. /java.lang.reflect.InvocationTargetException /java.lang.NullPointerException (TUP-22906)
  • TPS-3197 [7.1.1] Error when using Two tRules component in the studio (TDQ-17133)
  • TPS-3165 [7.1.1] Updating Context doesn't update the route's context (TESB-25939)
  • TPS-3153 [7.1.1] Soap Service non-default env contexts missing (TESB-25509) - Note: If applied to a Studio without TPS-3010 (7.1.1 Spring 19) applied before the Talend Cloud Preferences will show the new Accesstoken option as default
  • TPS-3159 [7.1.1] Possible thread lock during git update operation (TUP-22713)
  • TPS-3144 [7.1.1] context variable used in Additional WHERE Clauses not "evaluated" when 2 tELTOracleMap linked (TUP-22627)
  • TPS-3158 [7.1.1] twriteJsonField consumed 100% CPU (TESB-25705)
  • TPS-3102 [7.1.1][20190531] Context variable Value in tELTHiveMap Map Editor(expression column) is not Set correctly at Runtime (TBD-8566)
  • TPS-3131 [7.1.1]Change the check from internet in NetworkUtil.isNetworkValid()(TUP-22940)
  • TPS-3098 [7.1.1]Job in CI Builder gets generated and deployed, but doesn't show as a Tag (TUP-22681)
  • TPS-3099 [7.1.1]20190524] Bigquery components throw NumberFormatException in 7.1.1 (TBD -8573)
  • TPS-3108 [7.1.1]Job with component tSAPIDOCOutput not getting built (TUP-22804)
  • TPS-3111 [7.1.1]NPE code generation on tRestRequest Components(TESB-25693)
  • TPS-3031 [7.1.1]tMap lost look-up details (TUP-22435)
  • TPS-3093 [7.1.1]CI Builder doesn't add stats to any builds, even though the source is good(TUP-22683)
  • TPS-3095 [7.1.1]Problem of performances when login / save project (TUP-22735)
  • TPS-3119 [7.1.1]TPS-3038 overwrites TPS-2820 (TBD -8621)
  • TPS-3125 [7.1.1]Fix problem of patch (TUP-22924)
  • TPS-3084 [7.1.1]Null pointer exception when executing the jobs (TUP-22438)
  • TPS-3074 [7.1.1]NullPointerException When you try to publish a job as docker (TUP-21983)
  • TPS-3060 [7.1.1]Docker Image with tRestClient component (TESB-25045)
  • TPS-2990 [7.1.1]Non-default Artifactory context path, not working (Artifact, shared libs, talend-update, Studio) (TUP-22182)
  • TPS-3010 [7.1.1]Talend Studio - Spring 19 Patch (AccessToken Support) (TESB-24842)
  • TPS-3038 [7.1.1]Unchecking 'Use Timestamp format for Date type' checkbox in tFileOutputParquet gives compilation error (TBD-8500)
  • TPS-2950 [7.1.1]tMap losing all links in testcase when we do some modification in the main job in the same component (TUP-21252)
  • TPS-3065 [7.1.1]Stackoverflow issue in studio (TUP-22425)
  • TPS-3028 [7.1.1]Missing Signature in Business Model item => cannot export / import even in 7.1.1 (TUP-22347)
  • TPS-2994 [7.1.1]Comment in the query in tJDBCInput component does not work if the job is migrated from 6.2.1 to 7.1.1 (TDI-41898)
  • TPS-2921 [7.1.1]tElasticSearch components receiving nullpointer (TBD-8270)
  • TPS-3042 [7.1.1]The exception NoSuchDatabaseException:Database"xxxx"not found (TBD-8077)
  • TPS-2972 [7.1.1]Run Testcase instance fails : java.lang.NullPointerException (TUP-22015)
  • TPS-2975 [7.1.1]Importing a job from 6.2.1 to 7.1.1 is throwing error (TDI-41876)
  • TPS-2979 [7.1.1]Default endpoint URI not added to context variable endpoint in cRest (TESB-24920)
  • TPS-2982 [7.1.1]Metadata information is not stored properly for Sysbase DB (TUP-22268)
  • TPS-2966 [7.1.1]Problems handling SAP HANA Objects in Talend Studio (TUP-21999)
  • TPS-2926 [7.1.1]Commit to Git frequently without any user action (TUP-21922)
  • TPS-2978 [7.1.1]Intermittent "ClassNotFoundException: javax.mail.Address" errors (TESB-25164)
  • TPS-2980 [7.1.1]Published routeName_jobName jar file with size zero in Nexus. (TESB-25130)
  • TPS-2946 [7.1.1]Issue with cREST configured with resource class (TESB-25033)
  • TPS-2888 [7.1.1]tDBConnection(Snowflake) issue within joblet(TUP-21105)
  • TPS-2879 [7.1.1]OnSubJob Links Not Working(TUP-21333)
  • TPS-2964 [7.1.1]Unexpected Empty Contexts Variable Values (TUP-22005)
  • TPS-2925 [7.1.1]job run well on studio but failed after build (TUP-21871)
  • TPS-2937 [7.1.1]Job migrated from 6.5.1 to 7.1.1 throwing UNEXPECTED_EXCEPTION (TDI-41803)
  • TPS-2932 [7.1.1]Build job takes about 4 minutes while Run job takes > 40 minutes to start (TUP-21911)
  • TPS-2909 [7.1.1]An error has occurred. UNEXPECTED_EXCEPTION when opening job migrated 6.4.1 to 7.1.1 (job using tJDBCInput) (TUP-21895)
  • TPS-2904 [7.1.1]NPE when importing job
  • TPS-2903 [7.1.1]Import 701 job get error 'Unknown value in the list / Value set not supported by the component' (TDI-41324)
  • TPS-2874 [7.1.1]tImpalaConnection component not able to build libraries (TUP-21710)
  • TPS-2897 [7.1.1]"talend-bigdata-launcher-1.2.0-20170410.jar" not found when spark job launched from standard job by jobserver (TBD-7933, TBD-8276)
  • TPS-2783 [7.1.1]Add support for Elasticsearch 6.x - Spark Streaming (TBD-7700)
  • TPS-2860 [7.1.1]Standard DI job which refers to big data batch job having S3 component and standard DI job having S3 connection component fails with an error. (TUP-21532)
  • TPS-2848 [7.1.1]Error write data to S3 using the S3a file systsem in the spark job (TBD-8145)
  • TPS-2833 [7.1.1]In studio Java Debugging of Routes fails (TUP-21005)
  • TPS-2859 [7.1.1]Issue with POM/dependencies causing working jobs to suddenly fail with Could not find or load main class (TUP-21127)
  • TPS-2811 [7.1.1]JDBC connection will not commit even if autocommit is set to True (TUP-21160)
  • TPS-2782 [7.1.1]ESB - CI for ESB - Update 1 (TESB-24058)
  • TPS-3912 [7.1.1] tRESTClient does not send json as an array if only one array element (TESB-28674)

Prerequisites

Consider the following requirements for your system:

  • Talend Studio 7.1.1 must be installed.

  • To be able to publish docker images in studio, please set maven online mode in Preferences and publish it once to download several missing jars/poms, then switch back to offline mode.

  • To make TPS-2990 totally work with TAC, please install TPS-3085 also.

  • To make TPS-3099 totally work, please install TPS-3140 also.
  • To make TPS-3098 totally work, please replace the builder-maven-plugin-7.1.1.jar into "{Studio_Home}/configuration/.m2/repository/org/talend/ci/builder-maven-plugin/7.1.1" from "repository/org/talend/ci/builder-maven-plugin/7.1.1" in patch zip. And this TPS adds a parameter "-Dtalend.project.branch" for CI, you can use this parameter in MAVEN_OPTS, it will force every jobs built with this setting branch.(eg: -Dtalend.project.branch=tags/mytag)
  • To make TPS-3477 totally work, please replace "{Studio_Home}/plugins/org.ops4j.pax.url.mvn_2.4.6.Talend.jar" with "org.ops4j.pax.url.mvn/org.ops4j.pax.url.mvn_2.6.1.Talend.jar" which can get from patch zip, then in "{Studio_Home}/configuration/config.ini", add ",org.ops4j.pax.url.mvn@start" at the end of property "osgi.bundles".
  • For TPS-3687, please make sure job running processes(java process which is running dq_email3) are killed manually. If you are not able to identify the process to kill, alternative option is that you can kill all of java processes or restart your computer.
  • For TPS-3713, please delete the old jar "org.talend.dataquality.record.linkage_6.1.3.jar" from folder "studio/plugins" and folder "studio/configuration/.m2/repository/org/talend/dataquality/org.talend.dataquality.record.linkage/6.1.3". then restart studio.

Installation

Installing the patch for Cloud Studio

  • If you want to fetch license by cloud token 1) Get the bundles.info which is under the folder named "configuration/org.talend.configurator" from patch zip 2) Replace the bundles.info from "{Studio_Home}/configuration/org.talend.configurator" with the bundles.info file from patch zip
  • If you want to use CI with Cloud token 1) Get the file cloudpublisher-maven-plugin-7.1.1.jar which is under the folder named "repository/org/talend/ci/cloudpublisher-maven-plugin/7.1.1" from patch zip 2) Copy the file cloudpublisher-maven-plugin-7.1.1.jar into Talend Studio in "/configuration/.m2/repository/org/talend/ci/cloudpublisher-maven-plugin/7.1.1"

Installing the patch using Software update

1) Logon TAC and switch to Configuration->Software Update, then enter the correct values and save referring to the documentation: https://help.talend.com/reader/f7Em9WV_cPm2RRywucSN0Q/j9x5iXV~vyxMlUafnDejaQ

2) Switch to Software update page, where the new patch will be listed. The patch can be downloaded from here into the nexus repository.

3) On Studio Side: Logon Studio with remote mode, on the logon page the Update button is displayed: click this button to install the patch.

Installing the patch using Talend Studio

1) Create a folder named "patches" under your studio installer directory and copy the patch .zip file to this folder.

2) Restart your studio: a window pops up, then click OK to install the patch, or restart the commandline and the patch will be installed automatically.

Installing the patch using Commandline

Execute the following commands:

  1. Talend-Studio-win-x86_64.exe -nosplash -application org.talend.commandline.CommandLine -consoleLog -data commandline-workspace startServer -p 8002 --talendDebug
  2. initRemote {tac_url} -ul {TAC login username} -up {TAC login password}
  3. checkAndUpdate -tu {TAC login username} -tup {TAC login password}