TPS-3470 (cumulative patch) - 7.1

author
Talend Documentation Team
EnrichVersion
7.1
EnrichProdName
Talend Data Fabric
EnrichPlatform
Talend Studio

TPS-3470 (cumulative patch)

Info Value
Patch Name Patch_20191112_TPS-3470_v1_7.1.1
Release Date 2019-11-15
Target Version 20181026_1147-7.1.1
Product affected Talend Studio

Introduction

This patch is cumulative. It includes all previous generally available patches for Talend Studio 7.1.1.

NOTE: To download this patch, liaise with your Support contact at Talend.

Fixed issues

This patch contains the following fixes:

  • TPS-3470 [7.1.1] Cumulative Patch - 20191115
  • TPS-3541 [7.1.1] context value doesn't update after publishing the job to release repository(TUP-23322)
  • TPS-3485 [7.1.1] [20191115] tELTHiveMap doesn't pass context variable properly (TUP-24955)
  • TPS-3514 [7.1.1] CI-Builder: "Missing the reference project for..." (TUP-24910)
  • TPS-3516 [7.1.1] Spark Joblets cannot be built within Parent DI job (TUP-24884)
  • TPS-3455 [7.1.1] Route - Beans package not visible to test cases (TESB-26696)
  • TPS-3458 [7.1.1] SOAP Action missing while calling a SOAP WebService through tESBConsumer (TESB-27081)

This patch also includes the following patches:

  • TPS-3436 [7.1.1] Created a new test case and run it, can not show up the test result on the right panel (TUP-24273)
  • TPS-3456 [7.1.1] Migration issue with tReplaceList when importing jobs from 611 to 711 (TUP-24733)
  • TPS-3437 [7.1.1]Child job does not get updated when (TUP-24429)
  • TPS-3477 [7.1.1]Studio fails to sync jars with Artifactory if password has '@' character in it (TUP-24735)
  • TPS-3488 [7.1.1]Context encrypted password value is incorrect in context properties file(TUP-23528)
  • TPS-3443 [7.1.1] bean called in routelet not found by main route (TESB-26789)
  • TPS-3381 [7.1.1] routines is duplicated in the reactor (TUP-24310)
  • TPS-3427 [7.1.1]Unable to access remote project after applying TPS-3363 (TUP-24579)
  • TPS-3365 [7.1.1]JSON with accented characters is not being recognized when creating a new JSON file in Metadata. (TUP-23914)
  • TPS-3349 [7.1.1][20190913] tMapROjaiOutput error(TBD-9121)
  • TPS-3376 [7.1.1]Projects are switched to read only mode while reconnecting the session (TUP-24272)
  • TPS-3363 [7.1.1]Cannot publish Route with Routelet to snapshots when project has a ref project defined (TESB-26415)
  • TPS-3362 [7.1.1]Studio doesn't load latest jar for TCOMPv0 update site patch (TUP-24226)
  • TPS-3361 [7.1.1]Profiling Error for Snowflake - For more number of fields selected(TDQ-17301)
  • TPS-3329 [7.1.1]SFTP proxy bean not recognized in runtime only (TESB-24354)
  • TPS-3302 [7.1.1]Error on Job with multiple tRunJob calling Call another Child job with tESBConsumer (TESB-26174)
  • TPS-3274 [7.1.1][20190823] tImpalaClose component not closing the connection (TBD-8989)
  • TPS-3339 [7.1.1]XML Meta data wizard showing inconsistent view on V711 comparing with V6 Studio (TUP-24159)
  • TPS-3265 [7.1.1] Pom files are not generated sometimes for the jobs in 7.1.1 (TUP-23789)
  • TPS-3289 [7.1.1]Route persists error even after resolving the issue(TESB-26300)
  • TPS-3313 [7.1.1] command changeMavenVersion not work (TUP-20601)
  • TPS-3286 [7.1.1] Unable to push code from Studio to Bitbucket Server if hook is enabled in Bitbucket Repository(TUP-23610)
  • TPS-3147 [7.1.1] tHiveInput component with Orc file(Spark1.4+) option doesn't work in hortworks 2.6(TBD-8565)
  • TPS-3238 [7.1.1] Migration issues in the Studio after migrating the jobs from 6.5 to 7.1(TDI-42380)
  • TPS-3275 [7.1.1] Services no longer accessible ( NPE) after route deployment (TESB-24730)
  • TPS-3292 [7.1.1] Talend Studio User Defined Indicators Invalid Row Count(TDQ-17316)
  • TPS-3245 [7.1.1] Published artifact does not have context files (TESB-26086)
  • TPS-3184 [7.1.1] tHiveInput and tHiveOutput components are not support spark local mode in studio 7.1.1 (TBD-8646, TBD-8789)
  • TPS-3280 [7.1.1] After applying the patch TPS-3180, it missed CAST / AND etc from the WHERE Clause
  • TPS-3214 [7.1.1] Unable to retrieve the schema from Synonym (TUP-21086)
  • TPS-3221 [7.1.1] Guess Schema error - SLF4J: Defaulting to no-operation (NOP) logger implementation (TUP-23230)
  • TPS-3224 [7.1.1] NullPointerException when using the build job wizard.(TUP-23594)
  • TPS-3248 [7.1.1] Regression caused by TUP-21532 for ESB use case using tRunJob (TUP-23755)
  • TPS-3186 [7.1.1] Not all bundles available in Nexus when publishing webservice (TESB-25769)
  • TPS-3192 [7.1.1] Build jobs doesn't creates the java source file(.java) for the child jobs(TUP-22986)
  • TPS-3203 [7.1.1] tMap - cannot edit schema (TUP-23389)
  • TPS-3220 [7.1.1] Hive on Spark does not work with Spark 2+ if not using default database (TBD-8096)
  • TPS-3212 [7.1.1] Unable to transfer JAR file to Nexsus 3 due to repository version policy: SNAPSHOT does not allow version (TUP-22490)
  • TPS-3230 [7.1.1] Missing context files in Service's assigned jobs (TESB-25376)
  • TPS-3223 [7.1.1] Duplicated libraries in private & import packages of the build manifest file (TESB-26293)
  • TPS-3227 [7.1.1] COMPUTE_DEPENDENCIES_FAILED:{path=META-INF/maven/org.talend.components/components-salesforce-runtime/dependencies.txt (TUP-23452)
  • TPS-3187 [7.1.1] Big Data - No Data Mapper functions(TUP-23190)
  • TPS-3180 [7.1.1] Context is not recognized as context variable in ELT Map components and is not separated with string concat from SQL code (TUP-21164)
  • TPS-3189 [7.1.1] Context value of joblet cannot load into main job if delete joblet then add it back (TUP-23353)
  • TPS-3182 [7.1.1] New branch with name "/" will lead job with reference joblet build failure (TUP-23170)
  • TPS-3145 [7.1.1] job working in 6.3.1 fails to generate in 7.1.1 : Failed to generate code. /java.lang.reflect.InvocationTargetException /java.lang.NullPointerException (TUP-22906)
  • TPS-3197 [7.1.1] Error when using Two tRules component in the studio (TDQ-17133)
  • TPS-3165 [7.1.1] Updating Context doesn't update the route's context (TESB-25939)
  • TPS-3153 [7.1.1] Soap Service non-default env contexts missing (TESB-25509) - Note: If applied to a Studio without TPS-3010 (7.1.1 Spring 19) applied before the Talend Cloud Preferences will show the new Accesstoken option as default
  • TPS-3159 [7.1.1] Possible thread lock during git update operation (TUP-22713)
  • TPS-3144 [7.1.1] context variable used in Additional WHERE Clauses not "evaluated" when 2 tELTOracleMap linked (TUP-22627)
  • TPS-3158 [7.1.1] twriteJsonField consumed 100% CPU (TESB-25705)
  • TPS-3102 [7.1.1][20190531] Context variable Value in tELTHiveMap Map Editor(expression column) is not Set correctly at Runtime (TBD-8566)
  • TPS-3131 [7.1.1]Change the check from internet in NetworkUtil.isNetworkValid()(TUP-22940)
  • TPS-3098 [7.1.1]Job in CI Builder gets generated and deployed, but doesn't show as a Tag (TUP-22681)
  • TPS-3099 [7.1.1]20190524] Bigquery components throw NumberFormatException in 7.1.1 (TBD -8573)
  • TPS-3108 [7.1.1]Job with component tSAPIDOCOutput not getting built (TUP-22804)
  • TPS-3111 [7.1.1]NPE code generation on tRestRequest Components(TESB-25693)
  • TPS-3031 [7.1.1]tMap lost look-up details (TUP-22435)
  • TPS-3093 [7.1.1]CI Builder doesn't add stats to any builds, even though the source is good(TUP-22683)
  • TPS-3095 [7.1.1]Problem of performances when login / save project (TUP-22735)
  • TPS-3119 [7.1.1]TPS-3038 overwrites TPS-2820 (TBD -8621)
  • TPS-3125 [7.1.1]Fix problem of patch (TUP-22924)
  • TPS-3084 [7.1.1]Null pointer exception when executing the jobs (TUP-22438)
  • TPS-3074 [7.1.1]NullPointerException When you try to publish a job as docker (TUP-21983)
  • TPS-3060 [7.1.1]Docker Image with tRestClient component (TESB-25045)
  • TPS-2990 [7.1.1]Non-default Artifactory context path, not working (Artifact, shared libs, talend-update, Studio) (TUP-22182)
  • TPS-3010 [7.1.1]Talend Studio - Spring 19 Patch (AccessToken Support) (TESB-24842)
  • TPS-3038 [7.1.1]Unchecking 'Use Timestamp format for Date type' checkbox in tFileOutputParquet gives compilation error (TBD-8500)
  • TPS-2950 [7.1.1]tMap losing all links in testcase when we do some modification in the main job in the same component (TUP-21252)
  • TPS-3065 [7.1.1]Stackoverflow issue in studio (TUP-22425)
  • TPS-3028 [7.1.1]Missing Signature in Business Model item => cannot export / import even in 7.1.1 (TUP-22347)
  • TPS-2994 [7.1.1]Comment in the query in tJDBCInput component does not work if the job is migrated from 6.2.1 to 7.1.1 (TDI-41898)
  • TPS-2921 [7.1.1]tElasticSearch components receiving nullpointer (TBD-8270)
  • TPS-3042 [7.1.1]The exception NoSuchDatabaseException:Database"xxxx"not found (TBD-8077)
  • TPS-2972 [7.1.1]Run Testcase instance fails : java.lang.NullPointerException (TUP-22015)
  • TPS-2975 [7.1.1]Importing a job from 6.2.1 to 7.1.1 is throwing error (TDI-41876)
  • TPS-2979 [7.1.1]Default endpoint URI not added to context variable endpoint in cRest (TESB-24920)
  • TPS-2982 [7.1.1]Metadata information is not stored properly for Sysbase DB (TUP-22268)
  • TPS-2966 [7.1.1]Problems handling SAP HANA Objects in Talend Studio (TUP-21999)
  • TPS-2926 [7.1.1]Commit to Git frequently without any user action (TUP-21922)
  • TPS-2978 [7.1.1]Intermittent "ClassNotFoundException: javax.mail.Address" errors (TESB-25164)
  • TPS-2980 [7.1.1]Published routeName_jobName jar file with size zero in Nexus. (TESB-25130)
  • TPS-2946 [7.1.1]Issue with cREST configured with resource class (TESB-25033)
  • TPS-2888 [7.1.1]tDBConnection(Snowflake) issue within joblet(TUP-21105)
  • TPS-2879 [7.1.1]OnSubJob Links Not Working(TUP-21333)
  • TPS-2964 [7.1.1]Unexpected Empty Contexts Variable Values (TUP-22005)
  • TPS-2925 [7.1.1]job run well on studio but failed after build (TUP-21871)
  • TPS-2937 [7.1.1]Job migrated from 6.5.1 to 7.1.1 throwing UNEXPECTED_EXCEPTION (TDI-41803)
  • TPS-2932 [7.1.1]Build job takes about 4 minutes while Run job takes > 40 minutes to start (TUP-21911)
  • TPS-2909 [7.1.1]An error has occurred. UNEXPECTED_EXCEPTION when opening job migrated 6.4.1 to 7.1.1 (job using tJDBCInput) (TUP-21895)
  • TPS-2904 [7.1.1]NPE when importing job
  • TPS-2903 [7.1.1]Import 701 job get error 'Unknown value in the list / Value set not supported by the component' (TDI-41324)
  • TPS-2874 [7.1.1]tImpalaConnection component not able to build libraries (TUP-21710)
  • TPS-2897 [7.1.1]"talend-bigdata-launcher-1.2.0-20170410.jar" not found when spark job launched from standard job by jobserver (TBD-7933, TBD-8276)
  • TPS-2783 [7.1.1]Add support for Elasticsearch 6.x - Spark Streaming (TBD-7700)
  • TPS-2860 [7.1.1]Standard DI job which refers to big data batch job having S3 component and standard DI job having S3 connection component fails with an error. (TUP-21532)
  • TPS-2848 [7.1.1]Error write data to S3 using the S3a file systsem in the spark job (TBD-8145)
  • TPS-2833 [7.1.1]In studio Java Debugging of Routes fails (TUP-21005)
  • TPS-2859 [7.1.1]Issue with POM/dependencies causing working jobs to suddenly fail with Could not find or load main class (TUP-21127)
  • TPS-2811 [7.1.1]JDBC connection will not commit even if autocommit is set to True (TUP-21160)
  • TPS-2782 [7.1.1]ESB - CI for ESB - Update 1 (TESB-24058)

Prerequisites

Consider the following requirements for your system:

  • Talend Studio 7.1.1 must be installed.

  • To be able to publish docker images in studio, please set maven online mode in Preferences and publish it once to download several missing jars/poms, then switch back to offline mode.

  • To make TPS-2990 totally work with TAC, please install TPS-3085 also.

  • To make TPS-3099 totally work, please install TPS-3140 also.
  • To make TPS-3098 totally work, please replace the builder-maven-plugin-7.1.1.jar into "{Studio_Home}/configuration/.m2/repository/org/talend/ci/builder-maven-plugin/7.1.1" from "repository/org/talend/ci/builder-maven-plugin/7.1.1" in patch zip. And this TPS adds a parameter "-Dtalend.project.branch" for CI, you can use this parameter in MAVEN_OPTS, it will force every jobs built with this setting branch.(eg: -Dtalend.project.branch=tags/mytag)
  • To make TPS-3477 totally work, please replace "{Studio_Home}/plugins/org.ops4j.pax.url.mvn_2.4.6.Talend.jar" with "org.ops4j.pax.url.mvn/org.ops4j.pax.url.mvn_2.6.1.Talend.jar" which can get from patch zip, then in "{Studio_Home}/configuration/config.ini", add ",org.ops4j.pax.url.mvn@start" at the end of property "osgi.bundles".

Installation

Installing the patch for Cloud Studio

  • If you want to fetch license by cloud token 1) Get the bundles.info which is under the folder named "configuration/org.talend.configurator" from patch zip 2) Replace the bundles.info from "{Studio_Home}/configuration/org.talend.configurator" with the bundles.info file from patch zip
  • If you want to use CI with Cloud token 1) Get the file cloudpublisher-maven-plugin-7.1.1.jar which is under the folder named "repository/org/talend/ci/cloudpublisher-maven-plugin/7.1.1" from patch zip 2) Copy the file cloudpublisher-maven-plugin-7.1.1.jar into Talend Studio in "/configuration/.m2/repository/org/talend/ci/cloudpublisher-maven-plugin/7.1.1"

Installing the patch using Software update

1) Logon TAC and switch to Configuration->Software Update, then enter the correct values and save referring to the documentation: https://help.talend.com/reader/f7Em9WV_cPm2RRywucSN0Q/j9x5iXV~vyxMlUafnDejaQ

2) Switch to Software update page, where the new patch will be listed. The patch can be downloaded from here into the nexus repository.

3) On Studio Side: Logon Studio with remote mode, on the logon page the Update button is displayed: click this button to install the patch.

Installing the patch using Talend Studio

1) Create a folder named "patches" under your studio installer directory and copy the patch .zip file to this folder.

2) Restart your studio: a window pops up, then click OK to install the patch, or restart the commandline and the patch will be installed automatically.

Installing the patch using Commandline

Execute the following commands:

  1. Talend-Studio-win-x86_64.exe -nosplash -application org.talend.commandline.CommandLine -consoleLog -data commandline-workspace startServer -p 8002 --talendDebug
  2. initRemote {tac_url} -ul {TAC login username} -up {TAC login password}
  3. checkAndUpdate -tu {TAC login username} -tup {TAC login password}