TPS-3619 - 7.2

author
Talend Documentation Team
EnrichVersion
7.2
EnrichProdName
Talend Data Fabric
EnrichPlatform
Talend Studio

TPS-3619

Info Value
Patch Name Patch_20200123_TPS-3729_v1-7.2.1
Release Date 2020-01-24
Target Version 20190620_1446-7.2.1
Product affected Talend Studio

Introduction

This patch is cumulative. It includes all previous generally available patches for Talend Studio 7.2.1.

NOTE: To download this patch, liaise with your Support contact at Talend.

Fixed issues

This patch contains the following fixes:

  • TPS-3729 [7.2.1] Error "Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0" while running spark job against HDInsight cluster. (TBD-9864)

This patch also includes the following patches:

  • TPS-3689 [7.2.1] Multiple tSortRow components throw compilation error in 7.2.1 (TBD-9575)
  • TPS-3688 [7.2.1] Compilation error - cannot convert from JavaPairRDD to JavaPairRDD (TBD-9751)
  • TPS-3649 [7.2.1] Need improve speed of build for jobs with children on CI Builder [part 2] (TUP-25409)
  • TPS-3677 [7.2.1] After jobserver patch, studio will sometimes hit 100% cpu indefinitely on random jobs
  • TPS-3678 [7.2.1] Created a new test case and run it, can not show up the test result on the right panel(TUP-24273)
  • TPS-3695 [7.2.1] NPE while building a route in Studio (TESB-27614)
  • TPS-3629 [7.2.1] Remove user credentials from talend project.(TUP-24432)
  • TPS-3636 [7.2.1] schema hardcoded in guess query in tDBInput component (TUP-25406)
  • TPS-3583 [7.2.1] [20200117] Load hadoop conf jar from a contextualized parameter (TBD-9574, TUP-25226)
  • TPS-3676 [7.2.1] tNetsuiteInput throws cast error when switching from use tNetsuiteConnection to use this component(TUP-24148)
  • TPS-3544 [7.2.1] [20200103] Spark Job fails with "NoSuchMethodError" against EMR 5.15 (TBD-9489)
  • TPS-3617 [7.2.1] [20200103] Compilation error on spark jobs after migrating to 7.2.1 (TBD-9641, TBD-9631)
  • TPS-3621 [7.2.1] Request patch for TESB-27266 (TESB-27266)
  • TPS-3625 [7.2.1] CI-Builder fails to publish a route due to "src\main\resources\feature\feature.xml not found" (TESB-27578)
  • TPS-3654 [7.2.1] [20200103] [EMR 5.15] Job fails with "Incorrect path,job's name or context's name may contain illegal characters" Error (TBD-9675)
  • TPS-3659 [7.2.1] script15706208930651409502535 cannot be cast to groovy.lang.Script (TESB-27172)
  • TPS-3616 [7.2.1] Artifact structure in Nexus is wrong for Routes with Routelets (TESB-27437)
  • TPS-3650 [7.2.1] Data loss issue with tMelissaDataAddress (TDQ-17667)
  • TPS-3655 [7.2.1] Profiling Error for Snowflake - For more number of fields selected(TDQ-17301,TDQ-17324,TDQ-17392)
  • TPS-3567 [7.2.1] NPE when using joblets from reference Projects (TUP-25099)
  • TPS-3673 [7.2.1] JSON metadata wizard for output mode throws class cast exception on Linux and Mac| tMongodbOutput mapping linkage is not showing up from macOS studio(TUP-25522,TUP-23984)
  • TPS-3549 [7.2.1] Nexus 3 gets populated by crypto-utils.jar (TUP-24953)
  • TPS-3587 [7.2.1] Error "XML format is incorrect", when customer try to define a 'File XML metadata' using a XSD file (TUP-24954)
  • TPS-3635 [7.2.1] External jar sync issue in studio using tLibraryLoad(TUP-25194)
  • TPS-3612 [7.2.1] Could not find the context Default (TESB-27447)
  • TPS-3590 [7.2.1] tJDBCRaw and tJDBCInput behave differently in 6.3.1 and 7.2.1 (TDI-43212)
  • TPS-3637 [7.2.1] ELTMap bug in column expression while using context variable as a parameter (TUP-22361)
  • TPS-3552 [7.2.1] [20191206] tuniquerow doesn't generate code (TBD-9372)
  • TPS-3563 [7.2.1] [20191206] tMap with Inner Join and All Match gives different result with Spark 2.x (TBD-9511)
  • TPS-3565 [7.2.1] Route containing config file fails when deployed (TESB-27207)
  • TPS-3474 [7.2.1] Studio Code tab doesn't generate code/show errors in Job (TUP-24732)
  • TPS-3483 [7.2.1] Check out function is missing From Studio->Job->Git History (TUP-24630)
  • TPS-3491 [7.2.1] Modification in Context Variables is not propagating to all jobs.(TUP-24748)
  • TPS-3585 [7.2.1] Cannot publish job using tRestClient as Docker Image (TESB-27082)
  • TPS-3518 [7.2.1] Not able to download some additional jar via https proxy (TUP-24749)
  • TPS-3542 [7.2.1] ELTMap / Teradata connexion fixes(TUP-24885,TUP-24937,TUP-24944,TUP-25218)
  • TPS-3531 [7.2.1] CI 7.2.1 Fails: Missing org.talend.components in the Artifact repository(TUP-24365)
  • TPS-3550 [7.2.1] [20191122] [MapR 5.2] tMapRDBOutput_1StructOutputFormat.class is having compiler issue (TBD-9487)
  • TPS-3560 [7.2.1] Dependency issues on spark joblets(TUP-25123,TUP-24884)
  • TPS-3468 [7.2.1] Cumulative Patch - 20191108
  • TPS-3487 [7.2.1] Error when a service use two tESBconsumer component in a dataservice job (TESB-27085)
  • TPS-3502 [7.2.1] Issue with Context Variable(TESB-27101)
  • TPS-3507 [7.2.1] Jobs are failing with the error "Cannot find or load the main class" when imported the project export from 6.3 to 7.2 (TUP-24786)
  • TPS-3451 [7.2.1] Code-> routine section does not allow user to edit "required" checkbox(TUP-24613)
  • TPS-3457 [7.2.1] [20191108] Big data job on Google Dataproc failing with NoSuchMethodError (TBD-9202)
  • TPS-3513 [7.2.1] [20191108] Job fails with "Incorrect path,job's name or context's name may contain illegal characters" Error (TUP-23637)
  • TPS-3538 [7.2.1] Integrate tacokit 1.1.14 release
  • TPS-3529 [7.2.1] Context does not transmit to Job called by route in the second call in runtime (TESB-27123)
  • TPS-3554 [7.2.1] Job fails with compilation error (TBD-9508)
  • TPS-3478 [7.2.1] Studio fails to sync jars with Artifactory if password has '@' character in it (TUP-24735)
  • TPS-3431 [7.2.1] Not able to see the component error in the Studio Designer (TUP-24607)
  • TPS-3479 [7.2.1] Compilation error on the job with project references (TUP-24623)
  • TPS-3489 [7.2.1] Build error with tRunJob on a spark job (TUP-24784)
  • TPS-3476 [7.2.1] [20191018] Spark job fails on databricks when 'trim all' option is selected in the advanced settings of tFileInputDelimited component (TBD-9334)
  • TPS-3460 [7.2.1] [20191101] "Invalid signature file digest for Manifest main attributes" Error with HD Insight Cluster (TBD-9289)
  • TPS-3421 [7.2.1] Following TDI-42674, update dependency for Redshift database metadata (TUP-23960)
  • TPS-3401 [7.2.1] JDBCInput component not working as expected when values as provided using context (TUP-24392)
  • TPS-3449 [7.2.1] Route persists error even after resolving the issue(TESB-26300)
  • TPS-3459 [7.2.1] Change Databricks API calls for Databricks 5.4 (TBD-9316)
  • TPS-3413 [7.2.1] Default Context environment appended after migrating to 7.2.1 (TUP-24355)
  • TPS-3429 [7.2.1] [20190919] - ES6 support on tMatchIndex/tMatchIndexPredict (TDQ-16220)
  • TPS-3336 [7.2.1] Improve Tck integration/installation/update in 7.2.1 (TUP-23106,TUP-23967,TUP-23264,TUP-23536,TUP-24226,TUP-24084)
  • TPS-3402 [7.2.1] Build silently fails if Route calls a Routelet of different versions (TESB-26578)
  • TPS-3422 [7.2.1] "java.lang.NoClassDefFoundError: org/talend/repository/services/model/services/ServiceItem" in studio(TESB-26856)
  • TPS-3386 [7.2.1] Path in Textbox of "To archive file" is incomplete when building job (TUP-22646)
  • TPS-3389 [7.2.1] Projects are switched to read only mode while reconnecting the session (TUP-24272)
  • TPS-3387 [7.2.1] keyword "TABLE" not working for tJDBCxxxx components (TUP-24326)
  • TPS-3406 [7.2.1] [Azure] Add Azure datacenter part of the studio connection
  • TPS-3359 [7.2.1] JDBC metadata connection for Redshift when exported as context, unable to retrieve schema (TUP-24232)
  • TPS-3323 [7.2.1] Error with cSplitter and jsonpath langage (TESB-26549)
  • TPS-3383 [7.2.1] Jobs with tWindow not compiling in Spark Streaming Jobs - Studio 7.2.1 (TBD-9096)
  • TPS-3374 [7.2.1] ERROR when Job in MDM project calling Job in Reference DI project:import routines.DataQuality cannot be resolved (TUP-23743)
  • TPS-3291 [7.2.1] Rest Dataservice with Microservice build type fails with error LoggerFactory is not a Logback (TESB-26574)
  • TPS-3303 [7.2.1] ESB - Docker Support for Microservices - CI Part (TESB-24597)
  • TPS-3340 [7.2.1] Problem with Data Service Rest publishing (maven plugin) (TESB-26711)
  • TPS-3334 [7.2.1] Snowflake components issue with cloud licence (TUP-24130)
  • TPS-3243 [7.2.1] Backporting the support of Databricks 5.x and ADLS Gen 2 (TBD-7856) + Spark Batch fixes (TBD-8836, TBD-8850) + Configurable poll interval for Databricks job status (TBD-9006)
  • TPS-3294 [7.2.1] Change security encryption of nexus (TUP-23087)
  • TPS-3318 [7.2.1] Issue with nexus setup with cloud (TUP-24046)
  • TPS-3287 [7.2.1] Cannot add more than 5 columns in tAggregateRow (TBD-8860)
  • TPS-3273 [7.2.1] Error in calling spark job from trunjob job inside standard job (TUP-23950)
  • TPS-3249 [7.2.1] Regression caused by TUP-21532 for ESB use case using tRunJob (TUP-23755)
  • TPS-3263 [7.2.1] Studio changes in column order are not saved (no propagate changes dialog) (TUP-23809)
  • TPS-3268 [7.2.1] ClassNotFoundException of the class of the job called by tRunJob in Routes (TESB-26048)
  • TPS-3269 [7.2.1] [Java 11] Failures when publishing to cloud using CI (maven plugin) (TESB-26461)
  • TPS-3270 [7.2.1] Duplicated libraries in private & import packages of the build manifest file (TESB-26293)

Prerequisites

Consider the following requirements for your system:

  • Talend Studio 7.2.1 must be installed.
  • To make TPS-3340 or TPS-3269 totally work, please replace the cloudpublisher-maven-plugin-7.2.1.jar into "{Studio_Home}/configuration/.m2/repository/org/talend/ci/cloudpublisher-maven-plugin/7.2.1" from "repository/org/talend/ci/cloudpublisher-maven-plugin/7.2.1" in patch zip.
  • To make TPS-3243 or TPS-3459 totally work:
  • In the "{Studio_Home}/configuration/config.ini" file, add the following entry: ,org.talend.hadoop.distribution.dbr540@start
  • Clean the libraries installed on the Databricks cluster. To do this:
    1. On the cluster side, click the "Libraries" tab and then select the check box to select all the libraries.
    2. Click "Uninstall".
    3. Restart the cluster.
  • To make TPS-3269 totally work, please replace the cloudpublisher-maven-plugin-7.2.1.jar into "{Studio_Home}/configuration/.m2/repository/org/talend/ci/cloudpublisher-maven-plugin/7.2.1" from "repository/org/talend/ci/cloudpublisher-maven-plugin/7.2.1" in patch zip.
  • To make TPS-3531,TPS-3649 totally work, please replace the builder-maven-plugin-7.2.1.jar into "{Studio_Home}/configuration/.m2/repository/org/talend/ci/builder-maven-plugin/7.2.1" from "repository/org/talend/ci/builder-maven-plugin/7.2.1" in patch zip.
  • To make TPS-3429 totally work when installing the patch using Commandline, Before starting the studio, need to delete the folder Configuration/org.eclipse.osgi
  • To make TPS-3655(TDQ-17301,TDQ-17324,TDQ-17392) totally work, please remove this folder "{Studio_Home}/configuration/.m2/repository/org/talend/libraries/org.talend.cwm.management"
  • To make TPS-3583 also works with standard job, please also install the plainzip patch of TPS-3583

Installation

Installing the patch for Cloud Studio

  • If you want to fetch license from cloud Azure - USA West (for TPS-3406)

    1) Open "{your_patch_zip}/plugins".

    2) Open "{Studio_home}/configuration/org.talend.configurator/bundles.info".

    3) CHANGE the version of org.talend.license.gui and org.talend.license.gui.talend in bundles.info(in the last two lines) TO the version of the jars in plugins.

    Example´╝Ü

    The jars in plugin folder of the patch zip are "org.talend.license.gui_7.2.1.20190909_1200-patch.jar" and "org.talend.license.gui.talend_7.2.1.20190909_1200-patch.jar", MODIFY them in bundles.info file to "org.talend.license.gui,7.2.1.20190909_1200-patch,plugins/org.talend.license.gui_7.2.1.20190909_1200-patch.jar,4,false" and "org.talend.license.gui.talend,7.2.1.20190909_1200-patch,plugins/org.talend.license.gui.talend_7.2.1.20190909_1200-patch.jar,4,false"

Installing the patch using Software update

1) Logon TAC and switch to Configuration->Software Update, then enter the correct values and save referring to the documentation: https://help.talend.com/reader/f7Em9WV_cPm2RRywucSN0Q/j9x5iXV~vyxMlUafnDejaQ

2) Switch to Software update page, where the new patch will be listed. The patch can be downloaded from here into the nexus repository.

3) On Studio Side: Logon Studio with remote mode, on the logon page the Update button is displayed: click this button to install the patch.

Installing the patch using Talend Studio

1) Create a folder named "patches" under your studio installer directory and copy the patch .zip file to this folder.

2) Restart your studio: a window pops up, then click OK to install the patch, or restart the commandline and the patch will be installed automatically.

Installing the patch using Commandline

Execute the following commands:

  1. Talend-Studio-win-x86_64.exe -nosplash -application org.talend.commandline.CommandLine -consoleLog -data commandline-workspace startServer -p 8002 --talendDebug
  2. initRemote {tac_url} -ul {TAC login username} -up {TAC login password}
  3. checkAndUpdate -tu {TAC login username} -tup {TAC login password}