Changelog for R2020-04 - 7.3

Introduction

This monthly patch includes all previous generally available patches for Talend Studio 7.3.1.

New features

This patch contains the following features:

• TBD-10198 Add database/table parameters on DeltaLake components
• TDM-7679 Flattener: generate the flattening map (via New Map wizard)
• TDM-7095 Get the index of the parent Loop

Fixed issues

This patch contains the following fixes:

• TUP-26596 Proxy of libraries not working when studio have no internet access
• TUP-26189 metadata connection with proxy may not select proxy properly
• TUP-26264 tELTMap generated query has extra symbols generated when more input mapping in component
• TUP-26156 tCreateTable: change "DBType" and "Property Type" not work
• TUP-26482 Studio is very slow to build the job(the performance issue)
• TUP-26212 Share more than one car component to nexus3.19.1 will fail to generate the right index file
• TUP-26213 Compilation issue after migration to v7.2
• TUP-26539 High Memory Consumption by Studio with GIT
• TUP-26793 JDBC Redshift in context mode still asked for jars which is not required
• TUP-26876 NoClassDefFoundError when I run spark job with JobServer
• TDI-43810 fix MongoDB issue with option "Create empty element if needed"
• TDM-7969 TDM adds unencrypted passwords to error message
• TDM-7957 Studio commandLine error on Headless Linux following Git pull
• TDM-7952 Nested distinct element causes performance issues
• TDM-7932 Flatten: some value isn't mapped after flatten map
• TDM-7931 Flatten: will return error when create flatten map from JSON structure
• TDM-7929 Importer CSV need clean not supported header in Xquery,rriahi
• TDM-7928 Move "Flattening Map" option at 2nd position in New Map Wizard
• TDM-7924 merged file path is wrong after thmapfile job when "merge file path" is the same as "output folder"
• TDM-7894 CSV show sample on element only display one record
• TDM-7870 importing avro schema is failed for openAPI json
• TDM-7867 Exclude Commons Collections 3.2.1
• TDM-7865 Bad initial values and exception on the LoopIndex function dialog
• TDM-7858 IsPresent updates are not persisted
• TDM-7855 Exception thrown on drag/drop of looping element where dialog was expected
• TDM-7840 Variable names in GetVariable/SetVariable produce unfriendly errors
• TDM-7839 LoopIndex in a distinct NestedContext Simple Loop can not detect the index_of element
• TDM-7836 Distinct funtion generate a not valid xquery in the context of AgConcat
• TDM-7835 Distinct function generate NullPointer Exception in the context of root elements
• TDM-7834 Distinct function generate NullPointer Exception in case of SimpleLoop Having NestedContext
• TDM-7829 tHMapFile merge functions doesnt not check correctly the folder name
• TDM-7826 thmapFile merge option doesnt work with Hadoop 3.1
• TDM-7789 CSV reader should use the optimization done for the CSV writer
• TDM-7772 Don't include a _osdtTerminator column when importing a CSV
• TDQ-18135 tDataEncrypt cannot generate a crypto file with context variable
• TDQ-17954 tMatchIndex, tMatchIndexPredict: parameter "Nodes" and "Index" can not use context mode value
• TDQ-18220 After migrating from 6.3 to 7.2 the tMatchGroup job has compiler errors
• TBD-10355 Missing Dataset to RDD method call in a migrated spark job
• TBD-10005 HDP3.1 Compile error tHiveOutput with partitioning: hiveContext_tHiveOutput_1 can not be resolved
• TBD-10101 tFileOutputDelimited can not keep the format of date column
• TBD-10167 Compiler error when run spark job on Databricks with tS3configuration that use context value
• TBD-10212 [BUG] Avro dependencies cause error in databricks
• TBD-9674 tHiveOutput append action in spark big data batch job under HDP3.1
• TBD-9872 byte[] type is written to file incorrectly
• TBD-9986 user token is printed as plain text in joblog when databrick debug level log is on
• TBD-10081 Fix wrong release maven url with -SNAPSHOT in artifact id
• TBD-10108 Date conversion in tExtractJSONFields is not correct
• TBD-10157 Advanced option is not considered when using tHDFSPut in Standard jobs
• TBD-10158 Migration task can alter the pattern selected by user
• TBD-10210 Cannot load component "tFileOutputJSON"
• TBD-10217 org.apache.parquet cannot be resolved to a type
• TBD-10297 slf4j logger does not contains error() method
• TBD-10008 Wrong timestamp in tFileOutputDelimited component

Prerequisites

Consider the following requirements for your system:

• Talend Studio 7.3.1 must be installed.

Installation

Installing the patch using Software update

1. Log in to Talend Administration Center and go to Settings->Configuration->Software Update. Enter the correct values and save them referring to the documentation: Configuring the Software Update repository in Talend Administration Center (https://help.talend.com/access/sources/content/topic?pageid=config_update_repo&EnrichVersion=7.3&afs:lang=en).
2. Download the new patch from the Settings->Software Update page into the nexus repository.
3. Log in to Talend Studio with remote mode.
4. Click the Update button displayed on the login window to install the patch.

Installing the patch manually using Talend Studio (for Cloud users)

1. Create a folder named "patches" in your Studio installer directory and copy the patch .zip file to this folder.
2. Restart your Studio.
3. Click OK when prompted to install the patch, or restart the commandline to install the patch automatically.

Installing the patch using CommandLine

Execute the following commands to install the patch:

1. Talend-Studio-win-x86_64.exe -nosplash -application org.talend.commandline.CommandLine -consoleLog -data commandline-workspace startServer -p 8002 --talendDebug
2. initRemote {tac_url} -ul {TAC login username} -up {TAC login password}
3. checkAndUpdate -tu {TAC login username} -tup {TAC login password}

After installing the patch, you need to stop CommandLine and clean the org.eclipse.osgi folder under the {Talend-Studio}/configuration directory, where {Talend-Studio} is the installation directory of your Talend Studio.

Installing the patch using Continuous Integration

To install the patch using the CI builder, use the -Dpatch.path option at build time. See https://help.talend.com/reader/192RkMI7p2m0NpW1~16SEg/Lx7BQ3BNGhDm6TrnDEm8kw for details.

Note: It is strongly recommended to resynchronize poms after installing the patch by clicking the Force full re-synchronize poms button in the Build -> Maven view in the Project Settings dialog box in Talend Studio.

Changes from previous monthly releases

New features

This patch contains the following features:

• TDI-43218 Azure storage components provide connectivity through SAS Token or Account key. This feature request is to provide connectivity though AD authentication.

Fixed issues

This patch contains the following fixes:

• TBD-10063 Errors on spark with Yarn Cluster with custom hadoop path on Remote Engines
• TBD-10251 Fix issues with some characters for hadoop configuration jar
• TUP-26576 Remove the warning about repository setup even if artifact repository is disabled in TMC
• TUP-26751 Fix CI issues, due to invalid test case
• TUP-26165 Fix possible missing jars when build job
• TUP-26728 Missing spark dependencies when using test cases and fix spark compilation issues
• TBD-10324 Fix compilation issue with RDD with tMap
• TBD-10284 Fix issues with custom hadoop configuration with DI jobs and Spark jobs with Yarn-Cluster setup