R2020-08 (cumulative patch) - 7.3

author
Talend Documentation Team
EnrichVersion
7.3
EnrichProdName
Talend Data Fabric
EnrichPlatform
Talend Studio

R2020-08 (cumulative patch)

Info Value
Patch name Patch_20200821_R2020-08_v2-7.3.1
Release date 2020-08-21
Target version 20200219_1130-7.3.1
Product affected Talend Studio

Introduction

This monthly release includes all previous generally available patches for Talend Studio 7.3.1. For more information about the new features and bug fixes included, see Talend Data Fabric Release Notes.

NOTE: For information on how to obtain this patch, reach out to your Support contact at Talend.

New features

This patch contains the following features:

  • TUP-27506 Execute custom script from jenkins task
  • TUP-27454 Generate poms for projects from jenkins task
  • TBD-11007 lightweight dependencies
  • TBD-10669 Customizable precision for Datasets
  • TBD-11029 AWS Spark S3 KMS Encryption issue (EMR 5.29)
  • TBD-10588 Add the location option to Delta's Metastore
  • TBD-10769 Add the Drop & Truncate option to Delta's Metastore
  • TBD-10774 Add the optimize table option to Delta's Metastore
  • TBD-10793 Load hadoop conf jar from a contextualized parameter - Repository / YARN-Client / Spark Batch & Spark Streaming
  • TBD-10908 Upgrade httpclient to 4.5.12 & httpcore to 4.4.13
  • TUP-28142 Add talendDebug for CI
  • TUP-28051 Easily forward properties from cibuilder to commandline
  • TUP-26542 MultiUser: readonly user can't logon remote project
  • TUP-27879 Shared user can't write library index file library_data.index
  • TUP-28048 MultiUser: readonly user can't update license
  • TUP-27679 The preparation data aren't same as the source data when tDataPrepRun creates a new preparation with dynamic column
  • TUP-27862 Add possibility to customize pattern for dates when retrieve table
  • TUP-25566 All the recycle bin should not be build or executed
  • TUP-25103 tELTMap - ctrl+space shortcut is not working to retrieve easily job context
  • TDI-44590 Salesforce bulk v2 query (Extraction from Salesforce Object using bulk V2)- Salesforce componnets
  • TDI-44364 tMongodboutput: Data insert and update with selective columns
  • TDI-44295 Studio - Improve performance of SAP Streaming
  • TDI-42668 tSSH replace deprecated library Ganymed with Apache mina-sshd
  • TDI-44045 S3 Family component to have an option for enablePathStyleAccess() function
  • TDI-44630 HA on master nodes with AWS EMR
  • TESB-29133 Update dom4j to 2.1.3
  • TESB-29322 Microservice monitoring - expose Camel metrics
  • TDQ-18438 tStandardizePhoneNumber: new column isValidPhoneNumberForRegion
  • TDQ-18439 New indicator: Valid Phone Number for Region Count

Fixed issues

This patch contains the following fixes:

  • TBD-11130 ClassNotFoundException when I check service for CDH 6.3.3& CDH 6.1.1 & HDP 3.1
  • TUP-26138 Unexpected character ('<' (code 60)): was expecting double-quote to start field name
  • TUP-28295 UI Problem of TCOMPV0 in the recent 741NB and 731 Release + Aug. Nightly Build Patch
  • TUP-28009 Dependency is dropped on creating new version
  • TUP-28002 Share Library errors show in error log after logging into remote project
  • TUP-27590 Relationship.index might get really big
  • TUP-27814 Talend Studio taking long time than normal for launching
  • TUP-27812 CVE:Bouncy Castle JSSE provider and TLS/DTLS API
  • TUP-27447 [7.2.1] Unable to build a project with a project reference
  • TUP-27374 [7.2.1] Commandline doesn''t pick up the correct JVM arguments
  • TUP-28338 [7.3.1]configuring Implicit tContextLoad in the job Goes on error after installing the patch 07_2020
  • TBD-11114 [Spark Batch] "java.lang.Boolean is not a valid external type for schema of decimal(38,18)" runtime exception on tHiveOutput component with all data types in schema
  • TBD-11103 Spark job doesn't work under CDP7.1.x with kerberos
  • TBD-10924 The operator != is undefined for the argument type(s) double, null
  • TBD-10977 [Spark 21, HDP260] java.lang.UnsupportedOperationException: Cannot infer type for class org.apache.spark.ml.linalg.Vector because it is not bean-compliant
  • TBD-10983 Could not initialize class org.apache.http.conn.ssl.SSLConnectionSocketFactory while connecting to hive in http mode
  • TBD-11040 Unable to build BD Streaming job
  • TBD-11052 Compilation error with migrated job
  • TBD-11078 [7.3.1] Spark Batch Job fails to compile when using MapRDBInput component
  • TBD-9565 java.lang.ClassCastException on tSqoopMerge component
  • TBD-10621 ClassNotFound/NoSuchMethod on Hive components on HDP 3.1
  • TBD-10878 Spark UI interface problem (org.glassfish.jersey.servlet.ServletContainer.service)
  • TBD-10954 tFileOutputDelimited applies trim operation but shouldn't
  • TBD-10957 tFileInputPositional with reject flow only: correct rows are going to reject
  • TBD-11055 tKuduOutput has compilation error while selecting Dynamic Distribution CDH 6.3.3
  • TBD-11097 tMap:Cannot resolve column that type is designed as Long type
  • TBD-11016 Disable KMS key id for emr 5.15 and s3a filesystem in spark batch
  • TUP-27776 Can't build job from CI (missing jar dependency)
  • TUP-27926 Invalid SQL syntax when adding CDC for a MSSQL based source table
  • TUP-27953 tSalesforceInput component displays in-job tSalesforceConnection incorrectly
  • TUP-27609 Maven option -Dpatch.path not working when -Dgeneration.type=local is used
  • TUP-28221 CLONE - Remove linefeed character from messages_fr.properties file
  • TDI-43606 JdbcInput Mysql dynamic schema throws an exception which disappearing with change component state
  • TDI-41286 tSnowflakeOutput --> Custom DB type = True, but no column choosed. It will throw error "java.lang.String cannot be cast to java.util.List"
  • TDI-44497 [Snowflake]'Upsert key column' list should be from DB columns
  • TDI-44498 tSnowflakeInput can't retrive data without manual query when column name is Japanese
  • TDI-44362 Remove commons logging from some components
  • TDI-44517 tSnowflakeBulkExec can't retrieve schema.
  • TDI-44400 NPE exception with BigqueryBulkExec
  • TDI-44457 JDBCSCDELT:type2 doesn`t work as expected when use mysql
  • TDI-44538 tSAPODPInput remove unsupported select group operator "Contains pattern"
  • TDI-44552 tDBOutput(Snowflake) 7.1.1 to 7.3.1 migration issue
  • TDI-44481 CVE: commons-beanutils:commons-beanutils:1.9.3
  • TDI-44486 tGSPut/tGSList/tGSGet : Error if "+" in filename : SignatureDoesNotMatch The request signature we calculated does not match the signature you provided
  • TDI-44192 Update dom4j to 2.1.3
  • TDI-44614 tMongoDBOutput_1_Out java.util.Date cannot be cast to java.lang.String
  • TDI-44512 tMicrosoftCRMOutput validate lookup update extremely slow in 731
  • TDI-44643 NPE exception on tWaitForSQLData with snowflake connection
  • TUP-27710 studio with GIT autocrlf setting
  • TUP-27989 Git related issues checked with support
  • TDM-6619 Mapper bundles in state 'Failure' after deployment
  • TDM-8172 Problem with Talend Studio 7.2.1 and WSDL + tHMap
  • TDM-8209 Fail to publish runtime TDM artifacts by commandline with NPE error
  • TDM-8210 Unable to MAP HL7 with CSV
  • TDM-8104 Provide a way to rebuild project properties file
  • TDM-8157 JSON: problem to import json file containing BOM
  • TDM-8173 AgConcat imported from 6.4.1 to 7.2.1 looses Fixed loop expressions
  • TDM-8198 Export more packages in org.talend.transform.saxonpe.osgi
  • TDM-8214 tuj job tdm_TDM7663_trunjob_trigger_BDjob is failed on build 20200722_1939
  • TESB-29645 NPE is thrown when route with 2 cRest components one of which has service locator enabled is deployed into runtime
  • TESB-29613 Many unexpected open connections at same time to AMQ
  • TESB-29278 Swagger UI not getting updated
  • TESB-29126 Specifying a SimpleAuthorizingFilter in a cRest component does not work anymore
  • TESB-29284 Error occurred when execute a microservice jar which is built by a tresrequest job with embedded trestclient job
  • TESB-29285 Error occurred when build a microservice jar which contains a tresrequest job with embedded trestclient job for the first time
  • TESB-29751 Not support RPC style operations when configuring cSOAP
  • TESB-29866 When using CI to build MS need to execute twice to get the correct result
  • TESB-29457 the different behavior after migration when the response code is 202
  • TESB-29903 ClassCastException: net.minidev.json.JSONArray
  • TDQ-18628 Azure Synapse Analytics: fixed the error on schema level
  • TDQ-18621 Indicator Selection dialog box: fixed the display error caused by a long column name
  • TDQ-18584 dom4j updated to 2.1.3
  • TDQ-18661 tMatchGroup: Fixed errors when using a PostgreSQL dababase and the tDBInput component
  • TDQ-18558 Google phone number library: upgraded to the most recent versions
  • TESB-28271 VMSpringDemo will not run in Runtime without activemq-camel feature installation
  • TESB-29957 CI Fail to publish Microservice Route with Prometheus param to cloud
  • TUP-27934 impala metadata not in sync with the impala component
  • TUP-27697 Studio throw NPE error when drag json item to job
  • TESB-29984 cMQConnectionFactory require incorrect jar
  • TESB-29935 Default Camel dependencies is not getting updated from Talend Studio 7.2.1 to 7.3.1
  • TDI-44393 Fix support of date pattern use within snowflake connector
  • TESB-30009 Missing jar in tRESTRequest component
  • TESB-28966 MQTT: consume messages published before client starts up

Prerequisites

Consider the following requirements for your system:

  • Talend Studio 7.3.1 must be installed.

Installation

Installing the patch using Software update

  1. Log in to Talend Administration Center and go to Settings->Configuration->Software Update. Enter the correct values and save them referring to the documentation: Configuring the Software Update repository in Talend Administration Center.
  2. Download the new patch from the Settings->Software Update page into the nexus repository.
  3. Log in to Talend Studio with remote mode.
  4. Click the Update button displayed on the login window to install the patch.
  5. When the patch is installed, if the following cache folders have been created: {Talend-Studio}/configuration/.m2/repository/org/talend/libraries/org.talend.cwm.management/6.0.0 and {Talend-Studio}/configuration/.m2/repository/org/talend/libraries/org.talend.dataquality/6.0.0, delete them.

Installing the patch manually using Talend Studio (for Cloud users)

  1. Create a folder named "patches" in your Studio installer directory and copy the patch .zip file to this folder.
  2. Restart your Studio.
  3. Click OK when prompted to install the patch, or restart the commandline to install the patch automatically.
  4. When the patch is installed, if the following cache folders have been created: {Talend-Studio}/configuration/.m2/repository/org/talend/libraries/org.talend.cwm.management/6.0.0 and {Talend-Studio}/configuration/.m2/repository/org/talend/libraries/org.talend.dataquality/6.0.0, delete them.

Installing the patch using CommandLine

Execute the following commands to install the patch:

  1. Talend-Studio-win-x86_64.exe -nosplash -application org.talend.commandline.CommandLine -consoleLog -data commandline-workspace startServer -p 8002 --talendDebug
  2. initRemote {tac_url} -ul {TAC login username} -up {TAC login password}
  3. checkAndUpdate -tu {TAC login username} -tup {TAC login password}
  4. When the patch is installed, if the following cache folders have been created: {Talend-Studio}/configuration/.m2/repository/org/talend/libraries/org.talend.cwm.management/6.0.0 and {Talend-Studio}/configuration/.m2/repository/org/talend/libraries/org.talend.dataquality/6.0.0, delete them.

After installing the patch, you need to stop CommandLine and clean the org.eclipse.osgi folder under the {Talend-Studio}/configuration directory, where {Talend-Studio} is the installation directory of your Talend Studio.

Installing the patch using Continuous Integration

To install the patch using the CI builder, use the -Dpatch.path option at build time. See Building and Deploying for details. When the patch is installed, if the following cache folders have been created: {Talend-Studio}/configuration/.m2/repository/org/talend/libraries/org.talend.cwm.management/6.0.0 and {Talend-Studio}/configuration/.m2/repository/org/talend/libraries/org.talend.dataquality/6.0.0, delete them.

Note: It is strongly recommended to resynchronize poms after installing the patch by clicking the Force full re-synchronize poms button in the Build -> Maven view in the Project Settings dialog box in Talend Studio.

Changes from previous monthly releases

New features

This patch contains the following features:

  • TDI-43899 tJDBCSCDELT SCD Type 0 Field Support
  • TDI-44284 Rename old tEXAxxx connectors in tExasolxxx
  • TDI-37016 tVerticaOutputBulk doesn't support Dynamic schema
  • TDI-44039 internal_ip_only for tGoogleDataprocManage component
  • TDI-44167 tJDBCSCDELT component to support Databricks Delta
  • TUP-27633 Update Montlhy release name in toolbar
  • TUP-27680 Can't use the database "MAPPING" parameter to decide the component UI if show
  • TDM-7800 Add merge option to tHConvertFile
  • TESB-28700 [Password Secure] Publish to TMC
  • TDI-38246 Add the ability to authenticate with Google Cloud Storage using service accounts in the tGSConnection component
  • TDI-44466 BigQuery Bulk - Add service account authentication for Google Storage properties
  • TDI-44448 Support AWS EMR 5.29.0
  • TDI-44109 tFTP components (FTP server) to be able to connect with tsetProxy (Http)
  • TDI-44476 Enhance tUnload Redshift Component to support download in parquet format
  • TBD-9999 Support CDP Milestone I: Dynamic Distro for CDP Data Center 7.x
  • TBD-9737 Support HDInsight 4.0 Static Distro - DI / Spark / Spark streaming
  • TBD-10362 Support Databricks instance pools in Spark jobs
  • TUP-26669 Adapt HDInsight wizard for HDInsight 4.0
  • TUP-26699 Enhance context propagation over reference project - Resolve link conflict with Git
  • TUP-27259 Change default driver to Microsoft official for MSSql in Metadata
  • TUP-27157 Searchable Stitch connectors
  • TDI-43962 Talend Data Preparation Support for Dynamic Schema
  • TDI-44214 Change default driver to Microsoft official for MSSQL connector
  • TDI-43717 Tck component CosmosDBSQLAPI for Studio
  • TDI-44216 AWS Redshift Partner Tracking
  • TDI-44171 Observability: Add "Component" label to component-related events
  • TDI-44172 Observability: Create new "component execution" event and emit it frequently
  • TDI-44061 Snowflake - External Oauth2 support
  • TDI-44181 Support new authentication for ADLSgen2
  • TDQ-18462 MSSQL Database: Microsoft is now the default driver
  • TBD-10198 Add database/table parameters on DeltaLake components
  • TDM-7679 Flattener: generate the flattening map (via New Map wizard)
  • TDM-7095 Get the index of the parent Loop
  • TDI-43218 Azure storage components provide connectivity through SAS Token or Account key. This feature request is to provide connectivity though AD authentication.
  • TBD-9991 Support for EMR 5.29 Static Distro - DI / Spark batch / Spark streaming
  • TBD-10328 Merge operation for Delta Lake in tDeltaLakeOutput
  • TBD-10169 Upgrade Delta Lake connectivity
  • TBD-10265 Upgrade Snowflake connectivity
  • TBD-9643 Support Oracle 19c
  • TBD-10206 Upgrade httpclient to align with other components
  • TUP-16546 Prompt users for new password in Studio Connection when AD/LDAP credentials change in TAC
  • TUP-25708 Avoid GIT Branch conflicts due to Timestamp and ID
  • TUP-26186 Use the operators =, <=, <, >=, >, <> instead of EQ, LE, LT, GE, GT, NE in tELTTeradataMap
  • TUP-26284 Upgrade AWS SDK for driver in metadata
  • TUP-26956 Update Studio top bar to reflect monthly deliveries for better understanding
  • TUP-26288 Enhance context propagation over reference project
  • TDI-43878 Accessing DynamoDB GSI
  • TDI-43724 Extend AWS STS assume role field for Studio
  • TDI-43719 Rename tSQLDWHXXX component to tAzureSynapseXXX and support adls gen2
  • TDI-44179 Support new load method with COPY statement in tSynapseBulkExec
  • TESB-27806 Expose Talend Microservices Metrics in a monitoring system like Prometheus
  • TESB-24998 Interpret context variables used in provider and consumer endpoints in Data Services and Routes
  • TMC-19740 Delete "update corresponding task" check box from Studio publish to Cloud dialog
  • TDI-39575 Support AD authentication for Azure SQL Data Warehouse with tMSSQL connectors
  • TDQ-17784 DQ components (Spark Batch) support Databricks on Azure & AWS
  • TDQ-18049 tMatchModel: Feature importance report can be saved on Databricks (Azure/AWS) and HDInsight (Azure)

Fixed issues

This patch contains the following fixes:

  • TUP-27338 Download jar pb with TDI license on Studio
  • TUP-27586 Slow to start studio when patch was applied from local folder
  • TUP-27253 Performance: studio startup takes long time because of too many invokes of file.exist()
  • TUP-26687 [7.3] Studio re synchronizing jars with artifact repository every time when logged into studio
  • TUP-27545 Update context var name for jdbc drivers can not be updated to job automatically.
  • TUP-27780 Workbench has not Been Created Yet.
  • TUP-27610 Clean up the CI version everywhere and have a common place to setup in studio.
  • TUP-27352 Traces enabled by default when using Memory Run.
  • TDI-44234 Check if normal and error threads are handled correctly in tMongoDBBulkLoad component.
  • TDI-44355 tFileInputMail generate a NullPointerException while parsing a missing multi value field
  • TDI-44412 TFTPPut doers not exit on Error even i ncase of Error
  • TDI-44165 BigQueryBulkExec Component fails when DATE type column has empty fields
  • TDI-44384 tBigQueryBulkExec failing load data after setting header
  • TDI-44413 The tDBOutputBluk does not load date correctly
  • TDI-44209 tDatasetoutput on inventory mode should not update the dataset when multiple datasets exist with the same name
  • TDI-44472 NB_LINE of tDBXXX Component may not work after migration
  • TDI-44453 tAdvancedFileOutputXML issue after upgrading to 7.3.1
  • TDI-44378 tSybaseOutput can't create table with character column
  • TDI-44340 Values in Custom body fields in SalesOrder in NetSuite are not return
  • TDI-44202 Sybase 16 (SQL Anywhere) donot support tCreateTable component
  • TDI-44465 Fail to load data to Snowflake table when column name is Japanese
  • TDI-44521 CVE:Data Mapper for Jackson
  • TDI-44342 BigQuery Datetime type ignore microseconds
  • TDI-44482 CVE: org.apache.ant:ant:1.10.1
  • TDI-44506 Failed to build job on TOS
  • TDI-44540 not format the duration for audit log in studio, only use raw value
  • TDI-44324 tCassandraInput doesn't have generation code when column is char type
  • TDI-44140 Update Commons Compress to 1.19
  • TDI-44404 teltsapmap throws string index out of range error if integer field has no value
  • TDI-44468 tSalesforceOutput component output schema has only ID column
  • TUP-27594 SVN project: after copy to branch, job can not link to context OK
  • TUP-27544 Context update can not update to the first testcase if the job have more than one testcase.
  • TUP-27599 Context var can not be listed in the same row when job use repository context the context both changed by two users.
  • TUP-27574 When job item file is not conflict, can't merge old link file
  • TUP-27497 tPreJob with tHDFSConnection with kerberized cluster fails with simple authentication error
  • TUP-25835 Dynamic distribution cannot download libraries from proxy Nexus
  • TUP-27517 Implicit Context is not working with the Field Separator as "#*#"
  • TUP-26059 tELTPostgresqlMap lost its "DB Type" column for which the value should be "BPCHAR"
  • TUP-27588 tCreateTable data types mapping in the schema editor is always Mysql after dragging and dropping from database Metadata
  • TUP-27070 ELT component configuration to create an UPDATE Statement
  • TUP-26810 if one jar used by two different components, it will upload to nexus with two versions
  • TUP-27416 studio timeout with network is not available error when downloading additional jar through proxy
  • TUP-27592 tDataPrepRun does not enforce studio proxy settings (outside a job) to connect to https://tdp.eu.cloud.talend.com
  • TUP-27718 Git merge compare editor security improvement
  • TUP-27433 Mvn package job with testcase fail after import in
  • TUP-27179 Studio freezes on job importing/loading
  • TESB-29331 Commandline 'Microservice for ESB' Build Type with tRestRequest Hangs
  • TESB-29503 Bundle version does not use 'Custom Version'
  • TESB-29647 Bundle version does not use 'Custom Version' for jobs
  • TESB-29739 java.lang.NumberFormatException: For input string: "0-SNAPSHOT"
  • TESB-29321 [CI Cloud Publishing] Fail to deploy DemoRESTRoute_ms to RE
  • TDI-44455 studio component integration can't active unit tests
  • TDQ-18173 Referenced project: Some changes in referenced project are now detected in main project
  • TDQ-18212 Reporting tool: Updated a dialog box to recommend Jasper Studio
  • TDQ-18567 tRuleSurvivorship: Fixed error when using certain data combinations
  • TDQ-18565 Hive database on a Hadoop cluster: Fixed error when switching contexts
  • TDM-8134 tHMap job error after upgrade to 7.3
  • TDM-8150 Distinct Child Element does not work with XML attributes
  • TDM-8151 Map using Structure Validation may fail when job generated using CommandLine
  • TDM-588 UTF-8 XML file with a byte order mark is not handled by the XML sample importer
  • TDM-7820 problem to map XML with attributes to CSV
  • TDM-7908 ReadNested within CSV or HashMap Representation fails
  • TDM-8040 Avoid map execution failure if cannot generate expression in avro schema
  • TDM-8139 Avro Exporter issues warning when default value is set on a primitive array
  • TDM-8174 Setting execution properties for tests does not work
  • TDM-8176 Automatic sorting on distinct element lost when migrating from 6.4.1 to 7.2.1
  • TDI-44494 duplicated variable name in tMongoDBInput
  • TDI-44377 UTF-8 BOM issue in tFileInputDelimited
  • TDI-44300 UTF-8 BOM issue in tFileInputPositional
  • TBD-10838 "URLClassLoader cannot be resolved to a type" in tHDFSConnection after Studio patch.
  • TBD-10799 HDI4 DI tHiveConnection issue
  • TBD-10798 Wrong repository url / password with proxy on dynamic distribution
  • TBD-10787 org.apache.spark.SparkException: Task failed while writing rows
  • TBD-10541 Upgrade jackson dependencies to 2.9.10.4 for MapR 6.0.1
  • TBD-10730 Revert TBD-10506 from maintenance/7.3 and master
  • TBD-10636 Need Test TUP-26669 Adapt HDInsight wizard for HDInsight 4.0
  • TBD-10695 Deprecate Altus
  • TBD-10711 Change default value for Hive Catalog
  • TBD-10048 When executing a job with tHive components, warning: set mapred.job.name=xxx... Encountered: . Expected: = CAUSED BY: Exception: Syntax error
  • TBD-10285 Sqoop job failing with exception Unknown dataset URI pattern
  • TBD-10654 [BUG] tFileInputDelimited error
  • TBD-10676 Compile error on simple Spark Streaming job
  • TBD-10680 [CDH6.1] java.lang.NoSuchMethodError on simple Spark Batch job
  • TBD-10213 [CDH61] java.lang.NoClassDefFoundError on job with OracleInput component
  • TBD-10429 additional double quotation is added to output file of tFileOutputDelimited
  • TBD-10436 Hive component fails with java.lang.NoClassDefFoundError: org/apache/log4j/Logger
  • TBD-10454 [7.3.1] DI job using tHDFSExist works from Studio to RE but not from TMC to RE
  • TBD-10581 Context for Spark Streaming Job isn't updating properly
  • TBD-10620 apache.spark.sql.catalyst.analysis.NoSuchDatabaseException for non-default database in HiveInput
  • TBD-10621 ClassNotFound/NoSuchMethod on Hive components on HDP 3.1
  • TBD-10657 Change in behavior of iterating fields using hive components
  • TBD-10700 "hive-exec-shade-2.1.1-cdh6.1.1-talend.jar" not found in talend-update site for dynamic distribution.
  • TBD-10712 [CDH 6.1.1]" java.lang.NoSuchFieldError: resources" error on both Spark Batch and Streaming jobs
  • TUP-27642 Issue when login project setup with Implicit Context Load + JDBC component
  • TUP-27074 Kafka Job builds in Studio, but fails in CI Builder
  • TUP-26970 [7.3.1] custom component published to nexus as .zip
  • TUP-26683 "Generate Doc as HTML" Inputs label in documentation not the same as FlowDiagram
  • TUP-26896 Error create a Sybase connection in metadata and cannot retrieve tables
  • TUP-26812 Old plugin folders deletion failed after installed new updatesite patch
  • TUP-27530 [7.3.1] After install Patch of TUP-27315, studio can't build job when first time login on
  • TUP-27315 Patch installation issues for zero install CI
  • TUP-27533 [7.3.1] Update ci-builder version to 7.3.2 in org.talend.designer.maven.tis
  • TUP-27078 Studio upload the libraries (jar files) into the Artifactory Server at each start
  • TUP-27053 Error: Could not find or load main class due to no JVM parameters configured in Studio
  • TUP-27072 Unexpected behaviour occurred when context name is in Japanese
  • TUP-25889 Display issue for the line between Linker source and target on Mac and Ubuntu
  • TUP-26476 tELTMap Group By in Where Clause
  • TUP-27343 Version is missing in Studio top bar after installing monthly patch by Nexus Update
  • TUP-27210 Version isn't correct in Help->"About Talend Studio" after installing monthly patch
  • TUP-27403 Wrong default values set when retrieve schema on Sybase
  • TUP-27394 Missing DB Type for sybase
  • TDI-44038 tSalesforceOutput file upload: byte[] or base64 encoded strings
  • TDI-44273 tSalesforceOutputBulkExec reject link is providing nulls for Id
  • TDI-44261 tSnowflakeOutput/tSnowflakeOutputBulkExec/tSnowflakeBulkExec Upsert invalid identifier
  • TDI-44247 "Illegal operation on INFORMATION_SCHEMA" error on tBigQueryInput
  • TDI-30505 Don't log 'Has inserted/update/delete x recorde(s)' when DBoutput checked 'Use an existing connection' and DBconnection doesn't check 'Auto commit'
  • TDI-44221 MongoDBBulkLoad--Exception in thread "Thread-2" java.lang.StringIndexOutOfBoundsException
  • TDI-44269 Outline ERROR_MESSAGE is null if "die on error" is not checked
  • TDI-44185 Authentication Fields missing in tMongoDBBulkLoad
  • TDI-44196 JDBC/MSSQL(Input) -> SqlServer(Output) Dynamic schema ERR:Colname [$] is converted to [_]
  • TDI-44253 tMongoDBOutput java.util.Date cannot be cast to java.lang.String
  • TDI-44128 Update axis2 dependency (CVE: axis2-kernel:1.5)
  • TDI-44281 tSetProxy in "local proxy" mode failing with NoClassDefFound
  • TDI-44292 tJDBCInput not converting date in expected format
  • TDI-43833 tDBBulkExec bug when using PostGress driver
  • TDI-44166 AzureADLSGen2Output: Blob Path starting with slash leads to unclear error
  • TDI-44104 CVE: xmlrpc-common:3.1.2
  • TDI-44105 CVE: xmlrpc-common:3.0
  • TDI-44115 CVE: xmlrpc-client:3.1.2
  • TDI-44169 CVE: xmlrpc-client:3.0
  • TESB-29280 tESBConsumer component fails with NAMESPACE_ERR: An attempt is made to create or change an object in a way which is incorrect with regard to namespaces
  • TESB-28929 cSOAP - Advanced Settings - Log Messages
  • TESB-29315 P2 depoy failed because of missing osgihelper-maven-plugin
  • TESB-29150 Context password for Microservice could not be used correctly when using Http Basic
  • TESB-29506 Failed to request REST Job service + SL as microservice
  • TDM-8089 Problem with camel headers when cJMS and cMap are used
  • TDM-8125 DatabaseLookup creating new DataSources for each message on the ESB
  • TDM-8084 Using thmap is getting an error when using a map with X12_5050_HIPPA structure
  • TDM-8085 Cannot rename a json structure during the creation process.
  • TDM-8088 tHMap : read/write to COBOL representation - "Decimal" with decimal places has wrong result
  • TDM-8094 Databaselookup fails on new runtime unless it is a top-level expression
  • TDM-8126 Infinite loop when generating route or job if map name contains DatabaseLookup
  • TDM-7985 Weird result when change CSV "skip header reading" option for special CSV
  • TDM-7986 UI issue on selection changed event in Map editor
  • TDM-8029 Need to regenerate projectProps when GIT pull
  • TDM-8076 Importing the map form 6.2 to 7.3 is not working
  • TDM-8092 XML Reader should honor encoding set in the XML Representation
  • TDM-8144 TDM tuj (command line in Linux) will return error on 731 June monthly patch
  • TDQ-18470 Data Quality components: updated all DQ library jars to the correct version
  • TDQ-18347 tMatchGroup: fixed the difference between the Chart results and the Job results
  • TDQ-18491 Importing DQ rules: fixed the item conflict
  • TDQ-18513 tMSSql(In)ValidRows: fixed the version of talend_DB_mssqlUtil jar
  • TBD-10616 Compiler error when spark streaming job use tMap that linked with tFixFlowInput,tHiveInput
  • TBD-10615 Compiler error when spark streaming job use tFileInputDelimited
  • TBD-10613 [BUG] tDeltaLakeOutput - SQL Merge option and time-travel corrections
  • TBD-10606 [CDH 6.1 Spark Batch] Hive job fails with "Unable to instantiate SparkSession with Hive support because Hive classes are not found" error
  • TBD-9956 Sqoop issue with parquet/avro format with HDP 2.6
  • TBD-10095 Sqoop issue with parquet/avro format with EMR 5.15(2.8.3)
  • TBD-10113 [BUG] Streaming, no output/NPE on tFileStreamInputJSON
  • TBD-10363 lost data after read by tFileInputDelimited component
  • TBD-10374 Cannot connect to hive against CDH 5.16.2
  • TBD-10401 [7.3.1]Getting [ERROR]: org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator in a few job post migration to Talend 7.3.1
  • TBD-10442 tFileOuputDelimited - wrong columns order
  • TBD-10443 CDH - Dynamic distribution - CDH 6.X not available
  • TBD-10449 NullPointerException when column is empty
  • TBD-10479 [BUG] Compile error with tHiveOutput
  • TBD-10572 Streaming - tExtractDelimitedFields - Compile error
  • TBD-9802 Compile error in spark job with HBase on HDP 3.1
  • TBD-10067 Incorrect Encoding in FileInputJSON
  • TBD-10153 Compiler error for sqoop components in DI job when using java 11
  • TBD-10159 (Spark Local 2.4) java.lang.NoSuchMethodError on Oracle components
  • TBD-10337 [Spark Streaming, CDH 6.1] Compile errors on tHiveOutput component using CDH 6.1 when all data types are used in schema
  • TBD-10340 [Spark Streaming, CDH 6.1] NoClassDefFoundError on tHiveOutput component
  • TBD-10370 "Hadoop configuration jar not found" when run spark job with jobserver on Windows
  • TBD-10436 Hive component fails with java.lang.NoClassDefFoundError: org/apache/log4j/Logger
  • TBD-10454 [7.3.1] DI job using tHDFSExist works from Studio to RE but not from TMC to RE
  • TBD-10476 [CDH6.1] java.lang.NoSuchMethodError on job with Hive components
  • TBD-10505 Databricks on AWS, cannot output to DBFS when S3 configured
  • TBD-10089 Standardize encoding UI for I/O BD components
  • TBD-10470 Wrong logo for tKinesisInput component
  • TUP-27262 tAzureAdlsGen2Output component fails with class not found error
  • TUP-25961 org.talend.commons.exception.CommonExceptionHandler - java.util.ConcurrentModificationException
  • TUP-26639 Talend Cloud studio Issue -Changes to Context Parameter Names is not reflected on the Connection for Snowflake
  • TUP-26870 Incorrect sort when listing version of Jobs
  • TUP-26958 Test case: possible to remove input / output node
  • TUP-26961 When saving/deleting a test case, it might break the poms / CI
  • TUP-26990 Possible conflict in talend project
  • TUP-26994 Usage data collector: change the way Studio Unique Id is calculated
  • TUP-27000 Talend Salesforce Einstein connector Repository connection issue in Talend 7.3
  • TUP-27003 Should disable the Commit button of Uncommitted files found dialog when project is in MERGING state
  • TUP-27199 DB version of sybase isn't hide for other database on tCreateTable
  • TDI-44066 Illegal argument exception in tSAPBapi name field
  • TDI-44089 Program Z_TLD_BI_INFOPROV not found when moving from 7.1.1 to 7.2.1
  • TDI-44159 Data viewer on tSybaseInput get error in context model with sybase 16 anywhere database
  • TDI-43619 Null Value Treated as in Subjob
  • TDI-44051 tJDBCInput Dynamic Schema does not preserve special characters
  • TDI-44130 UPDATE_OR_INSERT Mode in tDBOutput for MSSQL does not display SQL
  • TDI-43935 NString type for prepared statement in tMSSQLRow component
  • TDI-44185 Authentication Fields missing in tMongoDBBulkLoad
  • TDI-43822 tDataPrepRun Token expiration must be taken into account
  • TDI-44191 Job Deployed to MDM server and using tFileCopy fails with java.lang.ClassNotFoundException: org.talend.FileCopy
  • TDI-44122 Proxy settings not being picked up in tSalesforceBulkExec API v2
  • TDI-43605 tDBConnection to Snowflake exception "Not connected" when API call is made
  • TDI-43612 Problem with retrieving Snowflake tables from Studio
  • TDI-43629 Dynamic schema issue in tSnowflakeOutput Component
  • TDI-43682 Get error when retrieving record types in tNetsuiteInput/tNetsuiteOutput
  • TDI-43752 Snowflake component throw warnings
  • TDI-44114 Snowflake multi statement execution error
  • TDI-43903 7.3 Enhancements to tSnowflakeBulkexec broke existing functionality in the Copy (manual) command
  • TBD-10507 7.3.1 Simple Databricks Delta Lake Job is trying to do a broadcast hash join
  • TBD-10520 Files with commas get truncated by tFileInputDelimited & tFileInputFullRow Databricks / Spark 2.4
  • TDM-8036 The tHMap component giving error in 7.3.1 Studio
  • TDM-8001 Streaming with XML output creates extra tags
  • TDM-8013 Job working in 7.2.1 fails in 7.3.1 with class org.apache.commons.compress.archivers.zip.ZipFile$1 not implementing InputStreamStatistics
  • TDM-8028 Remove dependency on avro-mapred-1.7.7
  • TDM-8031 Studio keeps crashing after opening the tHMap component and running the Job
  • TDM-7667 Flattener: flattening structure that contains element with same label does not generate correct name
  • TDM-7871 Attributes are lost when importing avro schema
  • TDM-7925 Data type is changed to STRING for element with data type NONE after export to avro schema
  • TDM-7964 Problem to parse JSON array having heteregeneous elements
  • TDM-7998 Regression: test run will return error when using &/$ in variable name of get/set variable function
  • TESB-28369 CI Publish To Cloud Error when publishing demorest job to Cloud using CI on Studio
  • TESB-28130 Duplicate dependencies in POM.xml for routes lead to compile issues
  • TESB-28815 tRestClient when called in a DS Job using tRunJob fails to load in the runtime
  • TMC-20647 Publishing large Job to the Cloud always ends up with SocketTimeoutException even if it has been uploaded to Cloud
  • TDQ-18174 Remote DQ project: Fixed Git conflict with some system and technical files
  • TDQ-18322 Support the retrievial of the schema on Sybase SQL anywhere
  • TDQ-18091 tSynonymOutput: Improved the error message on incorrect path parameter
  • TDQ-18383 Fixed the high vulnerability on Log4j dependency
  • TDQ-18444 Fixed CVE issues in Nimbus
  • TUP-26809 Fix: Build job could contain jars from test cases as well. (while it should only contain jars from job)
  • TUP-27077 NoClassDefFoundException when using "independent process to run subjob" and tAzureAdlsGen2Input
  • TUP-26596 Proxy of libraries not working when studio have no internet access
  • TUP-26189 metadata connection with proxy may not select proxy properly
  • TUP-26264 tELTMap generated query has extra symbols generated when more input mapping in component
  • TUP-26156 tCreateTable: change "DBType" and "Property Type" not work
  • TUP-26482 Studio is very slow to build the job(the performance issue)
  • TUP-26212 Share more than one car component to nexus3.19.1 will fail to generate the right index file
  • TUP-26213 Compilation issue after migration to v7.2
  • TUP-26539 High Memory Consumption by Studio with GIT
  • TUP-26793 JDBC Redshift in context mode still asked for jars which is not required
  • TUP-26876 NoClassDefFoundError when I run spark job with JobServer
  • TDI-43810 fix MongoDB issue with option "Create empty element if needed"
  • TDI-44579 [tRedshiftUnload] Encrypt setting is not hidden if file type is Parquet
  • TDM-7969 TDM adds unencrypted passwords to error message
  • TDM-7957 Studio commandLine error on Headless Linux following Git pull
  • TDM-7952 Nested distinct element causes performance issues
  • TDM-7932 Flatten: some value isn't mapped after flatten map
  • TDM-7931 Flatten: will return error when create flatten map from JSON structure
  • TDM-7929 Importer CSV need clean not supported header in Xquery,rriahi
  • TDM-7928 Move "Flattening Map" option at 2nd position in New Map Wizard
  • TDM-7924 merged file path is wrong after thmapfile job when "merge file path" is the same as "output folder"
  • TDM-7894 CSV show sample on element only display one record
  • TDM-7870 importing avro schema is failed for openAPI json
  • TDM-7867 Exclude Commons Collections 3.2.1
  • TDM-7865 Bad initial values and exception on the LoopIndex function dialog
  • TDM-7858 IsPresent updates are not persisted
  • TDM-7855 Exception thrown on drag/drop of looping element where dialog was expected
  • TDM-7840 Variable names in GetVariable/SetVariable produce unfriendly errors
  • TDM-7839 LoopIndex in a distinct NestedContext Simple Loop can not detect the index_of element
  • TDM-7836 Distinct funtion generate a not valid xquery in the context of AgConcat
  • TDM-7835 Distinct function generate NullPointer Exception in the context of root elements
  • TDM-7834 Distinct function generate NullPointer Exception in case of SimpleLoop Having NestedContext
  • TDM-7829 tHMapFile merge functions doesnt not check correctly the folder name
  • TDM-7826 thmapFile merge option doesnt work with Hadoop 3.1
  • TDM-7789 CSV reader should use the optimization done for the CSV writer
  • TDM-7772 Don't include a _osdtTerminator column when importing a CSV
  • TDQ-18135 tDataEncrypt cannot generate a crypto file with context variable
  • TDQ-17954 tMatchIndex, tMatchIndexPredict: parameter "Nodes" and "Index" can not use context mode value
  • TDQ-18220 After migrating from 6.3 to 7.2 the tMatchGroup job has compiler errors
  • TBD-10355 Missing Dataset to RDD method call in a migrated spark job
  • TBD-10005 HDP3.1 Compile error tHiveOutput with partitioning: hiveContext_tHiveOutput_1 can not be resolved
  • TBD-10101 tFileOutputDelimited can not keep the format of date column
  • TBD-10167 Compiler error when run spark job on Databricks with tS3configuration that use context value
  • TBD-10212 [BUG] Avro dependencies cause error in databricks
  • TBD-9674 tHiveOutput append action in spark big data batch job under HDP3.1
  • TBD-9872 byte[] type is written to file incorrectly
  • TBD-9986 user token is printed as plain text in joblog when databrick debug level log is on
  • TBD-10081 Fix wrong release maven url with -SNAPSHOT in artifact id
  • TBD-10108 Date conversion in tExtractJSONFields is not correct
  • TBD-10157 Advanced option is not considered when using tHDFSPut in Standard jobs
  • TBD-10158 Migration task can alter the pattern selected by user
  • TBD-10210 Cannot load component "tFileOutputJSON"
  • TBD-10217 org.apache.parquet cannot be resolved to a type
  • TBD-10297 slf4j logger does not contains error() method
  • TBD-10008 Wrong timestamp in tFileOutputDelimited component
  • TBD-10063 Errors on spark with Yarn Cluster with custom hadoop path on Remote Engines
  • TBD-10251 Fix issues with some characters for hadoop configuration jar
  • TUP-26576 Remove the warning about repository setup even if artifact repository is disabled in TMC
  • TUP-26751 Fix CI issues, due to invalid test case
  • TUP-26165 Fix possible missing jars when build job
  • TUP-26728 Missing spark dependencies when using test cases and fix spark compilation issues
  • TBD-10324 Fix compilation issue with RDD with tMap
  • TBD-10284 Fix issues with custom hadoop configuration with DI jobs and Spark jobs with Yarn-Cluster setup