Reuses the connection configuration to S3 in the same Job. The Spark cluster to be used reads this configuration to eventually connect to S3.
Only one tS3Configuration component is allowed per Job.
For more technologies supported by Talend, see Talend components.
Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks:
-
Spark Batch: see tS3Configuration properties for Apache Spark Batch.
The component in this framework is available in all Talend products with Big Data and Talend Data Fabric.
-
Spark Streaming: see tS3Configuration properties for Apache Spark Streaming.
This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.