Big Data Platform
Cloud Big Data
Cloud Big Data Platform
Cloud Data Fabric
Real-Time Big Data Platform
Spark Universal modes and environments support
|Spark 2.4.x||Spark 3.0.x||Spark 3.1.x||Spark 3.2.x||Spark 3.3.x||Spark 3.4.x|
|Yarn cluster mode|
|Cloudera Data Engineering|
- Azure Synapse Analytics with Spark Universal 3.2.x and 3.3.x is only supported in Spark Batch Jobs.
- Spark-submit script with Spark Universal 3.3.x is only supported in Spark Batch Jobs.
Spark Universal distributions support
*-site.xmlfiles related to the cluster.
This list of distribution is not exhaustive, you can use Yarn cluster with any other distribution if the Spark version matches, but keep in mind that they have not been officially tested by Talend and thus not guaranteed to work.