Compares a new data set with a lookup data set stored in ElasticSearch, using tMatchIndex. tMatchIndexPredict outputs unique records and suspect duplicates in separate files.
In the potential duplicates output, each record contains the fields from the source records and the fields from the potentially matching lookup records.
The tMatchIndexPredict component supports Elasticsearch versions up to 6.4.2.
As this component does not support the Elasticsearch authentication, it cannot run on Databricks.
In local mode, Apache Spark 2.4 is supported.
This component is not shipped with your Talend Studio by default. You need to install it using the Feature Manager. For more information, see Installing features using the Feature Manager.