Why do I get an error when profiling Teradata using the Soundex Frequency Statistics indicator?

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Open Studio for Data Quality
Talend Data Fabric
Talend Real-Time Big Data Platform
Talend Open Studio for MDM
Talend Data Services Platform
Talend MDM Platform
Talend Big Data Platform
Talend Data Management Platform
task
Data Quality and Preparation > Profiling data
EnrichPlatform
Talend Studio

Teradata error: "Invalid Input: only Latin letters allowed"

You will get an error message when using Talend Studio to profile the Teradata database using the Soundex Frequency Table indicator because your input is invalid.

From the Profiling perspective of Talend Studio, try to profile a column in Teradata, first_name for example, using the Soundex Frequency Table indicator. Run the column analysis with the SQL engine. The analysis runs successfully.

Try to drill down data on the result page: in the Frequency Statistics table in the Analysis Results view, right-click a row and select View Rows. You will get an error in the SQL Editor about the generated SQL query.

[Error 5583] Invalid Input: only Latin letters allowed.

This limitation is due to Teradata soundex implementation. The Teradata database requires that a character string or expression that contains a surname is evaluated in simple Latin characters.

A simple Latin character is one that does not have diacritical marks such as tilde (~) or acute accent (´). There are 26 uppercase simple Latin characters and 26 lowercase simple Latin characters. Even a simple call to SOUNDEX ('Sébastien') cannot be executed on Teradata. Therefore, it is not possible to drill down into all rows that sounds like 'Sébastien'.