Use the procedure below to add and configure a tUniqRow component that will be used to identify duplicate email addresses.
Procedure
-
Next the tFileInputDelimited component, add a new
addComponent {} function and its sub-function
setComponentDefinition {} to add the
tUniqRow component.
addComponent { setComponentDefinition { TYPE: "tUniqRow", NAME: "tUniqRow_1", POSITION: 416, 192 } }
-
Next to the setComponentDefinition {} function, enter
the setSettings {} function to define the deduplication
process and label the component.
setSettings { UNIQUE_KEY { SCHEMA_COLUMN : "email", KEY_ATTRIBUTE : "true" }, LABEL : "deduplicate" }
-
Next to the setSettings {} function, enter two
addSchema {} functions to define the schemas for the
output flows, one for the unique emails addresses and the other for the
duplicates.
addSchema { NAME: "UNIQUE", CONNECTOR: "UNIQUE" addColumn { NAME: "email", TYPE: "id_String" } } addSchema { NAME: "DUPLICATE", CONNECTOR: "DUPLICATE" addColumn { NAME: "email", TYPE: "id_String" } }