tUniservBTGeneric Standard properties

Schema and Edit schema

A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. When you create a Spark Job, avoid the reserved word line when naming the fields.

Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

• View schema: choose this option to view the schema only.

• Change to built-in property: choose this option to change the schema to Built-in for local changes.

• Update repository connection: choose this option to change the schema stored in the repository and decide whether to propagate the changes to all the Jobs upon completion.

  If you just want to propagate the changes to the current Job, you can select No upon completion and choose this schema metadata again in the Repository Content window.

Click Sync columns to retrieve the schema from the previous component connected in the Job.

Click Retrieve Schema to create a schema for the components that matches the input and output fields in the DQ Batch Suite job.

Host name

Host on which the Master Server of DQ Batch Suite runs, between double quotation marks.

Port

Port number on which the DQ Batch Suite server runs, between double quotation marks.

Client Server

Name of the client server of the DQ Batch Suite, between double quotation marks.

User name

User name for the registration on the DQ Batch Suite server. The stated user must have the right to execute the DQ Batch Suite job.

Password

Password of the stated user.

To enter the password, click the [...] button next to the password field, enter the password in double quotes in the pop-up dialog box, and click OK to save the settings.

Job directory

Directory in the DQ Batch Suite, in which the Job is saved.

Job name

Name of the DQ Batch Suite job that is to be executed.

Job file path

File path under which the DQ Batch Suite job to be executed will be saved. The path to the file must be stated absolutely.

Temporary directory

Directory in which the temporary files created during job execution are to be saved.

Input Parameters

These parameters must correspond to the parameters in the function Input (tab "Format") of the DQ Batch Suite job.

File location: State whether the input file is saved in the pool or the local Job directory.

Directory: If the File location = Pool, it means the directory is related to the pool directory. If the File location = Job, "input" must be specified here.

File name: Name of the delimiter file which has been generated by tUniservBTGeneric and is to be transferred to the DQ Batch Suite. The file name must correspond to the file name which is defined in the function Input of the DQ Batch Suite job.

No. of header rec.: 0 = no header record, 1 = header record in the input file.

Field separator: Field separator defined in the function Input of the DQ Batch Suite job.

Output Parameters

These parameters must correspond to the parameters in the function Output (tab "Format") of the DQ Batch Suite job.

File location: State whether the output file is to be saved in the pool or the local Job directory.

Directory: If the File location = Pool, it means the directory is related to the pool directory. If the File location = Job, "output" must be specified here.

File name: Name of the output file in the delimiter format, which is created by the DQ Batch Suite job. The file name must correspond to the file name defined in the function Output of the DQ Batch Suite job.

No. of header rec.: 0 = no header record, 1 = header record in the output file.

Field separator: Field separator defined in the function Output of the DQ Batch Suite job.

Global Variables

ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl+Space to access the variable list and choose the variable to use from it.

For more information about variables, see Using contexts and variables.

Usage rule

tUniservBTGeneric sends data to DQ Batch Suite and starts the specified DQ Batch Suite job. When the execution is finished, the output data of the Job is returned to Data Quality Service Hub Studio for further processing.

Limitation

To use tUniservBTGeneric, the Uniserv software DQ Batch Suite must be installed.