Component-specific settings for tFileInputParquet

The following table describes the Job script functions and parameters that you can define in the setSettings {} function of the component.

Function/parameter	Description	Mandatory?
DEFINE_STORAGE_ CONFIGURATION	Set this parameter to `true` to provide the configuration information for the connection to the target file system such as HDFS. If set this parameter to `false`, the target file system is the local system. Note that the configuration component to be used must be present in the same Job. For example, if a tHDFSConfiguration component is present in the Job, you can select it to write the result in the specified HDFS system. By default, this parameter is set to `true`. Information noteNote: This parameter works only in a Spark Batch or Spark Streaming Job.	Yes for a Spark Batch/Streaming Job
FILENAME	Type in the path pointing to the data to be used in the file system.	Yes

Function/parameter

Description

Mandatory?

DEFINE_STORAGE_ CONFIGURATION

Set this parameter to true to provide the configuration information for the connection to the target file system such as HDFS.

If set this parameter to false, the target file system is the local system.

Note that the configuration component to be used must be present in the same Job.

For example, if a tHDFSConfiguration component is present in the Job, you can select it to write the result in the specified HDFS system.

By default, this parameter is set to true.

Note:

This parameter works only in a Spark Batch or Spark Streaming Job.

Yes for a Spark Batch/Streaming Job

FILENAME

Type in the path pointing to the data to be used in the file system.

Yes

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!