Loading the traffic data - 7.2
Double-click the tPigLoad labeled
traffic to open its Component view.
button next to Edit
schema to open the schema editor.
button three times to add three rows and in the
Column column, rename them as date, street
and traffic, respectively.
Click OK to validate these
In the Mode area, select the Map/Reduce option, as we need the Studio to
connect to a remote Hadoop distribution.
In the Distribution list and the
Version field, select the Hadoop
distribution to be used. In this example, it is Hortonworks Data Platform V1.0.0.
In the Load function list, select the
PigStorage function to read the source
data, as the data is a structured file in human-readable UTF-8
In the NameNode URI and the
Resource Manager fields, enter the
locations of the master node and the Resource Manager of the Hadoop distribution to
be used, respectively. If you are using WebHDFS, the location should be
webhdfs://masternode:portnumber; WebHDFS with SSL is not
In the Input file URI field, enter the
directory where the data about the traffic situation is stored. As explained
earlier, the directory in this example is /user/ychen/tpigmap/date&traffic.
In the Field separator field, enter
; depending on the separator used by
the source data.