Configuration Files

These tables describe the parameters and the values you need to specify before you run the Global Address Validation job.

Table 1. inputFileConfig
Parameter Description
pb.bdq.input.type Input file type. The values can be: file, TEXT, or ORC.
pb.bdq.inputfile.path The path where you have placed the input file on HDFS. For example, /user/hduser/sampledata/addressing/ input/global/Global_Address.txt
textinputformat.record.delimiter File record delimiter used in the text type input file. For example, LINUX, MACINTOSH, or WINDOWS
pb.bdq.inputformat.field.delimiter Field or column delimiter used in the input file, such as comma (,) or tab.
pb.bdq.inputformat.text.qualifier Text qualifiers, if any, in the columns or fields of the input file.
pb.bdq.inputformat.file.header Comma-separated value of the headers used in the input file.
pb.bdq.inputformat.skip.firstrow If the first row is to be skipped from processing. The values can be True or False, where True indicates skip.
Table 2. addressValidationConfig
Parameter Description
pb.bdq.job.type This is a constant value that defines the job. The value for this job is: AddressValidation.
pb.bdq.job.name Name of the job. Default is AddressValidationSample.
pb.bdq.reference.data The path where you have placed the reference data. For example, {"dataDir":"/home/hduser/ReferenceData/ AddressQuality/GAM", "referenceDataPathLocation": "LocaltoDataNodes"}
pb.bdq.uam.addressvalidation.input.option Json string to define the input configurations, such as, Match Mode, Result Casing, and the Default Country.
pb.bdq.uam.addressvalidation.engine.configurations Json string to define the engine configurations, such as, the Database Path, Country Code and the Process Type.
Table 3. addressValidationConfigHDFSRefData(DataDownloader)
Parameter Description
pb.bdq.job.type This is a constant value that defines the job. The value for this job is: AddressValidation.
pb.bdq.job.name Name of the job. Default is AddressValidationSample.
pb.bdq.reference.data Path of reference data on HDFS and the data downloader path. For example, {"referenceDataPathLocation":"HDFS", "dataDir":"/user/root/ ReferenceData/AddressValidation", "dataDownloader":{"dataDownloader":"HDFS", "localFSRepository":"/opt/PitneyBowes/ ReferenceData/AddressValidation"}}
pb.bdq.uam.addressvalidation.input.option Json string to define the input configurations, such as, Match Mode, Result Casing, and the Default Country.
pb.bdq.uam.addressvalidation.engine.configurations Json string to define the engine configurations, such as, the Database Path, Country Code and the Process Type.
Table 4. addressValidationConfigDistributedCache
Parameter Description
pb.bdq.job.type This is a constant value that defines the job. The value for this job is: AddressValidation.
pb.bdq.job.name Name of the job. Default is AddressValidationSample.
pb.bdq.reference.data Path of the reference data on HDFS and the type of data downloader. For example, {"dataDir":"/home/hduser/ReferenceData/ AddressQuality/GAM", "referenceDataPathLocation":"HDFS", "dataDownloader":{"dataDownloader":"DC"}}
pb.bdq.uam.addressvalidation.input.option Json string to define the input configurations, such as, Match Mode, Result Casing, and the Default Country.
pb.bdq.uam.addressvalidation.engine.configurations Json string to define the engine configurations, such as, the Database Path, Country Code and the Process Type.
Table 5. mapReduceConfig
Specifies the MapReduce configuration parameters
Use this file to customize MapReduce parameters, such as mapreduce.map.memory.mb, mapreduce.reduce.memory.mb and mapreduce.map.speculative, as needed for your job.
Table 6. outputFileConfig
Parameter Description
pb.bdq.output.type Specify if the output is in: file, TEXT, or ORC format.
pb.bdq.outputfile.path The path where you want the output file to be generated on HDFS. For example, /user/hduser/sampledata/addressing/output/global.
pb.bdq.outputformat.field.delimiter Field or column delimiter in the output file, such as comma (,) or tab.
pb.bdq.output.overwrite For a true value, the output folder is overwritten every time job is run.
pb.bdq.outputformat.headerfile.create Specify true, if the output file needs to have a header.
pb.bdq.job.print.counters.console If the counters are printed on console or in a file. True indicates counters are printed on the console
pb.bdq.job.counter.file.path Path and the name of the file to which the counters are to be printed. You need to specify this if value in the pb.bdq.job.print.counters.console is false.