SparkJobConfig

Purpose

To specify Hadoop configurations for any Spark job.

Note: By default, RDD data structure will be used for all Spark jobs. To enable DataSet API, set pb.bdq.spark.job.dataset.enable as true.