Hadoop 3x support with Spectrum

With this release, these stages will support read and write from HDFS 3.x and Hive 2.1.1.
  • Read from Hive File
  • Read from Hadoop Sequence
  • Write to Hive File
  • Write to Hadoop Sequence
  • Read from DB
  • Write to DB
  • Load to Hive
The support includes:
  • Connectivity to HDFS and Hive from Spectrum on Windows
  • Support and connectivity to Hadoop 3.x from Spectrum with high availability
  • Kerberos-enabled HDFS connectivity through Windows
  • Support and connectivity to Hive version 2.1.1 from Spectrum with high availability
  • Support of Datetime data type in the Parquet file format
  • Support to Read and Write from Hive DB (JDBC) via Model Store connection

For best practices and configuration information, see the documentation of the respective stage in the Spectrum Enterprise Designer Guide.