Welcome
Explore Data Integration. Connect different data sources and various stages used in Data Integration process.
Introduction
Learn about data management architecture and the star schema data warehouse design.
Connecting to Data Sources and Data Warehouses
Connect to different types of data sources.
Populating the Data Warehouse
Prepare your data for warehouse. Populate Time Dimension table, Dimension table, Fact table. Add time stamp to records in a Data Warehouse.
Updating the Data Warehouse
Define a Data Warehouse update schedule. Update a fact table. Use Global and Local cache for queries.
Accessing Stages Through Enterprise Designer
Access different stages through Enterprise Designer.
Configurations
Configure Oracle LogMiner, and HDFS connection for HA Cluster.
Optimizing Performance
Improve performance by determining an optimum fetch size. Learn about best practices for connecting to HDFS 3.x and Hive 2.1.1.

Compression Support for Hadoop

Spectrum Technology Platform supports the compression formats gzip (.gz) and bzip2 (.bz2) on Hadoop. While using the Read from File and Write to File stages with an HDFS connection, include the extension corresponding to the required compression format (.gz or .bz2) in the File name field. The file is decompressed or compressed based on the specified compression extension. Spectrum Technology Platform handles the compression and decompression of the files.