Data Quality

The Filter stage retains or removes records from a group of records based on the rules you specify.

This stage creates a match key for each record. A match key is a non-unique key shared by like records that identify records as potential duplicates. The match key facilitates the matching process by only comparing records that contain the same match key.

The Write to Search Index stage enables you to create a full-text index based on the data coming into the stage. Having this data in a dedicated search index results in quicker response time when you conduct searches against the index from other Spectrum Technology Platform stages.

The Intraflow Match stage locates matches between similar data records within a single input stream. You can create hierarchical rules based on any fields that have been defined or created in other stages of the dataflow.

The Best of Breed stage consolidates duplicate records by selecting the best data in a duplicate record collection and creating a new consolidated record using the best data.