Data Quality Transforms

Pipeline transform settings are configured to add transformation steps in a pipeline. This reference describes the purpose of each transform and its settings that define a transformation step in a pipeline.

Transform Type Description
Case Field String Converts strings in a field into upper, lower, or title case.
Copy Column General Copies a column to one or more new columns.
Execute Formula General Performs operations on values and inserts the result in a new column.
Filter Column General Removes selected columns from a table.
Filter Row General The row filter evaluates whether to include rows depending on a logical expression that evaluates to either true or false.
Get Substring String Returns the substring from the start position to the end position. Index of the first character is 1.
Pad String String Pads the beginning or end of field content with a string to a specified length. The Pad field transform does not change the value of the original string.
Parse Name Parsing This transformation parses personal and business names into their constituent parts, such as given name, surname, and titles and qualifiers.
Rename Column General Renames a column in a pipeline.
Replace Between String Replaces a substring between two specified characters.
Replace By Position String Replaces the substring from the start position to the end position.
Replace Consecutive Spaces String Replaces all instances of two or more consecutive spaces in a string field value with a single space.
Search and Replace String Use Search and Replace in a pipeline to search for strings in columns and replace them with a different string.
Split Column General Splits a column into two new columns.
Standardize Date Date If a data column contains dates in different formats, use the Standardize Date transformation to convert values in all records to a single format.
Standardize Field Standardization The Standardize Field
Trim String String Removes specified characters from the start or end of a string.
Verify Address Addressing The Verify Address transform parses, matches, and formats address data against reference postal data. A confidence level is assigned to each verified record.