Data Quality Transforms
Pipeline transform settings are configured to add transformation steps in a pipeline. This reference describes the purpose of each transform and its settings that define a transformation step in a pipeline.
Transform | Type | Description |
---|---|---|
Case Field | String | Converts strings in a field into upper, lower, or title case. |
Copy Column | General | Copies a column to one or more new columns. |
Execute Formula | General | Performs operations on values and inserts the result in a new column. |
Filter Column | General | Removes selected columns from a table. |
Filter Row | General | The row filter evaluates whether to include rows depending on a logical expression that evaluates to either true or false. |
Get Substring | String | Returns the substring from the start position to the end position. Index of the first character is 1. |
Pad String | String | Pads the beginning or end of field content with a string to a specified length. The Pad field transform does not change the value of the original string. |
Parse Name | Parsing | This transformation parses personal and business names into their constituent parts, such as given name, surname, and titles and qualifiers. |
Rename Column | General | Renames a column in a pipeline. |
Replace Between | String | Replaces a substring between two specified characters. |
Replace By Position | String | Replaces the substring from the start position to the end position. |
Replace Consecutive Spaces | String | Replaces all instances of two or more consecutive spaces in a string field value with a single space. |
Search and Replace | String | Use Search and Replace in a pipeline to search for strings in columns and replace them with a different string. |
Split Column | General | Splits a column into two new columns. |
Standardize Date | Date | If a data column contains dates in different formats, use the Standardize Date transformation to convert values in all records to a single format. |
Standardize Field | Standardization | The Standardize Field |
Trim String | String | Removes specified characters from the start or end of a string. |
Verify Address | Addressing | The Verify Address transform parses, matches, and formats address data against reference postal data. A confidence level is assigned to each verified record. |