Character Analysis

This rule identifies patterns, scripts, and character categories (Casing, Spacing, Character Data Types, Special Characters) in string fields. To configure special characters when creating a profile, click the Configure icon and add or delete special characters from the pre-populated list.
  • To add a new special character, type the character in the Special Character field and press Enter.
  • To remove an existing special character, click .
  • To set the list of special characters to the default list, click Reset.
When your rule configuration is completed, click Save to save your selection.
Note:
  • You can add unique characters that are not already present.
  • You can add only single characters, multiple characters are not allowed. For example, \, y are allowed and $%, xya are not allowed.
  • The special characters are not identified in the data if you clear the list and save.

When you enable this rule, you will get this information for the string fields in your data:

Table 1. Information for string field for character analysis rule
Label Description
Frequency The most-used phrases in the selected string column.
Scripts Distribution The different scripts identified in the selected string column and their count.
String Lengths The distribution of string lengths in the selected string column.
Character Categories The type of characters in the selected column, such as letter, punctuation, and number.
Text Patterns Converts data in the string column to pattern and displays the pattern, its count, and percentage occurrence. The pattern is determined using this rule:
  • Latin upper-case characters are replaced with "A".
  • Latin lower-case characters are replaced with "a".
  • Digits are replaced with "9".
  • Control characters are replaced with .