Home
Data Observability
Proactively monitor and manage the health of your data. Receive actionable insights through alerts that drive business decisions.
Observers
You can create observers to keep a watch on your data assets and take timely measures in case of data anomalies. The observer monitors your selected data assets and provides alerts based on the selected observer rules.
Manage Observers
You can manage your observers on the Observers page.
Create an Observer
You can create multiple observers for a single data connection, but you cannot use the same assets across different observers. You must set up a successful data connection before creating an observer. To create a data connection, refer to DISuite/Observability/data-connections/Creating_Snowflake_Data_Connection.html.
Observer Rules
Observations profile your data on a regular cadence. It observes and monitors your data to identify anomalies. Based on your selected observations, you will receive alerts for identified anomalies. You can use observer rules to generate trends that can help you to identify business impacts and take prompt actions.
Data Drift Rule Configuration
You can track a set of statistics for Numeric and Textual data such as Cardinality (number of distinct values), min/max values, min/max length, number of empty/blank values, new values found, and so on. The unexpected changes in the historical trends of any of these statistics can impact overall decision-making. Data drift configuration generates alerts for unexpected changes in the selected statistics. The alerts will be generated if the value of the selected statistics increases or decreases than its expected value.
Confidence-based alerts

Welcome
The Precisely Data Integrity Suite is designed to deliver trusted data with accuracy, consistency, and context – built on the core capabilities of data integration, data quality, data governance, location intelligence, and data enrichment.
Data Integration
Replicate data from mainframe, IBM i, and relational databases to cloud analytics platforms.
Data Observability
Proactively monitor and manage the health of your data. Receive actionable insights through alerts that drive business decisions.
- Observe Data Assets
  Observing your data assets allows you to take actions based on the alerts received. Alerts are provided after successful scheduled runs. The trends generated provide alerts about data anomalies. You can observe data assets only once and cannot use them again for another observer. Before you create an observer, identify your data source and set up a data connection. Scheduling is mandatory for creating an observer.
- Profile Data Assets
  Learn about how to perform end-to-end Data Profiling. It provides a complete workflow of Data Profiling.
- Data Connections
  Your organization may have diverse data sources that you want to process. Use Data Connection to configure these data sources and connect them to the Data Integrity Suite.
- Data Profiles
  Data profiling scans your data records from all the data sources - irrespective of their volume and complexity. It identifies problems related to correctness, completeness, and validity in the data, and suggests actions to fix the issues. Thus, it improves the quality and utility of your data with very little manual effort.
- Observers
  You can create observers to keep a watch on your data assets and take timely measures in case of data anomalies. The observer monitors your selected data assets and provides alerts based on the selected observer rules.
  - Manage Observers
    You can manage your observers on the Observers page.
    - Create an Observer
      You can create multiple observers for a single data connection, but you cannot use the same assets across different observers. You must set up a successful data connection before creating an observer. To create a data connection, refer to DISuite/Observability/data-connections/Creating_Snowflake_Data_Connection.html.
      - Observer Rules
        Observations profile your data on a regular cadence. It observes and monitors your data to identify anomalies. Based on your selected observations, you will receive alerts for identified anomalies. You can use observer rules to generate trends that can help you to identify business impacts and take prompt actions.
        Volume Rule Configuration
        The data volume is defined by the number of rows in the data. The unexpected changes—addition or deletion of rows in the data, can impact the overall decision-making. Volume rule configuration helps to generate alerts for these unexpected changes.
        Data Drift Rule Configuration
        You can track a set of statistics for Numeric and Textual data such as Cardinality (number of distinct values), min/max values, min/max length, number of empty/blank values, new values found, and so on. The unexpected changes in the historical trends of any of these statistics can impact overall decision-making. Data drift configuration generates alerts for unexpected changes in the selected statistics. The alerts will be generated if the value of the selected statistics increases or decreases than its expected value.
        Confidence-based alerts
        Data Drift Statistics
    - Edit an Observer
    - Delete an Observer
  - Search Observers
    You can search for a specific observer.
  - Reference
    This section provides reference information for Observers.
- Alerts
  Alerts are generated as per the observer rules and the assets that are selected during observer creation. The alerts are either critical level or warning level. This level is set during the observer rule configuration.
Data Governance
Manage data policy and processes with greater insight into your data's meaning, lineage, and impact.
Data Quality
Assure reliability, consistency, and accuracy data from different sources to deliver value to employees and customers.
Administration
Manage your subscription, your users and their roles, and other system tasks.

Confidence-based alerts

Confidence is a measure of how certain we are about the detected change in selected statistics of data. Setting the range of confidence will alert you if the detected change is within the set confidence level.

Important:

The scale can only be set from 20% to 100%.
The range below 20% is a very low confidence level and generates a lot of noise in your alerts.

For example, the confidence-based alerts set between 60% and 80% will send alerts only when the confidence of change in selected statistics of data is detected between 60% and 80%. The alert will be a critical alert when the change is detected for a confidence level above 80%.

Note:

The alerts will not be generated for lower values if the percentage overlap, the alerts will be generated only for values beyond the higher range.
- For example, alerts will not be generated below 80% for the range selected as 80% to 80%. Alerts will be generated only above 80%.
It will set to a default range if your range overlaps at 100%.
- For example, if you set the range as 100% to 100%, the range will revert to default range as 60% to 80%.

To set confidence-based alerts:

Select the statistics for the data types that you want to receive alerts. For details, refer to Data Drift Statistics
- Unique value count for all data types
- Numeric Data
- Textual Data
  - Minimum length
  - Maximum length
- Detail Drift
  - Distribution of value count
Perform any of the following:
- Drag the lower value slider and higher value slider to set a range of percentages.
- Enter the lower and higher value in the text box to set the range.
Click Save to save the changes.