Home
Data Integration
Replicate data from mainframe, IBM i, and relational databases to cloud analytics platforms.
Setup the Environment
Connect simplifies bulk data transfers and helps populate the data lake by automatically creating the target schemas and mapping fields. Use the streaming framework to create pipelines that replicate data changes from a source system to Apache Kafka distributed messaging systems.
Prerequisites

Welcome
The Precisely Data Integrity Suite is designed to deliver trusted data with accuracy, consistency, and context – built on the core capabilities of data integration, data quality, data governance, location intelligence, and data enrichment.
Data Integration
Replicate data from mainframe, IBM i, and relational databases to cloud analytics platforms.
- Setup the Environment
  Connect simplifies bulk data transfers and helps populate the data lake by automatically creating the target schemas and mapping fields. Use the streaming framework to create pipelines that replicate data changes from a source system to Apache Kafka distributed messaging systems.
- Configure Data Integration components
  Configure your data integration components to replicate your data within your environment.
- Manage Replication Agent
  The agent page shows various health statuses, last check-in, and other information known to the system.
- Manage Runtime Engine
  The runtime engine page shows information related to engine. You can add, edit, or remove runtime engine.
- Manage Replication Data Connections
  Use data connections to access both data source and target systems. Connections configured to access Apache Kafka are only valid for these targets and cannot be used to connect to data sources.
- Manage Replication Metabase
  A collection of internal objects that define and enable data distribution within the Data Integration components. A source data connection is required to configure a metabase.
- Manage Replication Pipeline
  The replication pipelines displayed on the Replication Pipelines page shows the current health/status of all pipelines that have been finalized/deployed (not sure what wording we want to use). It also shows whether each pipeline has any edits in progress, and whether or not those edits are staged. It will also show pipelines that have not been finalized yet (which do not yet have a health/status) and those that are marked for deletion.
- Manage On-prem Components
- Monitor Multiple Replication Projects
  Replication projects run in your test or production environment to capture data changes on sources, retrieve the changed data, and apply target stream. See Manage Replication Pipeline.
- Monitor Replication Pipelines
  Replication pipelines used in a replication project can copy, synchronize, and replicate your data from source to a target stream. This screen allows the user to monitor details of a selected replication pipeline and perform certain actions based on the component. When you click the selected replication pipeline, additional details such as health of the pipeline, the current phase of the pipeline, required actions, and the statuses of the processes are displayed. For example, if the overall health status is Stopped ( ) that indicates all processes and replication pipelines for the project are stopped. This includes kernel processes on all runtime engines and replication processes for all replication pipelines. Capture can still be enabled. Staged but not active projects will appear stopped. You can also perform actions on the components. For example, by clicking () next to replication pipeline, you can select an item from the context menu.
- Troubleshooting Data Integration
  Troubleshooting discusses some common problems you may encounter and suggest actions that will solve them.
Data Observability
Proactively monitor and manage the health of your data. Receive actionable insights through alerts that drive business decisions.
Data Governance
Manage data policy and processes with greater insight into your data's meaning, lineage, and impact.
Data Quality
Assure reliability, consistency, and accuracy data from different sources to deliver value to employees and customers.
Administration
Manage your subscription, your users and their roles, and other system tasks.

Prerequisites

The key components for your environment are agent and runtime server. Before you install your agent and runtime server, there are some prerequisites needed.

The following components need to be installed prior to using Data Integration:

You may need additional drivers in a mainframe environment. For more information, see Additional Components for IBM i and IBM Z.
Docker - Docker is an open platform for developing, shipping, and running applications. For information on installing docker, see https://docs.docker.com/get-docker/.
Docker-compose is needed on all platforms; however, on Linux, it may be separate install. For Linux, use docker-compose, see https://docs.docker.com/compose/
Note: On Windows, docker comes pre-installed as part of Docker desktop.
Java 8 is required for the runtime engine.