Home
Data Quality
Assure reliability, consistency, and accuracy data from different sources to deliver value to employees and customers.
Data Quality pipelines
Pipelines define and apply transforms to data loaded by a dataset.
How to
Create a pipeline on the Pipelines page
Create a pipeline to import and transform data from a dataset.

Welcome
The Precisely Data Integrity Suite is designed to deliver trusted data with accuracy, consistency, and context – built on the core capabilities of data integration, data quality, data governance, location intelligence, and data enrichment.
Data Integration
Replicate data from mainframe, IBM i, and relational databases to cloud analytics platforms.
Data Observability
Proactively monitor and manage the health of your data. Receive actionable insights through alerts that drive business decisions.
Data Governance
Manage data policy and processes with greater insight into your data's meaning, lineage, and impact.
Data Quality
Assure reliability, consistency, and accuracy data from different sources to deliver value to employees and customers.
- Data Quality Catalogs
  The Data Integrity Suite Data Catalog lets users discover and understand connected data sources.
- Data Quality datasets
  A dataset defines a data source and characterizes data to be loaded and transformed by pipelines.
- Data Quality pipelines
  Pipelines define and apply transforms to data loaded by a dataset.
  - About Data Quality pipelines
  - Using Data Quality pipelines
  - How to
    - Create a pipeline on the Pipelines page
      Create a pipeline to import and transform data from a dataset.
    - Edit a pipeline
      Edit a pipeline to view, add, or edit transforms that it applies to uploaded data.
    - Add steps to a pipeline
      Transforms are configured to form transformation steps in a pipeline. These steps change the format, structure, or values of data uploaded by a dataset. A pipeline may perform any number of transforms in the order determined by the order of the transformation steps.
    - Edit a step in a pipeline
      Edit a transform settings for a step in a pipeline to change its behavior. You may also reorder or delete transformation steps in a pipeline.
    - Preview a transformation step in pipeline
      You can quickly preview the outcome of any step in a transformation without opening the transformation operator settings.
    - Rename a step in pipeline
      This procedure describes how to quickly rename a step in a pipeline without editing the step.
    - Filter rows that match data in a pipeline
      While editing a pipeline, you can filter out rows in the inspection table that do not contain specified data.
    - Rename a pipeline
      You can rename a pipeline on the Pipelines page.
    - Duplicate a pipeline
      You can duplicate an existing pipeline to use it for a new pipeline. A duplicate pipeline initially consists of the same dataset and transformation steps as the original pipeline. Configurations are not copied.
    - Delete a pipeline
      You can delete a pipeline from the Pipelines page.
    - Select columns in a pipeline step
      There are several methods using the mouse or keyboard to select columns for a pipeline step. When you edit settings for a transform step, use any of these methods to add columns to the Columns box.
    - Delete a transform step from a pipeline
      Use the Delete command on the transform step shortcut menu to delete a transform step from a pipeline.
  - Reference
    This section contains reference information for pipeline pages in Precisely DQ.
- Data Quality jobs
- Data Connections
  Connecting to data is the first step in processing, analyzing, and storing information.
Administration
Manage your subscription, your users and their roles, and other system tasks.

Create a pipeline on the Pipelines page

Create a pipeline to import and transform data from a dataset.

Before you perform this procedure, the sample dataset used to create the pipeline must exist. The sample dataset should include representative data upon which to perform transformations.

This procedure describes how to select the dataset while you create a pipeline on the Pipelines page. To create a pipeline for a selected dataset on the Datasets page, see Create a pipeline from a dataset.

On the Precisely Quality page, expand the sidebar menu, and click Pipelines .
Click + Create Pipeline.
In the General step, enter a name and description.
1. In the Name box, enter a name for the pipeline.
  A pipeline name must start with a letter. It can contain alphanumeric characters, the underscore (-) and the dash (-). It cannot contain spaces or other non-alphanumeric characters.
2. Optional: In the Description box, you can describe the purpose of the pipeline.
3. Click Next.
In the Dataset step, select the sample dataset that you want to use to create the pipeline. Then click Next.
In the Source step, review column names, data types, and semantic types, then click Next.
The Data Preview step shows sample records from the source dataset.
Click Save to create the new pipeline.

Completing this procedure opens the pipeline page. On this page you can view sample data as you add transformation steps to the pipeline. The pipeline page consists of three panes. The upper pane shows transformation steps in the pipeline. The table under that shows the state of the data before or after a transformation step. A third pane expands from the side when you add or edit a transformation step. It exposes options that you can edit for a selected transform.

In the pipeline pane, you can click the Add Step button Image of the Add Step button

Image of the Add Step button

to add transform steps to the pipeline.