Pipeline settings

This page is displayed when you choose to edit a pipeline on the Pipelines page.

Pipeline

The pipeline panel contains steps in a pipeline. A new pipeline initially only shows the Original Dataset and Add Step buttons.

• Click the Add Step operator to add transformation step to the pipeline. This button always adds a step at the end of the pipeline.
• You can point at a step already in a pipeline and click the shortcut menu to add, edit, rename, reposition, or delete steps in the pipeline. Should you choose to add a step, you can choose to add it before or after the selected step.
• To quickly add a step between two steps already in a pipeline, point at the connection between the two steps, and click the add step button .
• To view sample data after a step completes its operation, click the step operator in the pipeline. You can always click the Original Dataset operator to view sample data as it initially appears when it is read into the pipeline

Search

You can use search on this page to identify and select columns in the table or to filter rows by data value. In the Search box, choose one of the following options:

• Column—In the adjacent Search box, enter a column name to select a column. Matching columns are displayed as you type the name. Choose a column in the drop-down list to select it. If you are editing a transform, the selection is added to the Columns box.
• Data—In the adjacent Search box, enter data that you want to view in the inspection table. As you type, rows that do not match the search string in any column are filtered from the table.

Sample data

Columns in the table show sample data from dataset fields. Click a heading to select a column. Press the Ctrl key and click another heading to extend the selection. When you add a transformation step to a the pipeline, columns selected in this table initially populate the Columns box in the transformation settings.

The data in the table show the outcome of steps in the pipeline. Click a step in the pipeline to view the sample data after the selected step completes its operation. Click the Original Dataset operator in the pipeline to show the data before it is processed by the pipeline.

Transformation Preview

This option allows you to preview the operation performed by a single step in the pipeline. Select a step in the pipeline, then select this check box to view data before and after it is transformed by the operation. As long as the check box is selected, you can click other steps to in the pipeline to show data before and after different operations. While you edit a step, you can also select this check box and click the Preview button to preview how the operation affects the data.