Databricks dataset (Data Catalog)

Data Catalog displays dataset structure for a cataloged Databricks connection.

This view is displayed by clicking Data Catalog Image of the Data Catalog icon and browsing tables in a Databricks. The top left corner shows the name and type (such as Table) of the cataloged dataset.

Details

Connection
The cataloged data connection.
Schema
The schema for the currently selected dataset. A schema encapsulates metadata for a dataset in a connected data source.
Last updated on
Shows the date and time that the connection was updated. The table view does not show any changes in the data source after the last update.
Shows the date and time that the data asset was updated. Any changes in the data source made after that time will not appear in Data Integrity Suite.

Dataset fields

Field Name
Shows the name for each field in the dataset.
Data Type
Shows the data type for each field in the dataset.
Semantic Type
Shows the semantic type defined for a field. This is empty when no semantic type exists for a field.