Metadata Insights

Manage connections in Metadata Insights

To create a new connection while working with Metadata Insights, you have the option to maintain connections outside of Management Console. The Data Sources menu options, added to Metadata Insights, allow you to create, modify, and delete connections.

Multimapping and unions

You can now map a logical model, multiple times, and perform union operations on those mappings. This feature enables you to:
  • Populate an entity in your logical model with data from multiple physical models. These models can be based on similar or distinct connection types.
  • Combine the data (from multiple physical models) by performing union operation on multiple mappings.

For more information, see "Multiple Mapping and Union" section of the Metadata Insights Guide.

Comments and annotations

You can now do real-time collaboration on your Data Profiling Results using the Comments and Annotations feature. You can add comments and tag various sections of the report using this feature.

For more information, see "Collaborating on Data Profiling Results" section of the Metadata Insights Guide.

Fetching random records

You can now fetch random records while running Profiling on your Model or Connection.

For more information, see "Configuring Profile" section of the Metadata Insights Guide.

Detecting malformed records

You can now detect malformed records in your Flat Files while running Profiling. A record is treated as malformed for these conditions:
  • Rows with a fewer fields than the number of defined columns

  • Rows with more fields than the number of defined columns

For more information, see "Table and Column Details in Profiling Results" section of the Metadata Insights Guide.

Semantic profiling rules

You can now detect and analyze semantic types such as credit cards, vehicle identification numbers (VIN), international bank account numbers (IBAN), and Social Security Numbers (SSN), while running a profile. This feature enables you to view a graphical representation of:
  • Validity and invalidity of the detected semantic types

  • Domain distribution of the detected semantic types

For more information, see "Profiling Rules" section of the Metadata Insights Guide.

Outlier detection

You can now detect patterns, values, lengths, and frequencies present in your data that fall outside the range of other observations. These values are categorized as Length Outliers, Frequency Outliers, Text Pattern Outliers, Numeric Outliers, Semantic Type Outliers, or Data Type Outliers.

For more information, see "Table and Column Details in Profiling Results" section of the Metadata Insights Guide.

Custom delimiter in flat file connection

You can now customize the field delimiter when creating a flat file connection.

Select entities to build model store query

The model store entities required for building SQL queries are now provided as a list in the Preview Model Store page. You can select and insert entities, as required, to build queries.

Bulk read in Salesforce

Bulk read option is now enabled in Saleforce connection.