Performance Tuning Recommendations
The sections below combine many tips that might help you improve the performance of various data quality stages. The recommendations listed will help you achieve performance for Advanced Matching, Data Normalization, and Universal Name stages.
- Number of records: Analyzing and filtering the records before sending them for processing improves the performance, as an increase in the number of records leads to a proportional increase in time.
- Cluster: The performance increases when the processing is performed in clustered mode.
Performance recommendations for Advanced Matching stages
Stage | Performance recommendations |
---|---|
Intraflow Match |
|
Interflow Match |
|
Transactional Match |
This stage is fast as compared to the Intraflow Match stage; however, it is recommended to choose the relevant stage according to your requirements as both serve two different purposes. Moreover, unlike Intraflow Match, the group size does not affect the performance as the suspect is matched only once with the candidate. |
Best of Breed Duplicate Synchronization Filter |
Condition: Minimizing the conditions improves the performance, as an increased number of conditions leads to more processing time. |
Match Key Generator |
Runtime: An increase in runtime instances increases performance. |
Candidate Finder | The recommendations below improves the performance for
Search Index.
Note: Search index performance depends on various factors,
and the points mentioned above are just an indication of how
the performance can vary based on the configuration applied.
It is essential to understand the end-user scenario, which
is the key driver for deciding on the choice of hardware,
index settings, cluster setup, and other configuration
parameters to achieve optimal performance. |
Performance recommendation for Data Normalization stages
Stage | Performance recommendation |
---|---|
Table Lookup Advanced Transformer Open Parser |
Runtime: An increase in runtime instances increases performance. |
Performance recommendation for Universal Name stage
Stage | Performance recommendation |
---|---|
Name Parser |
Runtime: An increase in runtime instances increases performance. |