Data Integrity modules

These automation tools modules run Data Integrity tests that can verify the fidelity of your data sets. Data Integrity modules are the following:

• The Complete Row by Row Comparison module runs reconciliation tests that give you an in-depth comparison between two data sets.

• The Complete Tree Comparison module runs reconciliation tests that compare JSON and XML files.

• The Defined File Tests against Caching Database module performs predefined tests on tables that contain information from files.

• The DI DB Expert Module handles your database statements through a single module.

• The File Load into Caching Database module loads the content of a text file into an SQLite database.

• The JSON to JSON Comparison module compares large JSON files.

• The JSON/XML File load into Caching Database module loads data from JSON or XML files into an SQLite database.

• The Load Data into Caching Database from Customization module to load data from a custom data reader into an SQLite database .

• The Load Data into Database module loads a data set from a source database into a target database.

• The Metadata Comparison module runs reconciliation tests that compare two metadata definitions against each other.

Reconciliation tests

Reconciliation tests perform in-depth comparisons of individual cells or nodes between a source and a target data set. While aggregated tests are faster, reconciliation tests are very precise and can test each element of your source and target. They provide you with a detailed report that identifies any differences in two data sets. However, depending on the size of your data sets, this comparison can be time consuming.

The following Data Integrity modules can run reconciliations tests:

• The Complete Row by Row Comparison module

• The Complete Tree Comparison module

• The Metadata Comparison module