Data Integrity modules

These automation tools modules run Data Integrity tests that can verify the fidelity of your data sets:

• Complete Row by Row Comparison module runs reconciliation tests that give you an in-depth comparison between two data sets.

• Complete Tree Comparison module runs reconciliation tests that compare JSON and XML files.

• Defined File Tests against Caching Database module performs predefined tests on tables that contain information from files.

• DI DB Expert Module handles your database statements through a single module.

• File Load into Caching Database module loads the content of a text file into an SQLite database.

• JSON to JSON Comparison module compares large JSON files.

• JSON/XML File load into Caching Database module loads data from JSON or XML files into an SQLite database.

• Load Data into Caching Database from Customization module to load data from a custom data reader into an SQLite database .

• Load Data into Database module loads a data set from a source database into a target database.

• Metadata Comparison module runs reconciliation tests that compare two metadata definitions against each other.

Reconciliation tests

Reconciliation tests perform in-depth comparisons of individual cells or nodes between a source and a target dataset. While aggregated tests are faster, reconciliation tests are very precise and can test each element of your source and target. They provide you with a detailed report that identifies any differences in two datasets. However, depending on the size of your datasets, this comparison can be time consuming.

The following data integrity modules can run reconciliations tests:

• The Complete Row by Row Comparison module

• The Complete Tree Comparison module

• The Metadata Comparison module