Data quality involves reliability and effectiveness of data, particularly in a data warehouse. DQ suite involves the process of verifying the reliability and effectiveness of data. Typically this involves updating it, standardizing it, and de-duplicating records to create a single view of the data, even even if it is stored in multiple disparate systems.
What is Data Verification?
Data Verification is a process wherein the data is checked for accuracy and inconsistencies after data migration is done. The DQ suite helps to determine whether data was accurately translated, is complete, and supports processes in the new system.
What is Data Validation?
Data Validation is the process of ensuring that a program operates on clean, correct and useful data. It uses routines, often called validation rules or check routines that check for correctness, meaningfulness, and security of data that are input to the system. Data that does not conform to these rules will negatively affect business process execution.
Data Discovery Features
Data Discovery provides the ability to automatically scan and identify information assets within an organization. The DPS Product Suite offers the following list of features to aid the Data Discovery Process
#
Requirement
Available
Comments
1
Create a Metadata Repository without significant manual involvement
Yes
2
Scan all structured databases of interest
Yes
See database types supported
3
Scan all unstructured data of interest
Yes
See content formats supported
4
Scan all semi-structured data
No
In development (beta). See supported formats
5
Provide web access to metadata repository
Yes
6
Profile the structured data
Yes
10 types of profiling is supported. See details
7
Automatically detect data quality problems in structured data
Yes
8
Create a data dictionary and glossary for critical business data
Yes
Requires some degree of manual input
9
Continuously monitor the metadata environment for changes
Yes
10
Create metadata reports and profile reports on demand
Yes
Based on customer requests, the Global IDs Product Roadmap also includes some new features that have been listed below
It can accomplish the above tasks, with a minimum of manual involvement
It can scale to extremely complex environments (enterprise or global levels)
It can meet these requirements in systematic and repeatable ways