Chapter 44 Flashcards
1
Q
What is Data profiling
A
Data profiling is a process which involves gathering of information about column through execution of certain queries with intention to identify erroneous records. It should also provide us a detailed view about the quality of data.
2
Q
What is standardization
A
Standardization process involves the consistency of number and types of columns, date formats, and storing conventions in database
3
Q
What we identify during data profiling
A
- Total number of values in a column
- Number of distinct values in a column
- Domain of a column
- Values out of domain of a column
- Validation of business rules
4
Q
How much time we should perform data profiling for the effectiveness of transformation
A
Twice. Once before transformation and once after transformation
5
Q
What function is used for + or - in dates
A
CAST function
6
Q
What is golden copy
A
original copy
