Data to create and preserve value for organisations

Question 1

Data Engineering

Answer 1

Practice of designing and building systems for collecting, storing and analysing large sets of data.

Question 2

Extraction, Transformation & Loading (ETL)

Answer 2

Three stages in blending data from multiple sources into a destination system, for example a data warehouse.

Question 3

Extraction

Answer 3

Process of harvesting data from source databases. Prior to extraction the data needs to be analysed to understand its content, format and structure - Data Profiling.

Question 4

Transformation

Answer 4

Takes extracted data and changes it into a format suitable for destination database and ultimate intended use. Done using code and rules designed to interrogate the source data before converting it to a new format as per the code instructions.

Question 5

Loading

Answer 5

When the newly cleaned and prepared data is uploaded into the destination database ready for use.

Question 6

Data Warehouse

Answer 6

Store for data that has been loaded into the ETL process. Data will be held in a systematic and logical way ready for further interrogation and analysis by the business intelligence function.

Question 7

Business Intelligence (BI)

Answer 7

Technology driven process of analysing business data to create insightful and actionable information to help improve the operations or products of a business.

Question 8

Data Mining

Answer 8

Important component of BI. The process of uncovering patterns and other valuable information from large sets of data in the data warehouse.

Question 9

Challenges of ETL

Answer 9

Rate of growth
Types and Sources
New Technologies

Question 10

Data Model

Answer 10

Considers data of an organisation in a systematic way. Allows it to be stored and retrieved in an efficient and effective manner.

Question 11

Advantages of Data Modelling

Answer 11

Foundation for handling data
Enforces business rules and helps achieve compliance
Consistency
Quality of data is enhanced

Question 12

Three levels of a data modelling process

Answer 12

Conceptual - Business oriented and practical, considering the business data and its requirements.

Logical - Begins to develop a technical map of rules and data structures, defining how data will be held and used.

Physical - Considers how defined system requirements will be implemented using a specific database management system (DBMS).

Question 13

Data Manipulation

Answer 13

Process of changing data to make it easier to read.

Question 14

Data Analysis

Answer 14

Process of examining, transforming and arranging a given data set in specific ways in order to study its individual parts and extract useful information.

Question 15

Data Strategy

Answer 15

A coherent approach for organising, governing, analysing and deploying an organisation’s information assets.

Question 16

The 4 V’s of Big Data

Answer 16

Volume
Velocity
Variety
Veracity

Question 17

Data Scientists

Answer 17

Individuals with the ability to extract meaning from and interpret data, which requires both tools and methods from statistics and machine learning.