DAT Integration

Question 1

What is the benefit of Data Integration?

Answer 1

Multiple sources of data builds up a richer picture of the real world.

Question 2

What is a Functional Requirement?

Answer 2

It describes a feature which the solution would have.

Question 3

What is a Non-Functional Requirement?

Answer 3

It describes how the feature itself is going to work.

Question 4

What aspects do Non-Functional requirements consider?

Answer 4

Operational aspects
Revisional aspects
Transitional aspects

Question 5

What is the acronym relating to Governance?

Answer 5

GRC - Governance, Risk Management, Compliance

Question 6

Define Governance

Answer 6

The guidelines and performance goals of an organisation.

Question 7

Define Rules and Policies

Answer 7

Rules set absolute boundaries within which an organisation must operate.
Policies are more broad instructions for how this will be achieved.

Question 8

Define Processes and Practices

Answer 8

Processes (workflows) are maps which guide actions.

Practices (procedures) specify detailed tasks/actions performed as part of the process.

Question 9

What are the steps in a Risk Assessment?

Answer 9

1. Identify risks
2. Characterise what and how of risk
3. Evaluate risk and decide mitigation strategy
4. Record findings and implement mitigation
5. Periodic review

Question 10

What are the two aims of Risk Management?

Answer 10

1. Eliminate risk

2. Reduce to acceptable level, then live with it (with controls) or transfer (eg insurance)

Question 11

What are the types of Risk Control?

Answer 11

Deterrent - Reduce likelihood of attack
Preventative - Protect vulnerabilities
Corrective - Reduce impact of event
Detective - Monitors risk, can trigger preventative/corrective

Question 12

What is Compliance?

Answer 12

Following external rules imposed by the organisation. Includes laws, regulations, codes of conduct and industry best practice.

Question 13

What are the purposes of Data Integration?

Answer 13

Optimise business processes.
Predict new business opportunities
Mitigate business risk, including compliance

Question 14

Define Paradata

Answer 14

Information on where the data came from and how it has changed.

Question 15

What are the types of Virtual Integration?

Answer 15

Query Mediation - Data from multiple systems is queried. Splits into sub-queries for each system and result is integrated data from different systems. Lower resource usage, but slower.

Data Transfer - Data moved or duplicated to a more convenient location, and this new location queried.

Question 16

What are the types of Physical Integration?

Answer 16

Data Migration - Moving data from one system to another.

Streaming - Processing unbounded (incomplete) data.

Question 17

Explain how the ETL process relates to Big Data

Answer 17

Conventional ETL - Data Warehouse approach.

ELT - Optimised process for Big Data

ETLT - Hybrid approach. Can be combined with streaming for in-transfer processing.

Question 18

What are the types of Streaming?

Answer 18

True/Native Streaming - Records processed on arrival.

Micro or Fast Batching - Records grouped into batches. Each batch is processed.

Question 19

What is the difference between Declarative and Compositional Engines?

Answer 19

Declarative - The outcome is outlined, not how to achieve it (eg SQL).

Compositional - Detailed steps to take are provided, rather than the outcome. Order matters.

Question 20

What are common UIs for Data Integration?

Answer 20

Dashboard - Visualises KPIs for a point in time.
Performance Scorecard - Visualises progress towards a goal.
Dynamic - User selects item to display. Interactive.