01 - Explore Core Data Concepts

Question 1

What is Data

Answer 1

Collection of facts, numbers, descriptions, objects, stored in a structured, semi-structured, unstructured way

Question 2

Online Transactional Processing (OLTP)

Answer 2

Data is stored one transaction at a time

Question 3

Online Analytical Processing (OLAP)

Answer 3

Data is periodically loaded, aggregated and stored in a cube

Question 4

Transactional Workloads

Answer 4

Atomicity

Consistency

Isolation

Durability

Question 5

What is Atomicity

Answer 5

Each transaction is treated as a single unit, which success completely or fails completely

Question 6

What is Consistency

Answer 6

Transactions can only take the data in the database from one valid state to another

Question 7

What is Isolcation

Answer 7

Concurrent execution of transactions leave the database in the same state

Question 8

What is Durability

Answer 8

Once a transaction has been committed, it will remain committed

Question 9

What are Analytical Workloads

Answer 9

Used for data analysis and decision making

• Summaries
• Trends
• Business information

Question 10

What is Data Processing

Answer 10

Convert Raw Data to Meaningful Information

Question 11

What is Batch Processing

Answer 11

Data elements are collected into a group. Whole group is then processed at a future time as a batch.

Question 12

What is Stream Processing

Answer 12

Each new piece of data is processed when it arrives

Question 13

Online Transaction Processing (OLTP)

Answer 13

For example order systems that perform many small transactional updates

Question 14

Data Warehousing

Answer 14

Large amount of

fill in

Question 15

Tables

Answer 15

Data is stored in a table

Table consists of rows and columns

All rows have same # of columns

Each column is defined by a datatype

Question 16

Entity

Answer 16

Representation of an item which can be physical (such as a customer or a product), or virtual (such as an order).

Connected by relations

fill in

Question 17

What is Normalization

Answer 17

Data is normalized to

Reduce storage
Avoid data duplication
Improve data quality

Question 18

Normalized database schema

Answer 18

Primary Key and Foreign keys are used to define relationships

No data duplication exists (other than key values in 3rd Normal Form (3NF))

Data is retrieved by joining tables together in a query

Question 19

Relational Database

Answer 19

Type of DB that uses the relational data model

Question 20

SQL

Answer 20

Structured Query Language

Question 21

Index

Answer 21

Optimizes search queries for faster data retrieval

Reduces the amount of data pages that need to be read to retrieve the data in an SQL Statement

Data is retrieved by joining tables together in a query

Question 22

View

Answer 22

View is a virtual table based on the result set of query

Views are created to simplify the query

Combine relational data into a single pane view

Restrict access to table while allowing users to access non-confidential data

Question 23

Non-relational collections can have

Answer 23

Multiple entities in the same collection or container with different fields

Have a different, non-tabular schema

Are often defined by labeling each field with the name it represents

Question 24

What is semi-structured data

Answer 24

Data structure defined within the actual data by fields. Format/file types include

JSON
AVRO
ORC
Parquet

Question 25

What is Unstructured Data

Answer 25

Does not naturally contain fields
EG: video, audio, media streams, documents

Often used to extract data organization and categorize or identify “structures”

fill in

Question 26

What is NoSQL

Answer 26

Loose term, to describe non-relational

Key-value stores
Document based
Column family databases
Graph databases

Question 27

What is a graph database

Answer 27

Stores entities centric around relationships

Enables applications to perform queries traversing a network of nodes and edges

Question 28

Steps in Data Journey

Answer 28

Data Ingestion
Data Processing
Data Exploration

Question 29

Data Ingestion

Answer 29

Process of obtaining and importing data for immediate use or storage in a database

Question 30

Data Processing

Answer 30

Takes the data in raw form, cleans it, and converts it into a more meaningful format

ETL - Extract, Transform, and Load

ELT - Extract, Load, and Transform

Question 31

Data Exploration

Answer 31

Query the data and create graphical representations of information and data

Question 32

Data Visualization

Answer 32

Business model can contain an enormous amount of information - there are techniques to analyze and understand the information in your models

Reporting

Business Intelligence (BI)

Data Visualization

Question 33

Data analytics

Answer 33

Discipline that covers the entire range of data management tasks - analysis, data collection, organization, storage, and the tools and techniques

Descriptive
Diagnostic
Predictive
Prescriptive
Cognitive

Question 34

Prescriptive analytics

Answer 34

What ACTIONS to take to achieve goal or target?

Question 35

Diagnostic analytics

Answer 35

WHY something happened?

Take what we collected from descriptive analytics and dive deeper

Question 36

Predictive analytics

Answer 36

What WILL happen

Use historical data to determine what will happen in future

Question 37

Prescriptive analytics

Answer 37

What ACTIONS to take to achieve goal or target?

Question 38

Cognitive analytics

Answer 38

What MIGHT happen if CIRCUMSTANCES change

Intelligent technologies

Combine AI, ML, Deep Learning to apply human brain-like intelligence to do certain tasks