Definitions

Question 1

• asterisk

Answer 1

“All columns” and useful when you need to retrieve all the columns at once.

Question 2

5 V’s of Big Data

Answer 2

Volume
Velocity
Variety
Veracity
Value

Question 3

@ (at) symbol

Answer 3

Used for variable identifiers in SQL Server

Question 4

ABFS (Azure Blob Filesystem)

Answer 4

One of the primary access methods for data in Azure Data Lake Storage Gen2 is via the Hadoop FileSystem. Data Lake Storage Gen2 allows users of Azure Blob Storage access to a new driver, the Azure Blob File System driver or ABFS. ABFS is part of Apache Hadoop and is included in many of the commercial distributions of Hadoop. Using this driver, many applications and frameworks can access data in Azure Blob Storage without any code explicitly referencing Data Lake Storage Gen2.

Question 5

ACID

Answer 5

OLTP concept:

-Atomicity
-Consistency
-Isolation
-Durability

Question 6

AD (Active Directory)

Answer 6

Azure integrated active directory, using the same SID assigned to the current user logged in to the client computer. Using this authentication method allows you to define security boundaries by Active Directory groups, by creating SQL logins for the group, instead for users one by one. This way, the Active Directory admin could assign or revoke access permissions, managing the group memberships directly.

Question 7

ADF (Azure Data Factory)

Answer 7

PaaS data movement and orchestration engine, and it shines in cloud or hybrid scenarios. It has a handy web UI for developing your pipelines. ADF has a strong integration with Azure DevOps, it provides a rich set of RESET APIs to interact with, and it has a prebuilt monitoring dashboard that lets you keep track of execution outcomes and resource consumption. You can also monitor activities through the Azure Monitor service.

Question 8

AES (Advanced Encryption Standard)

Answer 8

Algorithm that uses the same key to encrypt and decrypt protected data. Uses an automatically generated certificate, which is rotated as needed, and there is no need to manage it from your side.

Question 9

ALTER

Answer 9

Used to add, delete, or modify columns in an existing table. Changes part of the definition of an object, but not all changes are permitted. Can be used to add a column to a table but you cannot change the type of an existing column from a string type to a numeric one, if the data contains chars other than numbers.

Question 10

Always On availability groups

Answer 10

SQL Server solution implemented for high availability and recovery. It uses Windows Server Failover Cluster and implements replicas between the members of the cluster. The replicas can be asynchronously committed when long distances must be covered, but usually the synchronous method is used.

Question 11

Apache Hive

Answer 11

Data warehouse system for Apache Hadoop. Hive enables data summarization, querying, and analysis of data.

Question 12

Apache Kafka

Answer 12

Open-source distributed streaming platform that can be used to build real-time streaming data pipeline and applications.

Question 13

Apache Oozie

Answer 13

Workflow and coordination system that manages Hadoop jobs. Oozie is integrated with the Hadoop stack, and it supports the following jobs:
- Apache Hadoop MapReduce
- Apache Pig
- Apache Hive
- Apache Sqoop

You can also use Oozie to schedule jobs that are specific to a system, like Java programs or shell scripts.

Question 14

Apache Spark

Answer 14

Unified analytics engine for large-scale data processing. It provides high-level APIs in Java, Scala, Python, and R, and an optimized engine supports general execution graphs. See also Azure Databricks.

Question 15

ARM (Azure Resource Manager)

Answer 15

Used to perform administrative tasks. ARM is the service that uses the portal to perform the tasks. The actions and parameters you choose are sent back to ARM for the portal to get the work done.

Question 16

Atomicity

Answer 16

Derives from the concept of an atom, something that must be together, “all or nothing.” Ensuring that all the information is stored as one block, including all the parts at the same time.

Question 17

Attributes

Answer 17

Columns

Question 18

HiveQL

Answer 18

Query language similar to SQL used to write Hive queries in Apache Hive.

Question 19

WASB (Window Azure Storage Blob)

Answer 19

Azure Blob Storage is Microsoft’s object storage solution for the cloud. Blob Storage is optimized for storing massive amounts of unstructured data.

Question 20

Access Management

Answer 20

Azure provides various procedures that you can use to allow access to your resources, Authentication and Authorization.

Question 21

Acquisition

Answer 21

Produced data is pushed to one or multiple endpoints, where a stream transport and/or processing engine is listening for incoming data events.

Question 22

Adjacency List

Answer 22

A collection of unordered lists used to represent a finite graph.

Question 23

Adjacency Matrix

Answer 23

A square matrix used to represent a finite graph.

Question 24

Aggregation

Answer 24

Aggregation is usually performed over time, grouping events by windows. Tumbling, hopping, sliding, and session windows are commonly used to identify specific rules for aggregation.

Question 25

Transformation

Answer 25

Filtering out unwanted values, enriching it by joining it with static data sets or other streams, or passing it to a machine learning service to be scored or a target of prediction.

Question 26

AI (Integrating in Pipelines)

Answer 26

Offerings like Azure Cognitive Services make it possible to integrate AI in your pipelines with just API calls, saving the burden of building a complex platform yourself.

Question 27

ALIAS

Answer 27

In the FROM part of the SELECT, each table can be followed by AS expression with a letter or a couple letters. This makes it easier to identify the tables by the ALIAS instead of the full name.

*In practice, the AS is not needed in the query when aliasing tables.