Storing Data Flashcards

1
Q

Identity and briefly explain the 3 different data types

A

Structured Data
* Relational containings sames fields and properties
* Updates can be difficult due to constriaints

Semi-Structured
* Non-relational
* More key values
* NoSQL and data serialization into XML, JSON, YAML

Unstructured Data
* Media Files
* Microsoft 365 files
* Text Files
* Log files

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Determine Operational Needs, questions to consider

A
  • Doing simple lookups?
  • Query for one or more fields?
  • Number of create, update and delete operations
  • Queries run complex analytical operations?
  • How quickly do these operations need to be processed?

Some examples include Product Catelog, Photos and Videos, and Business Data (All 3 needing have different operational needs)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Identity and briefly explain ACID prinicpals?

A
  • Atomicity => means a transaction must execute once and it must be atomic (all of it completed or none at all)
  • Consistency => data is consistent before and after the transaction
  • Isolation => ensures each transaction is not affected by other transactions
  • Durability => changes made as a result of the trasnaction are permantly saved in the system
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is OLTP?

A

Online Transaction Processing

High usages and volumes of data, short transactions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is OLAP?

A

Online Analytics Processing

Less users, longer response times, large volume of data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Regarding the Product Catalog, Identity the following:
* Data Classification
* Operations
* Latency and Throughput
* Transaction Support
* Recommendation

A

NOTE: Could have used Azure SQL, however products may not have similar properties

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Regarding storage and transaction needs of Photos and Videos, Identity the following:
* Data Classification
* Operations
* Latency and Throughput
* Transaction Support
* Recommendation

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Regarding storage and transaction needs of Business Data, what would be the recommendation?

A

Can use Azure SQL Database but could also consider Azure Analysis Services

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the considerations when determining the number of storage accounts?

A

Data Diverisity
* Data specific to country or region?

Costs
* Geo-redunancy more that local redundant
* Premium vs Standard Tier
* Hot access increases costs (access tier)
* You could split storage accounts and put critical data in geo-redundant and less critical use local redundant

Management Overhead
* Requires time to create and maintain

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Three things to consider when choosing Account Settings

A
  • Name => 3 - 24 characters and must be unique
  • Deployment Model => Resource Manager (recommended) or Classic (Azure Service Manager API)
  • Account Kind => Storage V2, Storage V1, and Blob Storage
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Identity the various Account Creation Tools

A
  • Azure Portal
  • Azure CLI
  • Azure PowerShell
  • Management Client Libraries
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Identity the 4 terms that define Microsoft Azure Storage

A
  • Managed
  • Durable => redundant
  • Secure
  • Scalable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How many Storage Accounts can a subscription have PER REGION

A

250

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the 4 types of data supported by Azure Storage

A
  • Blobs
  • Fileshares
  • Queues
  • Table Storage
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the 3 Blob Types?

A
  • Block Blob
  • Page Blob
  • Append Blob
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the features of the File Share?

A
  • Enables you to set up highly available network file shares that can be accesed the the Server Message Block (SMB) Protocol
  • REST interface
  • Storage Client Libraries
  • Uses (Configuration Files, Log Files)
17
Q

Az Command to create a Storage Account

A

az storage account create
–resource-group
–location
–sku
–name

18
Q

HTML to list all blobs in a container

A

GET https://[mystorageaccount]/?comp=list&include=metadata

Shows results in XML

19
Q

Basic Example using the client libraries

A

string containerName = “mycontainer”;
BlobContainerClient container = new BlobContainerClient(connectionString, containerName);
var blobs = container.GetBlobs();
foreach (var blob in blobs)
Console.WriteLine($”{blob.Name}”);

20
Q

Basic API Endpoints

A
  • https://{name}.blobs.core.windows.net
  • https://{name}.queue.core.windows.net
  • https://{name}.table.core.windows.net
  • https://{name}.file.core.windows.net
21
Q

Whats the difference between Access Keys and SAS

A

Access Keys
* Similar to user name and password
* Rotate Keys
* Shouldn’t put in configuration files or hard coded in application

** SAS**
* Limited permissions to a particular resource

22
Q

Az Command to show your Storage Account connection String

A

az storage account show-connection-string
–resource-group
–query connectionString
–name

Shows results in XML

23
Q

Storage Account Security Considerations

A
  • Protect data at rest (this is automatic and cannot be disabled)
  • Protected data in transit (use HTTPS)
  • Support browser cross-domain access
  • Use RBAC
  • Audit storage files (logs)
24
Q

Embed the SAS in an HTML header

A

Authorization: SharedKey myaccount:cY49k44BimLToTWiloX44ldfas0pi833Ppxda

25
Q

What two type of SAS are provided?

A
  • Service Level SAS
  • Account Level SAS

For untrusted clients, use SAS

26
Q

Two typical designed to get SAS keys

A
  • Front End Proxy Service
  • SAS Provider Service
27
Q

What are the options when selecting network access?

A
  • Enable from all networks
  • Enable from selected networks and IP Address
  • Disable
28
Q

What are the features of Microsoft Defender?

A
  • Provides an extra layer of security
  • Available for blob and files General Purpose V2
  • Not available to foreign governments
  • Send alerts to administrators
29
Q

What are some of the details in an event notification from Defender?

A
  • Nature of anomaly
  • Storage Account Name
  • Event Time
  • Storage Type
  • Protection causes
  • Investigation Steps
  • Remediation stps
  • Also includes details about possible causes and recommended actions to investigate and mitigate the potential threat
30
Q

Azure Data Lake Storage

A
  • Provides first-class data lake solution than enables enterprises to consolidate their data (its built on Azure Blob Storage)
  • RBAC, Access Control List
  • Authenticates through AD OAuth 2.0 bearer tokens and can include MFA
  • End to End encryptions