Mod 8 - Explore Azure Storage Operations Flashcards
what are the rules for SA endpoint names
- must be between 3 and 24 characters in length and
- may contain numbers and lowercase letters only.
- Your storage account name must be unique within Azure.
what are the storage account endpoints names
Blob Storage https://<storage-account-name>.blob.core.windows.net
Data Lake Storage Gen2 https://<storage-account-name>.dfs.core.windows.net
Azure Files https://<storage-account-name>.file.core.windows.net
Queue Storage https://<storage-account-name>.queue.core.windows.net
Table Storage https://<storage-account-name>.table.core.windows.net</storage-account-name></storage-account-name></storage-account-name></storage-account-name></storage-account-name>
what is Storage Account resource
an azure storage resource that enables storage of data in cloud.
provides a unique namespace for your Azure Storage data that’s accessible from anywhere in the world over HTTP or HTTPS
3 Basic Reqs needed to deploy SA:
- Resource Group
- Location
- Name
How to deploy SA
- Login to azure portal
- Search for storage account resource
- Go through prompts and set three basic settings
what are the 4 types of SA Types
- Standard general-purpose v2
- Premium block blobs
- Premium file shares
- Premium page blobs
what are the 4 types of SA services
Containers(Blob Service):
Queue Service:
File share(File service):
Table Service:
what is Containers(Blob Service)
: cloud storage for unstructured data such as text or binary data.Low cost to use
Premium page blobs Redundancy Options
LRS
Premium file shares Redundancy Options
LRS, ZRS
Premium block blobs Redundancy Options
LRS, ZRS
Standard general-purpose v2 Redundancy Options
LRS, GRS, RA-GRS, ZRS, GZRS, RA-GZRS
Blob
raw storage files that are located in containers. No permissions, no organization. Example, static website content like pictures on a website
how would you describe a Containers
Like a folder on windows OS
what is Queue Service
messaging store for consistent messaging between application components.
Smaller version of service bus. Can be coded into SDK
what does Queue Service use for send/receive
Uses API calls to send and receive messages between apps.
what is service bus
PaaS offering that acts as an enterprise grade queue for messages sent between microservices apps.
Apps subscribe to messages sent by another App.
what is service bus used for
Used for large scale apps with large amounts of message sent and stored
what is File share(File service):
organized file shares that maintain NTFS structure and permissions. Uses AD style authentication. Higher cost to use
what is Table Service
NoSQL store for schema-less storage of structured data. Rarely used, used for mobile apps, lightweight projects ex. Power Platform
HAAG
High availability, always on data stores
what does ETL stand for regarding data transfer
Method of data transfer where you extract data from data store, transform data into another format, load that compatible format into another data store.
- Example: Extract database data into csv file»Transform into Blob data type, Load blob into Azure Storage resource
how does Sw Developer role use SA
- Mainly use Blob storage and queue storage
- Store files uploaded by users to a web server or front end website or Dev process
how does Data engineer role use SA
- Mainly use Blob service and table service
how does System Admin: role use SA
- Mainly use File service
- Keep copy of corp data in cloud
what are the three Storage Access Tiers
Hot
Cool
Archive
what are the attributes of Hot tier
Changes frequently
Lowest latency
Used for Files
what are the attributes of Cool tier
Less frequently
Stored at least 30 days
Slower performance than Hot when accessing
Can incur a pro-rated penalty if you switch from Cold to Hot. Ex, 1 TB in cold for a week, get charged for 23 days
Used for Backups or Data waiting to be processed(ex. once a quarter data)
what are the attributes of Archive tier
Stored at least 180 days
Very affordable
Data offline
Used for Backups or Annual Backups for compliance reasons
Rehydration
process to pull data out of archive into cold tier after 180 days. Costs a lot of money
How to create a storage access resource with any tier
- Go to azure portal
- Open Storage Account resource page
- Select a Data storage option
- Click Create/Add button
a. Set a name
b. Set Access level(private, public) - Click Upload
a. Set Access Tier(Hot, Cold, archive)
Can edit Access Tier of selected file by selecting Change Tier
what are Redundancy Options
Option on the Storage Account resource to define how redundant data in the SA will be
Synchronous data replication(SDR)
When data is written to primary and replica stores simultaneously and data is synced.
* Data write operation not complete until all stores have data written to it and they confirm. If operation fails on any one, operation rolled back.
Asynchronous data replication(SDR
When data is written to primary store first without ensuring data is synced to replicas
what are the 2 storage performance tiers
Standard
Premium
what is the standard tier
Sets a general purpose v2 storage account and allows 6 SA Redundancy options
LRS
GRS
RA-GRS
ZRS
GZRS
RA-GZRS
recovery point objective (RPO)
The interval between the most recent writes to the primary region and the last write to the secondary region
what is RPO of azure storage
less than 15 mins
by default is data in secondary region available to read and write
no
what happens if failover is done to secondary region in case of primary region failure?
. After the failover has completed, the secondary region becomes the primary region, and you can again read and write data
Is data from primary region replicated synchronously
No, asynchronously. a failure that affects the primary region may result in data loss if the primary region can’t be recovered
How many nines of durability does LRS, ZRS, GRS, and GZRS
LRS provides at least 11 nines of durability (99.999999999%) of objects over a given year
ZRS offers durability for Azure Storage data objects of at least 12 nines (99.9999999999%) over a given year.
GRS offers durability for Azure Storage data objects of at least 16 nines (99.99999999999999%) over a given year.
GZRS is designed to provide at least 16 nines (99.99999999999999%) of durability of objects over a given year.
what is LRS SA option
- Locally redundant storage(LRS): LOW COST OPTION FOR HARDWARE FAILURES.
o 1 datacenter, 3 copies of data on three separate server racks(3 copies total)
o For non-critical scenarios
o Uses Synchronous data replication
what is GRS SA option
- Geo-redundant storage(GRS): Intermediate option with failover capabilities in second region
o 2 regions, 1 datacenter in each region, uses LRS in each datacenter(6 copies total)
o For backup scenarios
o Uses Asynchronous data replication between regions and Synchronous data replication in the datacenter
what is ZRS SA option
- Zone-redundant storage(ZRS): Intermediate option with protection from datacenter level failures
o 3 zones, 3 datacenters total, 1 copy in each data center in 1 region(3 copies total)
o For high availability scenarios
o Uses Synchronous data replication
what is GZRS SA option
- Geo-zone-redundant storage(GZRS): High cost, Optimal data protection solution that includes the offerings of both GRS and ZRS
o 2 regions, 3 datacenters spread across 3 zones in primary region, 1 datacenter in secondary region ZRS in the primary region(6 copies total)
o For critical data scenarios
o Uses Asynchronous data replication between regions and Synchronous data replication in the datacenter
what is premium performance tier
Enables low latency, high availability options only. Can’t choose all four SA services. Used for Hyperscaling and Used to deploy Azure data Lake Gen 2
what are the 3 SA options for preium tier
- Block blobs: blob storage for high transaction rates
- File shares: high performance apps that need to scale
- Page blobs: blob storage for random read and write operation
Azure data Lake Gen 2
Premium Blob storage account optimized for storing csv or parquet files. Utilized by Read data analytics tools such as Power BI
what is Azure Storage Explorer
Desktop app that allows you to view file shares in azure from your local computer. Can view storage accounts and file contained within ex. blobs, tables, queries
DFS (Distribution File System
tech that allows you to replicate data between file shares on different windows servers
Azure File Sync
Azure resource that manages DFS sync between on prem and azure storage accounts
how does Azure File Sync work
- Deploy AZ File sync
a. Create sync group which identifies the servers and VMs in azure to be synced - Install AZ FS agent on the on prem server running the file share
- Confirm sync is active
Should we use Azure File Sync to migrate data from on prem to AZ?
- Probably not
o Using Public internet
o Cost money for egress and ingress ops
what is Azure Migrate tool
Migration tool and dashboard to move on prem data in bulk. Can do this for IaaS or PaaS, ex. Lift and Shift an on-prem virtual machine server to a Azure VM
what are 3 options for AZ migrate
o Servers
o Databases
o Web Apps
what is azure data box
azure migration option where Physical Box that you get sent by Azure, load data on box, send back to Azure and they will transfer that onto your Azure resources. Uses NAS protocols such as NFS or SMB to transfer the data
how do you setup data box
- Select Import or export to/from azure
- Select subscription
- Select Resource Group
- Select Source country/region
- Select Destination AZ region
what is use case for data box
Used for File Shares with massive amounts of on-prem data
what are 3 options for data box
o Data Box: 100 TB, AES 256 bit encryption
o Data Box Disk: 8 TB, 128 bit encryption
o Data Box Heavy: 1 Petabyte
what are 5 benefits of azure storage
- Durable and highly available.
- Secure.
- Scalable.
- Managed.
- Accessible
Azure Files 5 benefits:
- Shared access:
- Fully managed:
- Scripting and tooling:
- Resiliency:
- Familiar programmability
what is the size limit for individual queue messages
64 KB
how many queue messages are contained in on a AZ SA
can contain as many messages as your storage account has room for (potentially millions
what is Disk storage, or Azure managed disks
block-level storage volumes managed by Azure for use with Azure VMs.
when Synchronizing blobs or files with AzCopy, is it one direction or bi-directional
one-direction synchronization. When you synchronize, you designated the source and destination, and AzCopy will copy files or blobs in that direction
AzCopy def and actions
is a command-line utility that you can use to copy blobs or files to or from your storage account
Actions: upload files, download files, copy files between storage accounts, and even synchronize files
Azure Storage Explorer def
a standalone app that provides a graphical interface to manage files and blobs in your Azure Storage Account
It works on Windows, macOS, and Linux operating systems and uses AzCopy on the backend to perform all of the file and blob management tasks
Azure File Sync def
a tool that lets you centralize your file shares in Azure Files and keep the flexibility, performance, and compatibility of a Windows file server
Once you install Azure File Sync on your local Windows server, it will automatically stay bi-directionally synced with your files in Azure.
what is ISV acronym
independent software vendor
- Azure Migrate: Discovery and assessment
Discover and assess on-premises servers running on VMware, Hyper-V, and physical servers in preparation for migration to Azure.
- Azure Migrate: Server Migration
Migrate VMware VMs, Hyper-V VMs, physical servers, other virtualized servers, and public cloud VMs to Azure.
- Data Migration Assistant
. Data Migration Assistant is a stand-alone tool to assess SQL Servers. It helps pinpoint potential problems blocking migration. It identifies unsupported features, new features that can benefit you after migration, and the right path for database migration
- Azure Database Migration Service
Migrate on-premises databases to Azure VMs running SQL Server, Azure SQL Database, or SQL Managed Instances
- Web app migration assistant
Azure App Service Migration Assistant is a standalone tool to assess on-premises websites for migration to Azure App Service. Use Migration Assistant to migrate .NET and PHP web apps to Azure.
what are the 3 scenarios where Data Box can be used to export data from Azure
- Disaster recovery - when a copy of the data from Azure is restored to an on-premises network. In a typical disaster recovery scenario, a large amount of Azure data is exported to a Data Box. Microsoft then ships this Data Box, and the data is restored on your premises in a short time.
- Security requirements - when you need to be able to export data out of Azure due to government or security requirements.
- Migrate back to on-premises or to another cloud service provider
