LV 5 Flashcards

1
Q

Why elastic workload?

A

Reduce over/under provisioning
Reduce const
Increase customer satisfaction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Scalability limit

A

Web: overhead with parallelisation, sequential part dominates the execution
Transaction based apps: shared resources (e.g database)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Scalability

A

Characteristic of an application to increase capacity with the amount of resources

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Capacity of application depends on

A

Available resource capacities
Application design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Elasticity

A

Dynamic adaptation of capacity to change in workload
No shutdown/restart required

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Capacity planning in cloud

A

Possible due to dynamic resource management and pay per use cost model
High elasticity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Vertical Scaling - Scaling up

A

Increase capacity of singe Service instance by increasing its resources
( increase cpu time percentage, clock frequency, more cores)
Advantage: no change in service required

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Horizontal Scaling - Scaling out

A

Capacity increase if service by creating more instances ( copies of services, load balancer on top)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Vertical scaling

A

Advantages: easy to replace resource with more powerful
No application redesign
Disadvantages:
More powerful resource might be too expensive
Resource capacity is limited
Replacement of resource causes service interruption

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Horizontal scaling: pros and cons

A

Pros: scaling through adding more resources
No requirement for more powerful hardware
Cons: increased amount of resources comes with more management overhead
Required distributed software architecture
Long term solution !

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

SLO

A

service level objective
Latency of requests
Failed request rate
Service availability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Auto scaling policy

A

Analyzer -> scheduler -> scaling actions -> executer -> cloud CMDs

Policy -> scheduler

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Auto scaling approach: reactive

A

Detect under/overloaded service
Scale in/out or down/up according to policy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Autoscaling approaches: scheduled

A

Policy specifies scaling events
Apply scaling actions at appropriate time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Autoscaling approaches: predictive

A

Continuously predict future workload
If workload change, schedule scaling actions ahead in time
Goals: circumvent scaling latency, enable more time consuming scaling decisions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Resource centric auto scaler

A

Scaling actions modify resources
Services are implicitly adapted

17
Q

Service centric auto scalers

A

Scaling actions modify service instances
Resources are implicitly adapted

18
Q

AWS Reactive Autoscaling

A

Resource centric: scaling of VM

19
Q

AWS Scaling Policies

A

Target tracking scaling (specify target value, automatically adjust resources to meet target)
Simple scaling
Step scaling

20
Q

AWS Predictive Autoscaling

A

Determines proactively minimum of Autoscaling group

21
Q

Load balancing

A

Distributes requests among services
Scaling out: works only if all replicas are equally busy

22
Q

Load balancing: goals

A

Efficient utilization of set of resources
Increase availability
Reduce response time and failure rates

23
Q

Static vs dynamic load balancing

A

Static: no feedback from server
E.g round robin
Dynamic: feedback on the status

24
Q

Dynamic load balancing

A

Distributed: shifts work between different nodes
Cooperative: have the same goal (optimize memory workload)
Non-cooperate: different goals( optimize cpu workload)

Non-distributed:
Centralized: one central LB
Semi-centralized: nodes are partitioned and one LB responsible for partition

25
Q

Approaches for web apps

A

Round robin dns
DNS Delegation
Client-side random sampling
Server-side load balancing

26
Q

Classes of LB Algorithms

A

Class-aware: classification of requests
Content-aware: request content
Client-aware: packet source

27
Q

LB Algorithms

A

Round robin and weighted round robin
Least connection and weighted least connection
Resource based
Weighed response time

28
Q

AWS Elastic load balancing

A

Distributes upcoming traffic across the instances in the auto scaling group