Metrics, Monitoring, Observability and Governance

Question 1

What are the 4 key metrics tobe measured by DevOps teams?

Answer 1

1. Lead time
2. Change failure rate
3. Deployment frequency
4. Mean time to recovery

Question 2

What are the most critical attributes of the application design to be monitored?

Answer 2

User facing attributes

Question 3

What are RED metrics?

Answer 3

RED Metrics:
- Rate - The number of requests the service is handling per second.
- Error - The number of failed requests per second.
- Duration - The amount of time each request takes.

Question 4

What are the 3 approaches to measure Application release readiness?

Answer 4

1. Defect tracking uses the number and distribution of discovered defects inside the software for estimating release readiness.
2. The Software Readiness Index (SRI) makes use of quality and reliability metrics in order to determine release readiness.
3. ShipIt describes an elaborate measurement for release readiness which uses the development progress of the software product as an underlying metric.

A comparison between these three approaches shows that defect tracking is simple but limited in its application while ShipIt comes to short in measuring the important criteria of quality and reliability. Finally, SRI renders to be the most versatile and detailed approach for release readiness measurement.

Question 5

What is synthetic monitoring?

Answer 5

Synthetic monitoring(also known asactive monitoringorproactive monitoring) is a monitoring technique that is done by using asimulationor scripted recordings of transactions.

Behavioral scripts (or paths) are created to simulate an action or path that a customer or end-user would take on a site, application or other software (or even hardware).

Those paths are then continuously monitored at specified intervals for performance, such as: functionality,availability, andresponse timemeasures

Question 6

What are the 4 maturity levels of Monitoring systems?

Answer 6

Monitoring Maturity Levels:
1. Optimizing – self correcting
2. Proactive – integration of monitoring sources
3. Reactive – separate monitoring sources
4. Chaos – missing monitoring sources

Question 7

What is Observability?

Answer 7

Observability is the extent to which the internal states of a system can be inferred from externally available data.

Question 8

What are the 4 key elements of Observability?

Answer 8

1. Monitoring
2. Logging
3. Tracing
4. Visualization

Question 9

What are the 3 DevOps Governance stratergies?

Answer 9

• Tool Governance: Ensures DevOps teams use approved tools
• Pipeline Governance: Ensures software changes meet DevOps metrics
• Site Reliability Governance: Ensures software releases meet deployment metrics

Question 10

What are the required attributes for DevOps culture?

Answer 10

• Break down communication silosbetween development and operations.
• Shared responsibility encourages closer collaboration.
• Autonomous teams make decisions and apply changes without convoluted decision-making processes.
• Cross-functional ownership of quality, performance, and security.
• Feedback, is valued to continuously improve
• Automation frees people focus on valuable activities and reduces human error.

Question 11

What are the 5 skills as per DOI for effective DevOps?

Answer 11

1. Automation skills
2. Human skills
3. Technology skills
4. Functional skills
5. Process and framework skills