Chapter 7: Data Collection Flashcards

1
Q

What are the five types of data needed for SPE

A
  1. Key Performance scenarios
  2. Performance objectives
  3. Execution Environment
  4. Software Resource Requirements
  5. Computer Resource Requirements
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are heavy hitters?

A

Functions that take up the most resources

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What do we need to estimate in key performance scenarios?

A
  • Workload intensity
  • Arrival rate of requests
  • Number of concurrent users
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does the execution environment consist of?

A
  1. Hardware and network
  2. Operating system
  3. Database usage
  4. Other software that uses resources
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How do we estimate software resource requirements?

A

Can use work units

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the types of computer resource requirements?

A
  1. CPU time for work units
  2. Number of I/O
  3. Message size
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How do we map software resource requirements into computer resource requirements?

A

Processing overhead matrix

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is a walkthrough?

A

Informal review where member of development team discusses system

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a performance walkthrough?

A

Similar to walkthrough except goal is to gather the information needed to construct performance models.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is a user representative?

A

Provides data on how the system will be used, how often and typical usage conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is a system architect

A

Provides overview of system and its components along with use cases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is a performance specialist?

A

Someone who is familiar with measurements of target configuration and can either provide data or perform measurements to get data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When should performance walkthroughs be conducted?

A
  1. Early stages, should be part of overall feasibility study to see if the project can continue.
  2. When system evolves. The frequency of performing walkthroughs depends on performance risk.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Are resource requirements the most difficult specifications to esimate?

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are use measurements?

A
  1. Start with an estimate
  2. Use model results to study accuracy of model results to estimates
  3. Modify it with accurate estimates as soon as possible

Continue to evaluate the system as it evovles

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are study measurements?

A

Study similar systems to develop a frame of reference to estimate resource requirements

17
Q

What should you do if you haven’t participated in SPE studies before?

A

Use a mentor to assist and advise you on resource estimates in initial walkthroughs

18
Q

When uncertainty is an issue in measurements what should be used?

A

Use best-worse case estimates

  1. First use best case as if that doesn’t work then no point in continuing
  2. Use worst case estimates to find anomalies in system.
19
Q

What happens if worst-case estimates pass the system?

A

No point in developing more precise metrics.

20
Q

What should be estimated?

A
  1. Dominant Resource Usage
  2. I/O Requirements
  3. Network messages
21
Q

What are dominant resources?

A

Resources that account for most of elapsed time in scenario

22
Q

What do we need to estimate I/O Requirements?

A
  1. Number of physical I/O
  2. I/O Service times
  3. Random or sequential access
23
Q

How do we estimate number of physical I/O?

A
  1. First method: Indirectly method of estimating I/O. Estimate the logical I/Os and then estimate hit ratio
  2. Second method: Directly estimate I/O. Estimate which I/O requests might be stored in a cache/buffer, count only ones that would access physical I/O.
24
Q

How does read random access effect number of I/O?

A

For read requests that random access an indexed file or table the number of logical I/O is i+1,

where i is the number of files in file index and
1 is the I/O to read the data record

25
Q

How does write random access effect number of I/O?

A

For write requests that random access an indexed file or table the number of logical I/O is i+1,

where i is the number of files in file index and
1 is the I/O to read the data record

where 1 is best case as index is not effected and i+1 is worst case where all levels of index are effected

26
Q

How do we estimate network messages

A
  1. Number of messages transferred
  2. Number of characters transferred

must account for the characters in message headers and the application messages

27
Q

What is the overhead for transferring a message?

A
  1. CPU path length for preparing message
  2. physical I/O for logging message
  3. Time to transfer both the message and other extra required messages for protocol
28
Q

Where can we find overhead resource requirements?

A

Model libraries

29
Q

What happens if you cannot find overhead resource requirements?

A

Perform a performance measurement study

30
Q

What should you do after estimating computer resource requirements?

A

Make a library for others to use as well.

31
Q

How to have a successful performance walkthrough?

A
  1. Partition long walkthroughs into smaller ones
  2. Minimize action items
  3. Include Solution Alternatives with results