10 - Stochastic Simulation Modelling Flashcards

1
Q

Input Variability as stochasticity

Deterministic and stochastic models

A
  • when a dynamic system can experience random disturbances, these have to be mirrored by a stochastic model
  • a model needs to include stochastic elements if these significantly influence the measured indicators
  • one of the most frequent mistakes in considering stochastic models is evaluating the results of mean values only
  • > average doesn’t tell you anything if you have no idea about the variance
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Input Variability as stochasticity

Simulating variability

A

Fundamental part of most simulations are stochastic, since we cannot predict precisely what will happen in the future

For example:

  • customer arrivals
  • type of customer
  • serving times
  • machine cycle times
  • machine breakdowns
  • defective parts
  • travel times
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Input Variability as stochasticity

Simulating Variability

General approach

A
  • specify overall behavior using probability distribution
  • for each simulation run, select values at random from the probability distribution
  • this calls for a way of making random selections - we usually start with random values from the Uniform(0,1) distribution
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Input Variability as stochasticity

Simulating variability

Where do past probabilities come from?

A
  • past data (therefore you need to have the data available)
  • expert judgement (e.g. “one out of ten products” judged by an expert)
  • nature of situation (e.g. throwing a coin will be either heads or tails)

-> as probabilities are a type of input data, the parameter values and their effect on simulation output have to be validated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Computing Randomness

What is randomness?

A

Processes:
- coin, dice, lottery, radioactive decay

Properties:
- equal chance, full range, independent (no correlation)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Computing Randomness

General approach

A

We need a way of making random selections

  • The usual approach is to start with a random value from Uniform(0,1) distribution
  • we transfer the resulting value to fit the given probability distribution of the simulation parameter
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Computing Randomness

Example for a generator

A

Congruential random number generators

  • Produces sequence of integers using equation: I=(a*I+c)mod m
  • integers are all between 0 and m-1, so random number returned = I/m
  • intialise with a seed (gives control)
  • multiplicative version has c=0
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Computing randomness

Congruential number generators

Drawbacks and how to compensate them?

A
  • only possible values are 0/m, 1/m, 2/m, …, (m-1)/m
  • repeating cycle
  • maximum period before it repeats is m (m-1 if c=0)

Compensate drawbacks:

  • vital to choose good values of constants
  • large m and maximal cycle

-> congruential generators can work well but there are various other algorithms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Computing randomness

Testing random number generators

A
  • test that it covers the whole range of values (see whether each number shows up with equal probability)
  • test correlation
  • look at values, pairs of values, gaps
  • plot chart (look at the scatter plot)
  • statistical tests (e.g. chi-square test)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Computing randomness

Importance of random number generator

A
  • is a key part of most simulations
  • unreliable random number generation can lead to misleading results
  • the source of randomness produces input random variables with known distributions that we specify
  • the input random variables are accepted by the simulation model and an output is produced
  • the properties of the output random variables is what we want to estimate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Computing randomness

Using random number generators in a simulation

A
  • we control which random numbers are used through seeds or streams - restarting a sampling process given the same seed or stream recreates the same random numbers
  • using the same seeds will repeat the run exactly
  • to run the model several times in experiments we need to change the seeds each time
  • we can get more efficient experimentation using “common random numbers”: use different random number streams for different sources of variability: then different strategies can be compared under essentially the same conditions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Probability distributions

Continuous distributions

A

Various distributions are frequently used in simulations, e.g.:

  • negative exponential - arrivals
  • lognormal - service times
  • Erlang - service times
  • Normal - finance
  • Weibull - times between breakdowns
  • Uniform - equal probability
  • Triangular - when know min, max, mode
  • empirical - like a histogram and sample each bar as discrete category; use when no standard distribution fits
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Probability distributions

Discrete distributions

A
  • empirical - type of part or customer, routes

- standard discrete distributions such as binomial or Poisson, e.g. for customer arrival probabilities

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Probability distributions

Negative exponential distribution

A

Position process:

- Given random arrivals at a constant rate, inter arrival times will follow the negative exponential distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Analyzing result variability

Simulation runs and random numbers

A

A single simulation run’s results are strongly influenced by random variations. Therefore a single run cannot lead to informative conclusions.

Processing multiple runs increases the statistical significance of results. These have to be analyzed using appropriate statistic methods:

  • repeat n independent simulation runs
  • calculate indicators and statistical measures (such as mean, variance) after every k and k+1 runs
  • calculate confidence intervals
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Analyzing result variability

Sampling

A

Sampling aims to draw realistic conclusions about the whole population from a mere sample

  • > every simulation run is a sample
  • > statistical tests to find out if the results from the sample are also applicable to the system
17
Q

Analyzing result variability

Confidence intervals

A

A confidence interval describes the interval, in which a particular real indicator will be expected with a certain probability for a particular level of significance. The probability is determined by the level of significance, e.g. 90%, 95%, 99%

Example:
Does the simulation indicate a mean to be at least 10% greater than 100 with a 95% probability?

18
Q

Analyzing result variability

Confidence intervals

Additional info

A
  • CI is only realistic if the model correctly mirrors real variations and distributions
  • large CI’s indicate that the number of simulation runs was not sufficient
  • a simulation converges if the desired CI is reached based on the processed runs
  • When CI’s overlap for two scenarios, the difference in the indicators in not significant
19
Q

Analyzing result variability

Why student rather than normal distribution?

A
  • every simulation run is a random draw of mostly normally distributed parameters
  • a limited number of draws (sample) from a normally distributed population follows the Student (t) distribution