Chapter 4 - Modelling Flashcards

1
Q

Give an example of how Insurers may make a model for car insurance pricing

A

Might base model on answers in policy form. To price, insurers try to evaluate how likely each driver is to make a claim, and how big the claim might be.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Why might a car insurer base their pricing model on elasticity of demand?

A

Insurer then has to work out plus or minus a profit margin, Model may also be based on a model based on price elasticity of demand. Idea that people who are more price sensitive will get a more competitive price than those who are not as price sensitive (more wealthy).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How might insurance companies use models to get approval from the regulator of the change in product design and investment strategy?

A

To persuade the regulator that the switch leaves policyholders no worse off, one could model the fact that the new investment has historically provided superior investment returns compared to the old one.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How might the regulator use models to enforce regulation of corporation tax insurer must pay

A

No two insurance policies are the same, so finding a fair price for insurance is difficult. Model is needed to decide if corporation tax is reflecting the full profit the insurer is making - company may be understating its profit if the model demonstrate insurance premiums are insufficient for the risks covered.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How might an actuary use models to calculate the value a member leaving a DB pension scheme early is entitled to?

A

The pension plan retains an actuary who confirms that the cash value offered is fair compensation for the lost pension entitlement, using a model that describes the cost of the benefits foregone.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How might a model assist to decide between paying out dividends vs reinvesting into the firm

A

They build a model to describe the likely effect of dividend policy on share prices over the medium term, to support the decision.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How might a firm make a model for mortality if they were worried about the effect of mortality improvements? Who else would use this model?

A

The firm constructs a model for pensioner mortality analysing past data to quantify the effect of mortality improvements int he past- can be used as input into pricing and underwriting decisions.
Givernment would also use ismilar models - find out what services are needed etc.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Define a model

A

A model is a mathematical representation of a real-world phenomenon. Models enable analysts to reduce complex problems to manageable terms. Models invariably involve making simplified assumptions about the real world. Computation tool is not a model and a theoretical hypothesis of what the world might look like is also not a model.
Both of these become a model when it is implemented in formulas and calibrated by reference to the real world phenomena that the model is attempting to represent.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are some simplifying assumptions often in a model?

A

Assuming:
A quantity is constant over the period
We know the statistical distribution of a quantity
Some aspects of the model are not influenced by (or are independent of) other aspects.
Aspects of the real world have an insignificant effect on what is being modelled
All financial instruments are priced to preclude risk free arbitrage profits

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are two collections of data often assumed independent by isnurers. And when was this proved wrong

A

Assumption usually that longevity and returns are independent, covid 19 ruins this.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the biggest causes of death today?

A

Biggest causes of death are now diet and pollution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

How is the structure and complexity of a model determined?

A

Structure of a model sets out the relationship between the variables modelled (inputs) so as to determine the functioning of the system (outputs).
Complexity of model is determined by the number of variables modelled and the form of relationship posited between them.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the three approaches to building a model in terms of setting it up.

A

A commercial modeling product could be purchased;
An existing model could be reused, possibly after modification; or
New model could be developed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What will determine if an actuary will re use or build anew a model

A

the level of accuracy required;
the ’in-house’ expertise available;
the number of times the model is to be used;
the desired flexibility of the model; and
the cost of each option.- If model will be used multiple times you will not want to be paying license fees to the third party

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Give advantages of modelling

A

Modelling can claim all the advantages of the scientific programme over any other logical, study of phenomenon that builds to a body of knowledge.
You’re not relying on re-inventing everything the first time. Building on knowledge that’s come before
Complex systems can be studied.
It is quicker, and less expensive than alternatives.
Consequences of different policy actions can be assessed, good for optimisation - trial and error bears no consequences
We can reduce variance of model as we can better control experimental conditions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Drawbacks of modelling?

A

Investment of time, money and expertise.
Often time consuming to use many simulations needed and results analysed.
Not especially good at optimising outputs (better at comparing results of input variations)
Human pride - Impressive looking models can lead to overconfidence in model.
Model only as good as parameter inputs quality and credibility of data. - garbage in garbage out
Must understand model limitations
Sometimes can be difficult to interpret output
Model will become obsolete because of changes
Automation can result in reduction of scrutiny. Something to watch.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is a static model?

A

Static: later stages of a model can be forecast independent of what has happened earlier in the model - no feedback loops
Each model point can be computed in parallel
with other model points, and then assembled in a final step.
May be able to project with more or less
objective assumptions.
Simpler to code, aggregate and analyse.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is a dynamic model?

A

Dynamic: output from one variable affects the future trajectory of other variables. Example: path of interest rates or investment returns affect lapse rates;
Decisions affecting any model point can be
based on the results across all model points at an earlier point in time.
Dynamic aspects may arise from future
decisions by management/policyholders or by third parties. Anticipating these decisions may involve a large subjective element.
More model complexity arising from complex
feedback loops.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Explain profit sharing policies and how it would need a dynamic model?

A

Profit sharing, participating or with profits policies: means there is some pooling of risk between policyholders. For example for term assurance policies where there is lighter than expected mortality. This could lead to policy holders getting some sort of refund or bonus increase to the sum assured. Will pay a higher premium at first and then profit is redistributed.
Profit sharing agreement needs a dynamic model so at the end of each year/month you have the aggregate policies and then distributed the bonuses, and next year starts then.
So you cannot forecast one policy in isolation from others so cannot be a static mod

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Describe how a DB pension plan could be made into a dynamic model

A

Dynamic model DB pension plan, dynamic decisions for a pension plan could include sponsor contributions(how much contributing annually), investment decisions (in surplus we can seek higher returns, greater capacity to take investment risk). Also DB Pension scheme is one big pool of assets , these decisions will be taken at pool level so cannot look at each individual benefit and add up.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Explain deterministic model

A

Output is a single forecast or or a small number of alternative scenarios with assumptions but no probabilities attached.
Simpler to create; easier,cheaper and quicker to
use and explain to non technical audience.
Results can be compared over time
(different model run dates) to see trends
and allow reassessment of assumptions.
Uncertainty of model predictions is not
assessed (or at least, not quantified)
Requires thought as to the range of economic scenarios that should be tested.

22
Q

Explain stochastic model

A

Output is multiple scenarios or probability distribution of outcomes.
More difficult to formulate; more difficult to interpret output, more time consuming and more difficult to communicate results.
Comparisons over time more difficult as multiple scenarios are produced; however, can focus on particular percentiles.
A stochastic model tests a wider range of economic scenarios.
Can interpret whether actual outcome is within a probabilistic prediction interval forecast by the model.
Mostly implemented using Monte carlo simulation - random generation of scenarios from a distribution

23
Q

In a guarantee investment product explain some reasons you might get policies lapsing? -

A

unemployment
Direct debit failed
Market going up - big risk, Guarantee becomes less valuable as market goes up, but the AMC cost is bigger. - lapse. If market goes down, amc goes down and guarantee value goes up - definitely persist in this scenario. Dynamic model would be needed as policyholder makes a decision based on market.

24
Q

Outline what TAS100 outlines as actuarial technical standards for modelling

A

Models used in technical actuarial work shall be fit for the purpose have sufficient controls and testing so that users can rely on the resulting actuarial information.
An explanation of how a model is fit for the purpose for which it is used and what it does shall be documented.
Controls and tests applied shall be documented.
Communications shall explain methods and measures used in actuarial work and their rationale.
Communications shall explain changes to the methods and measures used from the previous exercise for the same purpose (if one exists).
Communications shall explain limitations of the models and the implications of those limitations - some people won’t want to hear this but you must disclose!!!

25
Q

Give two examples of things you “can’t model” events you assume will not happen

A

There will always be things you cannot model, governments defaulting on government debt- might be relying on this for a lot of financial models, chance of asteroid hitting the earth and killing everyone, not something you’ll model on as you’re assuming this won’t happen.

26
Q

What are the operational attributes of a good model?

A

Well documented
The workings of the model should be easy to appreciate and communicate.
The results should be displayed clearly.
Outputs can be independently verifed
Must not be overly complex so it is difficult to interpret, expensive and long to run
Capable of development and refinement
A range of methods should be available to facilitate testing, parameterisation

27
Q

What are model points?

A

When big insurers run models it is sufficient for a representative single policy in each group to be run through the model, the result to be found, and for this result to be scaled up to give the result of the total set of policies in the group. The representative single policy in a group is termed a model point.A set of model points will be chosen to represent the expected new business under the product modelled ex: 10 year term assurance for those aged 30-40. .

There is a trade off between accuracy, how many people you out into a model point and run time.

28
Q

What are ways you can challenge a model?

A

Fit to evidence,
Hypothesis testing
Parsimony
Parameter significance and Business Materiality
Materiality tests
Fit to theory
Sensitivity analysis

29
Q

Describe fitting a model to evidence - Backtesting

A

Back testing - Would the model have predicted past values ex: would have predicted the financial crash?.
Need to reconfigure starting point, what is the model we would have used, how do we re-scale past data to today’s starting point,
Danger of over-fitting: Remedy this with out-of-sample testing. Hold back some clean data not used in fitting for testing the model.

30
Q

How can one use hypothesis tests for model challenging and how are they used?

A

Can use Repeated hypothesis tests, retaining parameters that are statistically significant in any regressions.
Usually seek to determine a most powerful test, ie minimise β given α.
Hypothesis tests also make auxiliary assumptions: in testing if the gradient is zero, we assume errors are independent, identically distributed.
All models are wrong, some are useful.

31
Q

What is parsimony and how can we challenge a model with it?

A

We want to avoid large amounts of unnecessary parameters.
Trade off accuracy of model against the number of parameters and the complexity. Criteria often considered here are:
Minimise Akaike information criterion (AIC)
Minimise Bayes information criterion (BIC)
Hypothesis tests, retaining parameters that are statistically significant.
Lasso regression which seeks a best fit subject to an upper bound on the sum of absolute parameter values.

32
Q

Explain the difference between materiality and statistical significance in the context of testing if parameters in model are significant

A

If parameter is not statistically significant, we should consider sensitivity tests of model output to plausible alternatives as it may still have a commercial impact
Materiality and statistical significance means Commercial impact vs evidence of difference.
Be aware: You don’t always have enough evidence to get statically significance estimates for things that are materially important

32
Q

What is important to note when a result comes out as statistically insignificant?

A

I only should take statically evidence along with a narrative as to why this would happen. Ex;Bloomberg found butter production Bangladesh to be correlated with s and p 500: not material!

33
Q

When we challenge a model by fitting to theory what theories are often used?

A

Fisher: consider returns as inflation + real return
Controversial theories: efficient market hypothesis
Self-referential models

33
Q

Describe the idea of sensitivity analysis for challenging a model

A

The re-running of a model (deterministic or stochastic) with different, but feasible, parameter values will produce alternative results and hence help to illustrate the potential deviations. The effect of mis-estimation of parameter values can also be investigated by carrying out a sensitivity analysis.

34
Q

Give some of the model validation standards set by Lloyds of London for their Internal Models

A

Independence
Risk coverage and indicators
Use of validation tools - qualitative evaluation of methods, back testing, goodness of fit, stress and scenario testing, sensitivity testings, reverse stress tests, P and L attribution, Bench marking, analysis of change, Model function

35
Q

Describe how independence can be used to validate a model?

A

Validation requires objective challenge. Agents should be able to demonstrate that individuals responsible for validation have sufficient independence (different reporting line) from model builders and implementation of the model
Three lines of defence; model builders, internal model validations, external model validatiors ( external auditors)

36
Q

How can risk coverage indicators be used to validate models and how is this usually done in practice

A

Gap analysis tests whether all material risks are indeed covered by model. A way to do this is:
An identification of risks to the business: This list may be formed by history trawling, asking staff, horizon scanning, and considering new sources not experienced yet
An identification of which of these risks are not covered by the internal model
An assessment of whether the risks not covered are material: requires a threshold for materiality and risk indicators for determining materiality

37
Q

Describe the model validation tool of a Qualitative evaluation of methodology and assumptions

A

Begins with a description of the most material assumptions of the method being used; it should identify where the assumptions may not be appropriate for the risk being modelled, and assess the limitations.

38
Q

Give examples of ways to test against experience

A

Goodness of fit tests, backtests

39
Q

When testing against experience - when might period of time you select to compare to be altered?

A

The portfolio being modelled will have changed over time. In these cases, there may be good
reasons for excluding some parts of the history from the tests against experience. However, such exclusions should be based on objective reasons relating to unique characteristics of the risks. It is not acceptable to take a one- sided approach excluding unfavourable history as being irrelevant, while not making allowance for tail risk that may not be reflected in the experience.

40
Q

Descrribe stress and scenario testing as a validation tool and how it should be set up

A

Stress and scenario tests must be based on realistic assumptions and extreme events in order to be credible. It is imperative that modellers provide an explanation or narrative around their stress tests. Stresses must be sufficiently severe. The event severities and probabilities should be derived independently from the process used to derive the risk distributions in the model.

41
Q

What is the different between stability and sensitivity testing

A

Sensitivity tests: involves determining the sensitivity of model outputs to variations in key inputs or assumptions;
Stability involves testing the stability of outputs using fixed inputs while varying the random seed or number of simulations.

42
Q

Describe both approaches to sensitivity testing that are used in model validation

A

“ST-1” involves deterministically varying a set of assumptions (such as loss ratio CoVs) by a given amount and measuring the effect on model outputs. Identifies the relative materiality of different inputs.
ST-2” involves varying the inputs, but using plausible alternative selections. Choice of alternatives may be guided by a prior validation test, such as test against experience.

43
Q

How does sensitivity testing allow for testing the mechanics of a model

A

Tests the mechanics of the model, in that if outputs do not move in the expected direction, it could be the result of a coding error, broken link, etc.

44
Q

What are reverse stress tests? - used as model validation tools

A

Begins with consideration of the events or combinations of events that could threaten the viability of the business. How large must the deviations be to cause this. ex: how far does stock have to fall before i go bust.
Very complex to see what way a company will fail if they have multiple risks
If it did go bust what is the most likely way it would happen
They should reflect the interaction of management (in) actions and external events.
Reverse stresses that result in a depletion of capital are at return periods of 1-in-200 years or higher (as firms must hold enough capital to withstand a 1-in-200 event under Solvency II).

45
Q

Describe profit and loss attribution and how it can be used as a model validation tool.

A

Undertakings should review the causes and sources of profits and losses for each major business unit on at least an annual basis. They should demonstrate how the categorisation of risk chosen in the internal model explains the causes and sources of profits and losses.

46
Q

Describe how benchmarking can be used as a model validation tool

A

Benchmarking may involve using market data to derive an alternative result. It may also include
comparisons to market peer groups made by consultants or other third parties.
Validation should demonstrate that the internal model is appropriate for a business’s own risks;
external benchmarking cannot perform this task.

47
Q

Describe what is meant by analysis of change, and how it can be sued as a model validation tool

A

Analysis of change involves comparing the values of key inputs and outputs with those of the previous version of the model.
The analysis should include an investigation of why the values have or have not changed.

48
Q

How ideally should tests of model functioning be carried out?

A

Tests of model functioning are designed to ensure that the model is functioning as intended.
Tests of model functioning would normally be done most intensively during the model build stage.

49
Q

Give proactive ways to prevent mistakes in a model

A

Verify intermediate equations numerically by substituting values into the left and right hand sides.
Sense-check model outputs.
Re-test software functionality with many inputs, including both expected and uneexpected
Where routine outputs have known properties, test these. For example, matrix multiplied by its inverse
Apply regression testing: Check new and old versions of model are consistent
Document performed tests
Be aware mistakes may not be down to coding.

50
Q

Describe how one can sue defensive programming in a model

A

Break software down into pieces that can be checked individually.
Use plain language and reduce code complexity as much as possible
As colleague to review
Use pseudo-random number generators that can be seeded with a starting point - using seeds in random number generators means you can recreate results. Important for checking.
Use version control and document changes.
Write code to handle exceptions