Psychometrics and Assessment Skills Flashcards

1
Q

What is psychological assessment?

A

Can include testing, but is more comprehensive than just giving someone a test. Clinical assessment typically includes;
An interviews/session where a therapist asks about current problems
Observing the person in a particular setting
A test to measure symptoms
A checklist to ensure therapist has gathered all relevant details.
Reviewing collateral info.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

WHERE AND WHY

In clinical psych.?

A

Diagnosing clinical disorders and mental health issues
Assessing the risk and severity of symptoms
Measuring efficacy of treatment interventions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

WHERE AND WHY

In neuropsych.?

A

Assessment of behaviours and functional changes associated with neurological illness or injury.
Measuring efficacy of treatment interventions
Measuring specific cognitive functions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

WHERE AND WHY

In organisational/HR?

A

Assessing suitability for particular role (e.g. aptitude tests)
Measuring performance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

WHERE AND WHY

In educational/developmental?

A

Assessing learning abilities (giftedness, learning disorders)
Observing and managing classroom behaviour
Measuring developmental stages.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

WHERE AND WHY

In Health?

A
Assessment of motivation/ability to change health related behaviours
Chronic pain management
Pre surgery (e.g. before plastic surgery is there a body image disorder)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

WHERE AND WHY

In Forensic?

A

Assessing risk
Behavioural issues
Impact reports.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are important things to look for when interviewing?

A

Bodily behaviour (slouched/fidgety)

Eye behaviour (avoiding eye contact)

Emotional tone

Physiological responses (blushing/shaking)

General appearance (hair brushed, clothing style)

  • Not just about what people say, it is also what they don’t say*
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are some important things to consider about how you conduct yourself?

A

Facial expression

Voice-related behaviour (tone, pitch, volume, speed)

Space (physical distance between C & T)

General presentation

Important to present yourself in a way that makes them feel comfortable and that they can trust you

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is bodily behaviour unpacked?

A

S = face the client squarely

O = adopt and open posture

L = remember that it Is possible to lean towards the other person

E = Maintain good eye contact

R = try to be relatively relaxed or natural in these behaviours.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the clinical treatment process?

A
  1. Initial assessment
  2. Case formualtion
  3. Treatment planning
  4. Implement plan
  5. Monitoring progress
  6. prepare for closure
  7. closure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What does initial assessment involve?

A

Why has this person come to see you? gather relevant information from various sources (e.g. school, family) but this is not always necessary.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What does case formulation involve?

A

Makes initial diagnosis, think about what factors might be contributing to current concerns. As you go through, reevaluate as new information continues to be added.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What does treatment planning involve?

A

Develop an evidence based treatment plan that is concrete, with specific goals and clear steps describing how to get to those goals.
It is important to always explain to the client what is happening.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What does implementing a plan involve?

A

Talking through the plan and initiate it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What does monitoring progress involve?

A

This helps both you and the client to be able to look back and see how things have or have not improved.
This can boost peoples confidence.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What does preparing for closure involve?

A

What might happen when therapy ends? How might we reduce the risk of relapse?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What does closure involve?

A

Provide advice on how to ensure continued wellbeing.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What should be covered in initial assessment?

A
Identifying info about the client.
General appearance and demeanour
History related to the presenting problems
Past psychiatric/psychological/counselling history
Educational and job history
Health (medical) history
Social/developmental history
Family history.

It is important to begin with the least threatening topics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is Psychometrics?

A

It is a branch os psychology that deals with the design, administration, and interpretation of quantitative tests for the measurement of psychological variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is psychological testing?

A

administering some form of test (pen and paper, computerised) often as part of a broader assessment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

How can interpretation of scores occur?

A

A test may have a cut off (passing the cut off score may indicate pathology)
A person might be tested repeatedly to see if there is a change in scores.
An individuals test score might be compared to how a large number of other have scored to see if the person is above average, below average, or average (known as the norm referenced test)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What might be an example of a self-report test?

A

Personality, emotional state, aptitude testing, Pain

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What might be an example of a performance test?

A

Memory recall, block test (spatial awareness)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What are some things to think about when testing?

A

Is this test appropriate for the person
Is this a good test?
Are you using the test appropriately?
Is this person administering it appropriately qualified/train?
Is this test process ethical?
Have all details been appropriately recorder?
Have the results been clearly explained to the person/other agencies?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

How do you know if the test is appropriate for the person?

A

Age, gender, physical ability, norms and diagnostic all need to be taken into account when delivering a test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

How do we know if a test is a good test?

A

Tests need to be valid and reliable
Validity: is the test measuring what it should be measuring? Validity reflects the test’s ability to assess the construct it was designed to measure
Reliability: is it consistent. Reliability concerns measurement consistency or the ability of a test to produce consistent results.

28
Q

How do we know if we are using a test appropriately?

A

Practice effects: will people learn from previous exposure to a test and will that inflate scores?

Fatigue: how long are you testing for?

Setting: is there any distractions that could impact on performance

29
Q

How is a test/assessment developed?

A

Normally it starts with a theoretical construct
A test can then be designed that should measure the construct of interest, then we can use statistics to check that the test does measure what is is designed to measure.
We then can check how accurate the test is, and even compare it to other tests that measure the same thing.

30
Q

What are the step in developing a test/questionnaire?

A
  1. Define the test.
  2. Select a Scaling method
  3. Construct the items
  4. Test the items
  5. Revise the test
  6. Publish the test.
31
Q

DEFINING A TEST

What is a test/questionnaire?

A

A set of items that allows measurement of some attribute of an individual

32
Q

DEFINING A TEST

What is an item?

A

Generic word for the various forms of content in a psychological test or questionnaire (e.g. a question)

33
Q

DEFINING A TEST

What is it that you are seeking to measure?

A

Develop a clear idea or specification of the attribute
Use exisiting theory as a guide where possible
Write a document containing specification for the development of items.

34
Q

DEFINING A TEST

How do we ensure that a test/questionnaire has not already been developed?

A

Check the literature and mental measurement handbook which contain the information about tests that have come out.

35
Q

DEFINING A TEST

What is the Kaufman & Kaufman Model of the test definition process?

A
  1. Measure attribute/construct from a strong theoretical and research basis.
  2. Must have capacity to distinguish between different attributes
  3. Yield score that are translatable to an intervention
  4. Include novel tasks or questions
  5. Be east to administer and objective to score
  6. Be sensitive to the diverse needs of groups being assessed.
36
Q

SELECTING A SCALING METHOD

What is nominal data?

A

A group you put someone in, it is categorical. Numerical value assigned will be meaningless, it is the most basic level.

37
Q

SELECTING A SCALING METHOD

What is ordinal data?

A

It is still categorical but in ranking order e.g. 1st place, 2nd place.
The order can be told but the distance between each point cannot be told.

38
Q

SELECTING A SCALING METHOD

What is interval data?

A

This is where continuous data can be obtained e.g. temperature in Celsius.
It is equal distance between points but there is no true 0

39
Q

SELECTING A SCALING METHOD

What is ratio data?

A

This is a continuous measurement with a starting point of zero and differences between the points on the Cale are meaningful

40
Q

SELECTING A SCALING METHOD

List the types of data from most basic to most complex.

A

Nominal
Ordinal
Interval
Ratio

41
Q

CONSTRUCTING THE ITEMS

What is the item format?

A

Related to scaling method of choice with dozens of choices available.

42
Q

CONSTRUCTING THE ITEMS

What are the types of item formats?

A

Multiple choice
True false
Force choice
Likert scale

43
Q

CONSTRUCTING THE ITEMS

What is a multiple choice format?

A

Common for student exams. There is usually one correct answer and permits quick scoring.

The problems with this format is it is difficult to construct items and provides cues for correct responses.

44
Q

CONSTRUCTING THE ITEMS

What are true/false questions?

A

Often used in personality test and easy to understand/answer.

The problem with it is it may reflect social desirability more than personality traits. It doesn’t permit much variability.

45
Q

CONSTRUCTING THE ITEMS

What is forced-choice methodology?

A

Often used in personality tests and overcomes the problems of true/false questions in social desirability.

The problems with it are that people don’t always fit in either category (same problem as true/false)

46
Q

CONSTRUCTING THE ITEMS

What are Likest-Type Scales?

A

One of the most used types of response formats, as it can better account for individual differences. It is good for assessing attitudes and perceptions and reduces desirability bias.
The problems with it is it consistently measuring the construct Q.? Are all the items appropriate and contributing to the overall interpretation of the test? It assumes strength/intensity is linear. People do not always fit into specified option. Social desirability can still occur.

47
Q

How are items tested?

A
  1. Conduct a pilot study to first ensure the items are clear and can be easily answered.
  2. Administer questionnaire to a large participant sample
  3. Do some number crunching in special statistical software.
  4. Investigate psychometric properties for the individual items
  5. Determine reliability and validity for sub scales.
48
Q

What are the key concepts in testing?

A

Standardisation and norms
Validity
Reliability

49
Q

What are norms?

A

Refer to the performances by define groups on particular tests.

50
Q

What is standardisation and norming?

A

The process of administering a test to a representative sample for the purpose of establishing norms is referred to standardising a test.

51
Q

What are percentiles?

A

When we have a group of scores, we can also work out where a score fits in a distribution.

52
Q

What are the 3 types of validity?

A

Content validity
Construct validity
Criterion-related validity.

53
Q

What is content validity?

A

Is determine by the degree to which items on the test are representative of the domain of behaviour the test purports to measure.

54
Q

What is construct validity?

A

The appropriateness of the inferences about the underlying construct.
A construct is a theoretical, intangible quality or trait in which individuals offer.

55
Q

What is correlation?

A

Statistical measure to indicate the extent to which 2 variables are related.

56
Q

What is factor analysis?

A

A statistical technique to determine the pattern of correlations or variability amongst the items; Correlated items or items that share variance form factors or dimensions.
Factors represent underlying abilities. Factors in a test can be correlated with factors in other alternative tests.

57
Q

What is Criterion Validity?

A

is the extent to which the test predicts or is related to an outcome.

58
Q

What are the types of reliability?

A

Internal reliability

External reliability

59
Q

What is internal reliability?

A

Concerns the extent to which a measure is consistent with itself.

60
Q

What is external reliability?

A

Concerns the extent to which a measure varies from one use to another use

61
Q

What is test-retest reliability?

A

Stability over time

62
Q

What is Inter-rater reliability?

A

The degree to which different rater’s give consistent estimates of the same behaviour

63
Q

What are the 3 sources of error?

A

Test construction
Test administration
Test scoring and interpretation

64
Q

SOURCES OF ERROR

What is test construction?

A

item sampling or content sampling

65
Q

SOURCES OF ERROR

What is test administration?

A

External factors that affect the test takers attention or motivation; factors specific to the test taker; examiner related variable.

66
Q

SOURCES OF ERROR

What is test scoring and interpretation?

A

Rigidity and rigorousness of scoring criteria; meaning of test result in relation to psychological functioning.