Week 1 Flashcards

1
Q

What does Psychology Measure?

A
  • Human Behaviour
  • Feelings
  • Cognitions
    Psychological constructs are often abstract and therefore can’t be measured directly
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Assumptions of Psychological Testing

A
  1. Psychological Traits & States Exist
  2. Psychological Traits can be measured
  3. Test-Related behaviour predicts non test related behaviour
  4. Tests and other Measurement techniques have strengths and weaknesses
  5. Various Sources of Error are part of the assessment process
  6. Testing and assessment can be conducted in a Fair and Unbiased manner
  7. Testing and Assessment benefit society
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Assumption 1: Psychological Traits and States Exist

A

Construct: Informed concept backed by Scientific Theory explains behaviour affect, and cognitions
Traits: And enduring characteristic within people that varies between them
What is measured
State: Similar to trait,s but less enduring
There are differences and variation amongst individuals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Assumption 2: Psychological Traits & States can be Quantified & Measured

A
  • Before we measure something we need to agree what it is
  • Important - Not only definition of something
  • Also the operational definition of something
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Operational Definitions

A

a description of something in terms of the procedures, actions, or processes by which it could be observed and measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Assumption 3: Test Related Behaviour Predicts Non Test Related Behaviour

A
  • If we can’t measure a construct directly we can use proxy measures
  • Trust that the behaviour indicates the construct it reflects
  • Also trust that the construct connects with other construsts the way we predict they should
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Prediction in Constructs

A

“Prediction is a central, indeed nearly ubiquitous, activity of psychologists. Many clinical decisions, such as treatment selection, depend on predictions. Psychologists, or at least applied psychologists, are, therefore, obliged to know as much as possible about how to make good predictions.” (Grove & Lloyd, 2006, p. 192)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Assumption 4: Tests and Other Measurement Techniques Have Strengths and Weaknesses

A
  • We need to be aware of the strengths and weaknesses of the tools we use
  • These are not always perfect representations of our constructs
  • Most measures have limitations like acquiring resources
  • Test takers should be informed of the details of any tests they are required to complete
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Assumption 5: Various Sources of Error are Part of the Assessment Process

A
  • We are only measuring proxies not the construct itself
  • Other sources of validity will impact our results
  • ‘Error’ does not mean something has gone wrong
  • Errors can be indicator of how good our measure is working
  • Other factors present that affect what we measure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Error in Psychological Measurement

A

Refers to the idea that there is variability that we can’t always account for.
Doesn’t necessarily mean our data is wrong

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Assumption 6: Testing and Assessment can be conducted in a Fair and Unbiased Manner

A
  • This is a controversial assumption
  • Example: WEIRD samples in research
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Assumption 7: Testing and Assessement Benefit Society

A
  • Some think that tests do more harm than good
  • Particularly standardised testing can be seen as hindrance
  • Standardised testing are not always a true measure of an indiviudal
  • But what would the world be like without them?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Survey Based Assessment

A
  • The major way to measure and assess concepts
  • How we operationalise the constructs we want to know about
  • Constructs can’t be seen or observed so we infer them from behaviour using indicators
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Self Report Measures

A
  • Beck Depression Inventory
  • Rosenberg Self Esteem Scale
  • Intelligence Tests
  • These indicate behaviours that can be inferred to predict future behaviour
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Scientific Standards of Self Report Measures

A
  • Unidimensional - Measures one thing
  • Factor Analysis - Analyses relationships between factors and variables
  • Reliability and validity - Gives us stable picture of what is measured
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Measures Traits not States

A

e.g. self esteem is a stable characteristic
Should be the same if measured over time.
State: Mood like sadness could fluctuate across time and might be different if measured over time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Test Retest Reliability

A

Measuring a construct trait at different intervals in time
Reliable if the traits are consistent over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Internal Consistancy Reliability

A

When we measure a construct over time and it remains stable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Test Validity

A
  • Is actually measuring what we expect it to measure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Psychometric Properties

A
  1. Factor Structure
  2. Reliabilty
  3. Validity

When we measure a construct we need to ensure that we use sound Psychometric Properties

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Scale vs Questionnaire

A
  • Questionnaire is the entire package
  • Starts with title and instructions
  • Contains scales that can be measured
  • Needs supplies Fit
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Multi Dimension Scale

A

Contains items that capture more than one construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Constructs vs Indicators

A
  • Constructs cannot be measured but we deal with them everyday e.g. Intelligence or personality
  • We infer them from things we observe
  • These observations can be measured and are called indicators
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Reverse Coding

A

When rating states in a questionnaire are reversed
On a scale of one to 5 reflects different states with 5 being Strongly Agree

I am a talkative person - Disagree 1 2 3 4 5 - Agree
I am a shy person - Disagree 1 2 3 4 5 - Agree
I enjoy Social Situations - Disagree 1 2 3 4 5 - Agree

  • Agreeing on Q2 would indicate extroversion so it needs to be flipped before anaylsis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Ovals and Squares

A
  • When developing an operational definition of a questionnaire
  • We use ovals to indicate theoretical construct
  • We use Squares/Rectangles to indicate observable indicators
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Building Blocks of Scales

A
  • Writing Good Questions
  • Can stand alone as single entities
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Scales & Questionnaires as a Package

A
  • Includes questionnaire & Information Sheet
  • Information sheet comes before the questionnaire
  • Information Sheet acts as informed consent to advise the participant what to expect
28
Q

Ways to Administer Questionaires

A
  • On Paper
  • By phone
  • Face to Face
29
Q

Self Report

A

We ask people to give us answers about some aspect of themselves
* Attitudes
* Values
* Beliefs
* Behavious
* Personal Characteristics
* Knowledge
* Experiences
* Expectations

30
Q

Psychometrics

A
  • Branch of Psychology
  • Uses statistical techniques and deals with design administration interpretation of variables
  • Things like Correclation & Factor Analysis
  • try to identify underlying constructs
31
Q

Where to start with Psychometrics

A
  • Start with a Theory or Construct that you want to observe
  • Then design a test to match the theory
  • Then use statistics to check if your measure works
32
Q

Intelligence Tests

A
  • Unusual in Scientific Discourse
  • Measures of Intelligence were developed first
  • Theories of intelligence evolved to fit the measures
33
Q

Open Ended Question - Values & Uses

A
  • Exploratory Research allows collection of broad range of data
  • Generate new directions of study
  • Provide freedom and scope to express themselves
  • complex & nuanced
  • Not limited to pre determined questions
  • Allows subjects to use own words
  • Provides different perspectives
34
Q

Open Ended Questions - Drawbacks/Problems

A
  • Time consuming to answer
  • Time consuming to analyse
  • Responses can be ambiguous
  • Difficult to analyse
  • Can be messy when subjects get off track - this can sometimes be good, leads to further discussion or research
35
Q

Fixed Choice Questions - Value/Uses

A
  • Limited to predetermined response options
  • Generate quantitative data
  • Suited to statistical analysis & numeric calculation
  • Should not leave room for ambiguity
  • Should not be too difficult to categorise
  • Quick and easy to administer and analyse
  • Keep respondents on topic
36
Q

Fixed choice questions - Drawbacks/Problems

A
  • Force respondents to choose from limited range of responses
  • May not capture the full picture
  • True attitudes may not be wholly captured
  • Pre testing required to be sure responses are relevant
37
Q

Types of Fixed Choice Questions

A
  1. Forced Choice
  2. Numerical or Likert Type
  3. Graphic or Semantic Differential
38
Q

Fixed Choice Questions - Forced Choice

A
  • Forces subjects to choose between discrete response options
  • You can’t select both
  • You can’t select neither

e.g. I-E Scale - Rotter 1966

39
Q

I-E Scale

A
  • Internal Locus of Control
  • External Locus of Control
40
Q

Internal Locus of Control

A

Tendency to feel personally responsible for behaviour consequences
e.g. I failed the exam because I didn’t study.

41
Q

External Locus of Control

A

Tendency to give blame to external factos like luck, fate or others for consequences of behaviour
e.g I failed the exam because the lecturer hates me

42
Q

Using I-E Scales

A
  • Rotter beleived these Locus of Controls were stable characteristics
  • Also could predict how people will behave in different circumstances
  • Measured this with 23 paired statements
43
Q

Fixed Choice Questions - Numerical

A
  • Used in Practical Applications
  • Give two response questions True or False - Code False as zero and True as one
  • The higher your score, the more positive the attitude
44
Q

Numerical Questions - 5 Point Scale

A
  • Allows us to capture more vairability than the I-E Scales
  • Can add nuance to responses
  • Coding is implicit but can be made explicit with numbering
  • Keep track of numbering so that we know what 0 actually means
45
Q

Numerical Scales - Likert Scales

A
  • Often used in online surveys
  • Subject required to rate a series of statements
  • Reversing should be done with software not by hand
  • Then arrive at an overall score, average and Standard Deviation
46
Q

Reversing Questions in Lickert Scales

A
  • When the numerical scoring scale runs in the opposite direction.
  • good idea to reverse code items that are negatively worded so that a high value indicates the same type of response on every item.
  • Ensure full measurement of an answer
  • Reduces the effect of answering carelessly
  • Helps correct for agreement bias
47
Q

Questionnaires - Things to Consider

A
  • How many questions is enough
  • What is the mid point
  • Include negative and positive worded items
  • Label every response or only the anchors?
48
Q

Acquiescent Responses

A
  • Respondents’ perceptions of how they think the researcher wants them to respond
  • May lead to demand effects.
  • Responding favorably towards and answer because they think it is the expected answer
49
Q

Central Tendency Bias

A
  • When questions are seen all in a row, people tend to lose interest in giving out an extreme score.
  • Mixing the questions up helps them appear more interesting and may reduce this problem.
  • Including positively and negatively worded questions to reduce this tendency
50
Q

Mid Point

A
  • Instead of asking subjects to agree or disagree we give a middle option.
  • But this can reduce variablity making differences difficult to see differences
  • Some researchers consider a neutral answer as the same as no answer
51
Q

Negativ/Positive worded questions

A
  • If someone answered two questions oppositely charged we could assume they are not attending to the survey and eliminate them from the data
  • However could result in different sub scales and becom es making them multi dimensional in nature
52
Q

Graphic or Semantic Differential Scales

A

Allow people to identify where they sit between polar opposites
Can cause scoring complications so we divide the scale into segments

53
Q

Response Questions Format

A

All fixed choice questions must be:
* Accurate
* Exhaustive
* Mutually Exclusive
* Uni-dimensional
* Variable Responses

54
Q

Response Options Formats: Accurate

A

Does the response match the question?
e.g. answers to the questions How satisfied are you with your meal?
The option of Very Satisfied is more appropriate that Strongly Agree

55
Q

Response Options Formats: Exhaustive

A

Ensure all the options are covered.
e.g. What brand of phone do you have? a) Apple, b) Blackberry or c) Nokia
What if someone has another brand or if they have two phones?

55
Q

Response Options Formats: Exhaustive

A

Ensure all the options are covered.
e.g. What brand of phone do you have? a) Apple, b) Blackberry or c) Nokia
What if someone has another brand or if they have two phones? or no phone at all?

56
Q

Response Options Formats: Mutually Exclusive

A
  • Two or more events that cannot happen simultaneously.
  • Each choice is incompatible with the others
57
Q

Response Options Formats: Uni-Dimensional

A
  • First options are inconsistent
  • Need to be a meausre of the same thing.
58
Q

Poorly Written Quesitons

A
  • Avoid slang/jargon/abbreviations.
  • Avoid vague or ambiguous wording
  • Avoid double-barrelled questions.
  • Avoid leading questions.
  • Avoid loaded questions.
  • Avoid complex grammar and negative wording. Write for your intended audience.
59
Q

Ways to Address Poor Questions

A
  • Use correct terms for items like Australian College of Applied Professionals not ACAP
  • Give set of Response answers taking care not to shape the outcome
  • use open response format even if behaviour is ambiguous
  • Only ask about one thing at a time without double barrelling or even give a numeric scale
  • Led in with filtered questions
  • Design question to give answer you want
60
Q

What is a Questionnaire

A
  • Document used for colleting information
  • Must be clear and professional
  • Contains title, sub-headings and instructions for each section.
  • Look at examples before creating your own.
61
Q

What is Not a Needed in a Questionnaire

A
  • Not an Academic Submission
  • Does not adhere to formatting like Times New Roman font or double spacing
  • Does not need to contain references
62
Q

What Does a Questionnaire need?

A
  • Each Scale describes what to do to get usable data e.g. circle answer or assign a number
  • Demographics are set and are questions placed at the beginning or the end
  • Decide on environment survey will be done i.e. quiet, at home, online
  • merge and mix sub scales to avoid agreement bias or demand effect
  • Finish with thanking subjects and instructions to return paper to you i.e. submit button or letter in the mail
63
Q

Ways to conduct Questionnaire

A
  • Face to Face
  • Telephone
  • Postal Mail
  • Paper Based
  • Online
64
Q

Honesty/Accuracy in Self Report
Data

A
  • Honesty: Subjects choose the socially acceptable answer, not the tru answer
  • Introspective ability: The subjects may not be able to assess themselves accurately.
  • Interpretation of questions: The wording have different meanings to different subjects.
  • Rating scales: Yes or no can be too restrictive, but numerical scales also can give an extreme or middle response
  • Response bias: Biases of previous responses relate to experience and other factors.
  • Sampling bias: Are the subjects representative of the population you wish to study?
65
Q

Questionnaire Conclusion

A
  • Efficient way to gather data
  • Many factors need consideration in preparation
  • Data is shaped by what you ask and how you ask it.
  • Use a Multi-Modal approach wherever possible
  • Plus methodological triangulation
66
Q

Methodological Triangluation

A
  • Involves using more than one kind of method to study a phenomenon
  • Gives confirmation of findings
  • Data is more comprehensive
  • Increases validity and enhances understanding of studied phenomena.
  • If multiple methods of collecting date lead to the same conclusion then findings are sound