Lecture 3 - why measurement Flashcards
Why do we need measurement in psychology?
We need a consensus on key constructs & definitions; we need objectivity; we must minimise subjective judgements.
What are we measuring?
- We measure the ATTRIBUTES of people, objects, & events.
What are these measurement rules?
- scaling: what scale will we use? (Cm, feet for height). How much of an attribute is present? (Low / high depression)
- classification; yes or no for sleeping patterns.
What is the issue with measurement?
- desirability
- positivity
- recall bias
When using statistical analysis, its possible that …
The statements made based on patterns of relationships can be untrue (its because of extraneous variables; longer studies can help with controlling for external factors; but it’s not always ideal because of time, resources, motivation).
(2) Psychological assessments
- Items form a scale & represent an agreed internal mental construct
These attributes measured should be related to the construct
Organisational commitment
- affective
- normative
- cognitive
Example for items on the scale
- positive & negative affect schedule (PANAS)
(3) Factor Analysis
To measure whether or not things are similar. If not similar, then we have an issue (the attribute is highly unrelated).
Spearman’s Factor Analysis
A combinations of theory & statistics based on how similar the questions are
Job satisfaction vs Organisational commitment
These two constructs are different and are analysed using two different sets of questions.
What are the Latent Factor?
What are the Optimal factors?
Intention to leave (related to Job Sat & Commit)
Job satisfaction (positive)
Intention to leave (negative)
* but both are still different areas - so measuring job satisfaction may not be the best construct to measure to see how many employees will remain in the organisation within a year).
(4) Reliability
Refers to the consistency of a measure
Types of reliability
- inter-rather reliability
- Test-retest reliability
- inter-method reliability
- internal consistency reliability
Reliability of measurement requires at least 3 measures
Assignment:
- Job satisfaction / engagement
- Stress
- Burnout
Polygraph
- measures physiological reactions (heart rate, sweat)
- people can lie, maintain their heart rate, & the machine won’t necessarily pick up on it (lack of control fo extraneous variables)
- so not exactly measuring what it proposes to measure (which is if the person is lying when responding to a question; not particularly valid or reliable form of measurement).
(6) The Net Promoter Score (Reichheld)
- what is the NPS measuring? (Feelings, or behaviour?)
- unrealistic measure of behaviour (referring to the scale)
NPS validity
- what is the standing behind a detractor & passive - shows a skewed measure because the range & scale does not align. Additionally, what does 0 mean for any behaviour. The NPS seems to generate responses in the extreme because of the vagueness of the scale rating).
Other ways to strengthen NPS conclusions
- bring in some responders for a focus group to ask why they have this opinion.
- its useful for gaining some insights into the current levels of & satisfaction regarding customer service
- in survey design, its important to use a 1-5 , & 6-10 scale.
- you can change the question to get the answers that you want.
(7) Interpretation & results of measurement
- examine current trends
- see patterns of relationships between variables (positive, negative)
Independent variables: Role conflict, burnout, medication & IV incidents
- no account of extraneous variables (patients, ward organisation)
- missing mediation variable
- there should be a different order of variables
How can we determine the causality?
- deductive reasoning/ logic/ argument
- test data using experimental methods (clinical trials)
The Scientific Method
Follow this model
- observation
- theory
-predict
- evidence
* use theory to make a reasonable hypothesis.