autoevaluation Flashcards

1
Q

what is autoevaluation

A

Or self-reported measures, etc.Questions asked directly to the target person to obtain their opinion or perception of their adaptation or situationMost often done through a (a) questionnaire or (b) face-to-face interview, but can also be by phone, email, secure website, app, etc.

the person’s point of view is important. Is fundamental
Condition the action. Will determine what the person will do.

Although the principle is simple, accumulated scientific knowledge shows that conducting a self-report is a complex process that involves the cognitions, emotions, and affects of the person being evaluated (Tourangeau, Rips, & Rasinski, 2000; Schwartz & Sudman, 1996)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Trois types d’autoévaluation : directe, indirecte et ouverte (Paulhus & Vazire, 2007)

A

Direct: the questions asked to the person have explicitly a good plausibility, the measured construct is not hiddene.g., “I am comfortable in the presence of a large number of people” – explicitly measures sociability

(Extraversion)Indirect: the construct being measured is intentionally “obscured” or hidden - authors minimize likelihoode.g., “I like everyone I know” – does not measure sociability, but is part of a social desirability scale
e.g., “My most difficult struggles in life are with myself” is an item on the MMPI’s Alcoholism scale - does not seem to be obviously related to this disorder, yet is as valid as more

“obvious” itemsOpen-ended: Unlike the direct and indirect self-reports, in the open-ended self-report, people give a free description based on a general question or instructionAllows respondents to use any construct they wishThe 20 Statement Test (Kuhn & McPartland, 1954) asks the person to complete 20 sentences, each beginning with “I am …”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Quatre avantages de l’autoévaluation :

A

richesse de l’information, motivation à rapporter, force causale et aspect pratique (Paulhus & Vazire, 2007)
1.Richesse de l’information : The person being assessed is best “qualified” to provide the information - no one has access to so much information about themAccess to a multitude of information about different aspects of coping, in different contexts and over a long period of time (quantity)Access to internal/intrapsychic information, such as sensations, thoughts, feelings, etc. (quality)
2. Motivation to report: To a large extent, no one is as interested in the subject matter of the evaluation as the individual-In the vast majority of cases, people “like” to give information about themselves - including clinical samples-In some circumstances, the assessment of a peer may be done less seriously, or more superficially - while in contrast, people tend to put more time and effort into assessing their own characteristics
3. Force causale :
Self-assessment sets in motion and “engages” the respondent’s identityWhether accurate or not, self-perception has a strong influence on how people interact with the world, their behaviors, their expectations of others, etc. (Pauhlus & Vazire, 2007)
e.g., an adolescent reports that the quality of his or her relationship with his or her parents is poor; the important thing is not that this perception is accurate, but that it significantly influences his or her behavior with his or her parentse.g., perceiving oneself as shy is not the same as being genetically shy (temperament), but it influences
4. Aspect pratique :
Probably the most frequently emphasized advantage is the exceptional practicality of self-assessment
It is quick and inexpensive compared to other methods (e.g., interview, naturalistic observation, experimental tasks, etc.)
For some constructs that are difficult to observe by peers, self-assessment is in fact the only possible option

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Certains construits d’intérêt en psychoéducation sont difficilement observables

A

Some constructs of interest in psychoeducation are difficult to observe by peer informants other than the individual (e.g., friends, parents, teachers, practitioners, etc.), which makes self-evaluation essential and unavoidable
Cognitions (e.g., cognitive distortions, cognitive schemas, etc.)
Depressive mood or suicidal thoughts
Delinquent/criminal behaviour
Substance use
Etc.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Trois désavantages de l’autoévaluation

A

Three disadvantages of self-assessment: Bias and response styles, introspection skills and honesty (Paulhus & Vazire, 2007)In principle, it is expected that the answers given by the person are exclusively related to the construct of interestHowever, “other” motivations always come into play, to varying degreesSelf-evaluation can be contaminated by (Robins & John, 1997)
a. the search for coherence of the self
b. self-deception
c. positive impression management.

Trois désavantages de l’autoévaluation : Biais et styles de réponses, capacités d’introspection et honnêteté (Paulhus & Vazire, 2007)
En principe, on s’attend à ce que les réponses données par la personne soit exclusivement liées au construit d’intérêt
Toutefois, des motivations «autres» entrent toujours en jeu, à divers degrés
L’autoévaluation peut être contaminée par (Robins & John, 1997)
la recherche de cohérence du soi
l’auto-déception
la gestion positive des impressions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

When we measure something but not obvious. Not clear..

A

Deux biais ou styles de réponses classiques sont plus souvent associés à l’autoévaluation :
Désirabilité sociale:
Social desirability, sometimes called “positive impression management,” is important in evaluation with clinical populationsIndividuals facing a potential intervention, or during an intervention, may sometimes want to show themselves in a different lightPositive impression management: Wanting to appear more positive to avoid punishment or negative consequencesNegative impression management: Wanting to appear more negative, which may reflect a desire to get treatment quickly, opposition with interventionists, the effect of deviant peer influence, or even a cry for help in some cases …

Acquiescement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

La désirabilité sociale, parfois appelée

A

«gestion positive des impressions», est importante en évaluation avec des populations cliniques
Individus faisant face à une intervention potentielle, ou durant une intervention, peuvent parfois vouloir se montrer sous un autre jour

Social desirability, sometimes called “positive impression management,” is important in evaluation with clinical populationsIndividuals facing a potential intervention, or during an intervention, may sometimes want to show themselves in a different lightPositive impression management: Wanting to appear more positive to avoid punishment or negative consequencesNegative impression management: Wanting to appear more negative, which may reflect a desire to get treatment quickly, opposition with interventionists, the effect of deviant peer influence, or even a cry for help in some cases …

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

difficiles à détecte ET échelles de validité

A

These two major problems can present themselves in many specific ways, depending on the individual and the context of the assessment, and are very difficult to detect at the time of assessment
Instrument developers have found an imperfect but useful way to at least attempt to quantify the potential presence of bias, and that is to provide validity scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Les évaluations par les pairs ne sont pas nécessairement supérieures puisqu’elles sont souvent influencées par une «heuristique centrist»

A

The perception of the person concerned may sometimes be significantly different from that of an informant (e.g., parent, spouse, friend) or stakeholderPeer assessments are not necessarily superior as they are often influenced by a “centrist heuristic”.When a person’s peers assess traits that are difficult to observe or judge, they will often tend to refer to their own personality (Ready et al., 2000)This phenomenon is also observed when an adolescent’s friends try to evaluate his or her delinquent behaviour or use of psychotropic drugs (Kandel, 1996).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Capacité d’introspection :

A

Introspection skills: Some people have more difficulty with introspection (not related to intelligence) - i.e., difficulty thinking clearly about their personal or social situation and reporting it accurately

Developmental: adolescents have poorer introspective skillsLong-term retrospective questions are more difficultIndividuals with certain clinical conditions also have more difficulty with introspection: e.g., certain neurodevelopmental disorders, certain personality disorders (e.g., antisocial or psychopathic personality)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Malhonnêteté : Certaines personnes ont davantage la propension à ne pas répondre de façon honnête, en particulier pour des questions qui touchent des sujets sensibles ou pour lesquelles une réponse honnête pourrait entrainer des conséquences négatives (différent d’auto-déception; Pauhlus, 1984)

A

Dishonesty: Some people are more likely to not answer honestly, especially for questions that touch on sensitive topics or where an honest answer could lead to negative consequences (different from self-deception; Pauhlus, 1984)
More common problem in individuals who exhibit a clinical condition related to externalizing problems, antisocial behaviour, antisocial personality, etc.
However, studies show that even for very sensitive issues such as criminality, self-reports are as valid as official data (Thornberry & Krohn, 2000)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Limite développementale de la validité des autoévaluations

A

Method suitable for adolescence and adulthood, but is it suitable for childhood?At what age is it appropriate and valid?Although the validity of self-assessments for children (under 10 years of age) has typically been questioned, few rigorous empirical studies exist to support thisSome recent studies show that children are able to report their usual thoughts, emotions, and behaviorsDevelopment of new instruments with encouraging results (see Witcomb, 2017; Frick, Barry & Kamphaus, 2020 )

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

autorévélées avec pictogrammes

A

-Some authors have developed self-report measures with pictograms as items for school-aged children (elementary school)-Simply use pictures as items; each clearly illustrates the content of the itemDSM-IV disorders:Dominic Interactive (and Dominic Paper) (Valla, 2000; Valla, Bergeron, & Smolla, 2000), Dominic Interactive Adolescents (Bergeron et al., 2010)Personality Traits:Pictorial Personality Traits Questionnaire for Children (PPTQ-C)(Mackiewicz & Cieciuch, 2016)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

autoevaluation

A

For psycho-educational assessment of adolescents and adults, self-assessments are essentialParents and teachers gradually become less relevant informants with ageAdolescents become more independent from parents and their peers of the same age become more important (Hartup, 1992)Adolescents are more likely to confide in their friends than in their parents or teachers, especially if the behaviour is deviant or less socially acceptable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

autoevaluation:
À faire avec des enfants du primaire (~ moins de 10 ans)

A

With preschool and elementary school children, informants are used mostly (e.g., parent, educator), but many researchers suggest using an interview where the evaluator must read each item to the child, ensuring comprehensionTo be done with elementary school children (~ less than 10 years old)Evaluator should always be present to readAdapt language level as needed (simple, clear and brief items)Simple response choices are preferable (i.e., true/false, yes/no)Adherence to standard administration criteria is essential (i.e., instructions followed, no distracting stimuli, etc.)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Mesures de l’adaptation sociale et personnelle pour les adolescents québécois(MASPAQ; Le Blanc, 1996)

A

Constructed by Marc Le Blanc (professor emeritus of ÉPÉ)For teenagers from 10 to 18 years old-Versions in French, English, Spanish, Portuguese and Arabic
-One of the most comprehensive instruments for assessing troubled adolescents
Antisocial behaviors, social adjustment (i.e., family, school, friends, routine activities, etc.), psychological adjustment
-Instrument based on a known theory of psychosocial maladjustment
- social regulation theory (Hirschi, 1969)

17
Q

MASPAQ – Structure du cahier d’entrevue

A

Background Information QuestionnaireSECTION 1: GENERAL INFORMATIONSECTION 2: CURRENT SITUATION, SCHOOL and/or WORKPersonal Adjustment QuestionnaireSECTION 3: PERSONALITY (Jesness [JPI], Eysenck [EPQ], Beck)Social Adjustment QuestionnaireSECTION 4: FRIENDSSECTION 5: FAMILYSECTION 6: NORMS (antisocial attitudes and values)SECTION 7: ROUTINE ACTIVITIESAntisocial Behaviour QuestionnaireSECTION 8: CONDUCT DISORDERS, DELINQUENCY, SUBSTANCE USE

18
Q

Rationnel du MASPAQ

A
  1. The adolescent’s point of view is essentialIt is not necessarily accurate or unbiased, but its perception influences their emotions and behaviorsA teenager may feel that his or her parents are extremely controlling, but even if this is not the case in reality, it still influences his or her behavior
  2. Active and proximal risk factors are criticalin interventionWhat is important from an intervention perspective are active (i.e., that can change and/or be changed) and proximal (i.e., closer to the adolescent’s life) risk factors
  3. Integrative systemic perspectiveAdolescent adjustment is modulated by several interacting systems (family, school, friends, neighbourhood, routine activities, values, personality traits, etc.).We must therefore measure several systems of the person’s adaptation, but also several forms of adaptation problems. forces strengths
  4. Developmental perspectiveStandardized scores based on sex/gender and agee.g., vandalism at age 10 and 18 does not have the same clinical significancee.g., high parental control at 9-10 is okay, but at 17 it should decrease
19
Q

Fidélité
Cohérence interne:
Stabilité temporelle:

A

Reliability
Internal consistency: Indices are satisfactory for the vast majority of the scales, but weak for some scales that have few items (e.g., parental supervision = 2 items)
Temporal stability: Coefficients over 1 or 2 months are satisfactory

20
Q

Propriétés psychométriques du MASPAQ

A

General standards based on over 8000 adolescentsClinical standards with samples of adolescents in residential care (i.e., youth centers)

ValidityContent validity: Theory accepted, but no systematic review of items by independent experts

Criterion validity: Concurrent (scales differentiate between adolescents with and without behavioral problems) and predictive (multiple scales predict future problems)

Construct validity: supported by factor analysis, but problems with some sections; no C/D validity

21
Q

Administration du MASPAQ

A

Administration well explained in the manual (e.g., desirable conditions for the interview, specific things to say to the teen during certain sections, etc.)Self-administered: paper and pencil format and podcast version (mp3)Semi-structured interviewRecommended method with troubled teens, who often have reading difficulties and little motivation for this type of taskUseful for making contact and gathering information on attitude during the interview

22
Q

Perspective critique sur le MASPAQ

A

Good instrument; one of the most comprehensive available for assessing troubled adolescents (in the context of YCJA measures in particular)Useful for both clinical and research purposesIn addition to measures of adjustment difficulties, measures important environmental and personal factors that can be addressed through interventionIn general, psychometric properties are satisfactory, but still need studies to refine sectionsFactor analysis is needed in all sections, etc.

The personality trait questionnaires used in the MASPAQ (Eysenck and Jesness) are not optimal, either clinically or psychometrically
e.g., Factor structure of Jesness’ (1983) questionnaire is not at all empirically replicated
While the section on antisocial or externalizing behaviours is very solid and complete, the section on internalizing problems is rather poor (anxiety and depression only)

23
Q

Perspective critique sur le MASPAQ

A

Unlike some of the brief instruments that have been seen in the course so far (EDC, PSA), the MASPAQ can be used to make a comprehensive assessment, and eventually make clinical decisions with more confidenceCaution: use requires training and the professional using it to make clinical decisions must have a good understanding of the interrelationships between the different social and personal factors assessed in the MASPAQ (or put another way, she must have the theoretical knowledge)

24
Q

Conclusion sur l’autoévaluation

A

The self-report method is common in psycho-educational assessment because it is practical, simple, inexpensiveIn some cases, it is essential (i.e., constructs that are difficult for peers to observe)Scores obtained with self-assessments are sometimes interpreted with little caution or rigorDespite its obvious advantages, one should not forget its potential disadvantages (e.g., biases and response styles, introspection, honesty)There are many such measures, but the advantages and disadvantages are always the same