Article 3.4. Quantifying with words: an investigation of the validity of narrative-derived performance scores (Speer, 2018)

Question 1

Performance narratives =

Answer 1

Text-based data received in open-format during the PM process.
Specific evaluations or general evaluations.

Question 2

Disadvantages of traditional ratings (3)

Answer 2

1. Reliability-issues.
2. Biases.
3. Little context to understand ratings.

Question 3

Advantages of including narrative comments (2)

Answer 3

1. Increases reliability and information.

2. Reduces the rater-motivation bias.

Question 4

Steps to get a score from narratives

Answer 4

1. Pre-processing of text.
2. Building prediction models.
3. Data partition.
4. Obtain narrative scores in a new sample.