- What should one bear in mind when using the split-half method to estimate reliability?
- What is a norming sample? When can such a sample be called appropriate?
This is also known as a standardization sample. A norming sample helps with the meaning and evaluation of scores. Without such norms, the meaning of scores would have been difficult, if not impossible, to evaluate. However, by knowing such things as the average number of correct responses found in the norming sample, one could at least state whether a new subject was below or above it.
-
- What are the main reasons for strictly controlling the distribution of psychological tests?
If everyone knows the tests, then items measurement error will be unacceptably high.
Sensitivity among practitioners to the rights of the individual, relevant court decisions, and a clearly articulated set of ethical guidelines and published standards for proper test use.
- Why is knowing about social desirability important for testers? How does it affect the way testees respond?
Being aware that a response distortion is aggravated by the theory that somebody’s privacy is invaded so their uncomfortableness will aid in this response distortion, hence the scores become distorted. Moreover, the testees responses will not be honest because their response distortion will try to paint a picture of how they want people to perceive them in a better light and not the same as what their reality actually is.
- What is meant by rational and empirical scales in test construction?
The rational scales use a deductive method that begins by developing a theory for the construct of interest. This may include the use of a previously established theory. After this, items are created that are believed to measure each facet of the construct of interest. After item creation, initial items are selected or eliminated based upon which will result in the strongest internal validity for each scale. Advantages of this method include clearly defined and face valid questions for each measure.
The empirical scale is an External or Criterion Group method. It also means that data in the absence of theoretical assumptions drives the selection of items. A data Empirical test construction attempts to create a measure that differentiates between different established groups.
- For what purposes do psychologists use the KOIS? Briefly summarise the properties of the test.
The Kuder Occupational Interest Survey (KOIS) is used for general occupational interests. The KOIS presents the test taker with 100 triads (sets of three) of alternative activities. Scoring of the KOIS scales gives information yielded data on 10 general occupational interests (e.g., outdoor interests versus social service interests). KOIS examines the similarity between a test taker’s interests and those of people employed in various occupations. Furthermore, the KOIS has developed separate norms for men and women. The KOIS also has a separate set of scales for college majors. Thus, in addition to suggesting which occupational group might work best with a test taker’s interests, the KOIS may also help students choose a major.
- In which sense do psychological tests invade individual privacy?
When people respond to psychological tests, they have little idea what is being revealed, but they often feel that their privacy has been invaded in a way not justified by the test’s benefits.
- What are the purposes of ‘integrity tests’? What ethical and practical concerns do they raise?
Tests that directly target the construct of Integrity also known as honesty tests. Primarily self-reported test to predict the possibility of dishonesty and counter productivity. Integrity tests work on the rationale that there are meaningful differences in behaviours, attitudes and values between individuals that could be used to identify individuals who are more likely to engage in dishonest behaviors and behaviours that are counter-productive at work.
Eg. The Explicit Integrity Test & the Indirect Integrity test
The typical dimensions that integrity tests measure are perceived incidence of dishonesty, leniency towards dishonest behaviours, theft rationalization, theft temptation or rumination, perceptions regarding dishonest behaviours, impulse control and punitiveness towards self and Integrity tests typically come in two distinct forms, the first is overt integrity tests, also known as “clear-purpose” integrity tests and personality-based integrity tests, which are also known as “veiled-purpose” integrity tests. Overt integrity tests directly inquire about an individual’s attitudes and admissions about behaviours that are undesirable at the workplace such as workplace theft. Personality-based integrity tests are personality inventories that measure personality constructs that are linked with the undesirable behaviour.
- *****What is a multitrait- multimethod matrix? Why is it helpful? (This is not in the textbook, Gus says don’t need to know this)
- Pinpoint the radical difference between (i) “individually tailored” (or “adaptive”) testing and (ii) traditional standardised testing procedure.
“individually tailored” (or “adaptive”) or Criterion-referenced tests are used to document specific skills rather than to compare people. Criterion- referenced tests are the basis for standards-based assessment in public education. Standards-based assessment requires that students pass tests demonstrating that they have critical knowledge and skills in defined areas. Some critics believe the cut points for passing the tests are arbitrary.
- How do percentile transformations change scores? Why do we use percentiles?
Percentiles are the specific scores or points within a distribution. Percentiles divide the total frequency for a set of observations into hundredths. Instead of indicating what percentage of scores fall below a particular score, as percentile ranks do, percentiles indicate the particular score, below which a defined percentage of scores falls.
- What is the FFM, also called “Big Five”? How does it influence testing practice?
The Big Five personality traits, also known as the five factor model (FFM), is a model based on common language descriptors of personality. When factor analysis (a statistical technique) is applied to personality survey data, some words used to describe aspects of personality are often applied to the same person. For example, someone described as “conscientious” is more likely to be described as “always prepared” rather than “messy”. This theory is based therefore on the association between words but not on neuropsychological experiments. This theory uses descriptors of common language and therefore suggests five broad dimensions commonly used to describe the human personality and psyche. Each of the Big Five personality traits contains two separate, but correlated, aspects reflecting a level of personality below the broad domains but above the many facet scales that are also part of the Big Five.
- What is the Bender Gestalt Test used for? Why is it suitable for those purposes?
The Bender-Gestalt test is a psychological test that assesses visual-motor functioning, developmental disorders, and neurological impairments in children ages 3 and older and adults. The test consists of nine index cards picturing different geometric designs. The cards are presented individually and test subjects are asked to redraw each one from memory before the next card is shown. Test results are scored based on the accuracy and organization of the reproductions.
It is useful for individuals who have suffered a traumatic brain injury may be given the Bender-Gestalt as part of a battery of neuropsychological measures, or tests.
- What are convergent and discriminant validity?
Convergent evidence comes from correlations between the test and other variables that are hypothetically related to the construct. Discriminant evidence shows that the measure does not include superfluous items and that the test measures something distinct from other tests.
