Week 12 - Culture and Assessment Flashcards
Item-generation techniques are easy to apply to
figural ability items
Tailored testing involves
adapting test content to an examinee in real time
There are three types of successive development of different language versions of a psychological test. What are they?
Application
Assembly
Adaptation
What are strategies for identifying and dealing with method bias in cross-cultural assessment?
Assessment response styles
Extensive training of administrators
Use of collateral information
NOT error/distracter analysis
Emotional intelligence is
the ability to recognise and control one’s own and other’s emotions
MAT is to CAT as MANOVA is to
ANOVA
What are strategies for identifying and dealing with construct bias in cross-cultural assessment?
use of informants with expertise in local culture and language
use of samples of bilingual subjects
non-standard instrument administration
NOT error/distracter analysis
‘Open mode’ refers to
anyone being able to access a test without any form of authentication
Western intelligence tests tend to
de-emphasise social aspects of intelligence
The idea behind item-generative testing is that
the computer randomly generates new items based on an underlying rule or algorithm
What is not a typical source of construct bias in cross-cultural assessment?
Poor sampling of all relevant behaviour
A disadvantage of MAT is
an examinee is required to remember the instructions of all subtests simultaneously
Differential familiarity with response procedures is a type of method bias commonly found in which type of psychological test?
questionnaires
An examinee who sacrifices accuracy for speed is emphasising
quantity over quality
What is more efficient - CAT, MAT or SAT?
MAT is more efficient than CAT?
Some authors have suggested that, in the future, psychological tests will include
holograms
virtual reality
artificial intelligence
An examinee who sacrifices speed for accuracy is emphasising
quality over quantity
What is not an area of advantage for internet testing?
obtaining informed consent
An appropriate translation of psychological instruments requires a balanced treatment of
psychological, cultural and linguistic considerations
Who introduced the idea of practical intelligence?
Sternberg
What is practical intelligence?
it is context-based, pragmatically useful and acquired through experience rather than formal instruction
What do integrity tests attempt to measure?
concepts like dependability, theft proneness and counterproductive work behaviour
What is CAT?
computerised adaptive testing - the idea that the coputer can continuously monitor an examinee’s performance and refine the trait or ability estimate after each item is presented
What is IRT?
Item response theory - a family of theories that seeks to specify the functional relationship between response to a psychological test item and strength of a latent trait
What is an item bank?
the large pool of items underlying the CAT
What is MAT?
Multidimensional adaptive testing - it takes CAT to the next level by applying the basic idea to a whole battery of tests
What is the difference between CAT and MAT?
CAT adapts by dynamically estimating the single ability being measured by the test and selecting the next item that optimally improves that measurement; MAT adapts by dynamically estimating all abilities being measured by the battery simultaneously and selecting the next item, from whichever subtest, that optimally improves the measurement of all abilities
What is item generation?
it is where new items are generated automatically by computer according to some underlying rule or algorithm
What is time parameterisation?
it is to solve the fundamental problem of speed-accuracy trade-off, which is a basic dimension of strategy in solving any difficult task
What does Kyllonen argue?
he argues that test developers need to focus more on the constructs that they want to measure, rather than on the specifics of particular test - LATENT FACTOR-CENTRED
What is the digital divide?
the fact that some people have better access to the internet than others, and that those with the best access tend to be the most privileged
What is ‘ping latency’
bandwidth limitations - lag
What is open mode?
anyone can access the test
What is controlled mode?
involves users being sent a password and logging on to a testing site
What is supervised mode?
involves the presence of a human supervisor or proctor
What is managed mode?
highly controlled and the test is kept secure - similar to formal examinations
