Chapter 14 - CBTs and IBTs Flashcards
Outline the concept of a computer-based test (CBT)
Test is ADMINISTERED AND SCORED using a computer.
Is a program loaded onto a computer - doesn’t need internet
some paper based tests may have computer based interpretation
Outline the concept of Computerized Adaptive Testing (CAT), and give 2 benefits of CATs
The test is tailored for the individual based on their previous responses.
Two benefits of CATs:
- more ACCURATE
and - more EFFICIENT
Outline the concept of Internet-delivered testing (IDT)
IDT is administered on a computer via the internet
Name on precaution necessary when using a CBT
One cannot simply copy and paste the report provided by the CBT, you need to review and edit it with the client’s CONTEXT in mind
Legally, informed consent can be challenged if it was not done in the client’s……..
MAKE SURE THEY UNDERSTAND
first language
Briefly outline the following terms in their use in Psych Assessment:
- Vendor neutral assessment portals
- Computer-based test interpretation
- Computerized stimulation assessments
- Game assessments
- Artificial intelligence
- Vendor-neutral assessment portals: enable users to
combine tests from different test publishers in one
battery - Computer-based test interpretation: computer
system converts scores into a report - Computerized stimulation assessments: modelling a
real-life task - Gamified assessments: designed more like a game
which could include virtual reality or augmented reality - Artificial intelligence: computers performing tasks
that would normally require human intelligence
Many of the IBTs available in SA are not….
normed/adopted for a South African context
Give some of the reasons that IBTs are do not provide valid results
4 points
- they are not normed/adapted for a local context
- tests become overexposed and people become familiar with them -> decreases validity
- standardization is often very compromised when people are doing them from home (small phone screen etc)
- results are stored across locations and often not securely
List 4 Legislative controls and 2 Ethics that govern the use of CBTs/IBTs
Legislative controls:
- health professions act
- employment equity act
- protection of personal information act
- promotion of Access to Information Act
Ethical controls:
- health profession of SA (HPCSA)
- International Test Commission (ITC)
Outline 4 Good Practice principles for the administration and use of IBTs/CBTs
- Tests must be used by an appropriately registered psychology professional
- Test must be used under statutory control (legislative and ethics controls)
- Ethical code - assessment done within the context of a clearly defined professional relationship
- All conditions that apply to paper-based tests also apply to CBTs
List 4 considerations when it comes to maintaining paper-based test conditions for IBTs/CBTs
- Offer alternatives to those unfamiliar with computers
- Prepare for contingencies (power failures etc)
- Reports remain sensitive and need professional handling
- Qualitative observations remain a valuable source of information
List the first 7 guidelines for CBT and IBTs for the practitioner
- Give due regard to technological issues
- Attend to quality issues
- Provide appropriate levels of control over test conditions
- Make adequate provision to ensure security and privacy
- Practitioner needs to have appropriate level of competency
- Chose psychometrically sound tests –
evaluated and classified by Board - Scientific evidence of equivalence of paper- and computer based versions
Tech/Quality/Control/Security/Competency/Classified/Equivalence
Tom Quotes Classic Shakespeare Causing Clara Ecstasy
List the second 9 guidelines for CBT and IBTs for the practitioner
- Consideration of human factors – fairness, physical
difficulties - Prepare appropriately through tutorials
- Verify identity of test-taker
- Closely supervise in order to offer the necessary
support - Board requirement – professional needs to be in
attendance at all times - Ensure contingencies plans in event of technological
difficulties / power failure / power outages - Securely stored – tests and results
- Check accuracy re reports being generated
- Debrief
Humans/Prepared/Identity/Supervise/Presence/ Contingencies/Storage/Accuracy/Debrief
Howard Pops Ibuprofen So Penny Continues Snoring All Day
What is one of the main risks around the use of IBTs/CBTs
Practitioners becoming dazzled by the new technology and forgetting the underlying value of a test - its appropriateness for the intended purpose, suitability for the test taker and psychometric soundness
Dehumanising and v automated tests may compromise test takers
