Lecture 5 Flashcards
What are the 4 overarching steps to consider when user testing (before, during and after)?
Target users and recruitment
Test setting and preparation
- Tools and resources - Tasks - Ethics and risks
Facilitation
Reporting
What 4 things would you consider when looking to recruit and test with users? (focus of this question in users)
- Target audience
- How many users to test
- Their requirements and requirements of test
- Screener clearly specifying the types of people you are looking for, and include questions about AT use and needs for materials.
What 6 considerations would you need to think about when recruiting?
Add extra time and costs to recruit
- May have to go to a specialist recruitment agency - May have to go via "gatekeepers" or charities
Increased incentives
- Transport costs, carer etc
Location
- Sometimes easier to go to them
Make sure all materials for recruitment are available in accessible formats, send ahead of session from them to read through
Check ethical issues
Beware of overcasting participants
What 3 things do you need to set up for Test Setting and Preparation?
- Tools and Resources
- Tasks
- Ethics and Risks
What 4 things would you consider when preparing the session (tools and resources)?
- Consider their needs (wheelchair access, blind friendly environment etc)
- Be familiar with Assistive Technology used, schedule time to set up and test AT
- Ensure all materials are available in an appropriate format
- Make sure everybody involved in the session is properly trained
What 3 things would you consider when preparing the tasks for the session?
Find out what to test - user journeys and see if they can complete the tasks
- Possibly have back-up tasks so they can complete something
Consider how long they have to complete the tasks
- Might be up to 2 hours, might need breaks!
Conduct pilot tests early and if possible schedule a walkthrough by a person with similar accessibility needs, especially to estimate times.
What 3 things would you consider when preparing the session (worse case scenarios)?
Identify what to do if they don’t want to continue
Identify what might be an ‘adverse event’ and what to do
Do a risk assessment
- Identify hazards and who is affected - Evaluate the level risks arising from the hazards - Describe existing controls to reduce risks - Describe what else you might have to do & timescale - Might have to think about indemnity insurance
What preparations do you have to make when facilitating a session?
- How you will introduce yourself and explain the protocol to the participants
- How you gain informed consent
- Alternative techniques for facilitating and communicating
- Extra time for participants to become comfortable and familiar with the environment
- Don’t make assumptions
- Use people-centric terms and/or find out they preferred terms.
What adjustments would you make for participants who are blind or partially sighted?
- Introduce yourself and others who are in the room
- Describe the setting, including the position of the video camera
- Tell the participant when you/others enter or leave the room
- Give directions about where to be seated.
- Offer your elbow to lead the participant.
- Tell the participant where there is room for a service animal.
- Slow down screen reader and record keyboard use.
What adjustments would you make for participants who are deaf or hard of hearing?
- Get the participant’s attention before talking
- Take turns talking. Person who lipreads will find it hard to follow to people at a time.
- Face the participant while speaking
- Provide seating for an interpreter. Clarify to the interpreter the importance of translating questions and answers exactly.
- Speak normally unless requested otherwise. Don’t speak too loud.
- Offer to write down what you are saying.
What adjustments would you make for participants with physical impairments?
- Remember seating for a personal attendant or carer
- Have a clipboard available to hold any materials
- Remember space for a wheelchair, a cane or other mobility aids
- Don’t move mobility aids. Some people are uncomfortable if the aids are out of reach.
- Make sure they can reach and operate equipment.
- Respect personal space.
What things would you need to be aware of when reporting?
- Carefully distinguish between usability and accessibility issues
- Be careful about categorising users with disabilities.
- Include only relevant characteristics and think about causes
- Be careful with conclusions, especially with small sample sizes.
