Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

Exams > Research > Flashcards

Research Flashcards

1
Q

Describe what user-centred design is?

A

A design process that includes research.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the 3 principles of user-centred design UCD?

A
  1. An early focus on users and tasks
  2. Empirical measurements, random
  3. Iterative design
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the main difference between a UCD and a waterfall?

A

Waterfall design goes does in one direction and a UCD has different stages and iterates

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Name the different stages of UCD?

A

Enter loop: 1. Plan the human-centred design process.
2. Understand and specify the context of use.
3. Specify the user requirements
4. Produce design solutions to meet user requirements
5. Evaluate the designs against requirements
Exit loop: 6. The designed solution meets user requirements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the advatage of UCD?

A

A UCD process resluts in a product that responds to the users’ needs and wishes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the disadvantages of UCD, name two?

A
  1. A UCD process is complex, but it is flexible

2. A UCD process costs a lot of money, but adapting or redesigning a product may cost more time and money

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is scientific research, name 4?

A
  • Studies that are theoretically informed
  • Use a systematic procedure
  • Use approved methods and techniques
  • Documented in a way that allows others to assess the findings
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is fundamental scientific research?

A

Studies that are aimed at gaining knowledge.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is applied scientific research?

A

Studies that are aimed at the use of knowledge to change or improve situations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Describe qualitative research?

A
  • Inductive process
  • Literature to get a better understanding and discover theoretical concepts
  • Data collection semi-structured
  • Small research sample, intensively studied
  • Data analysis search common themes and regularities, interviews and observation
  • Results descriptions using theoretical concepts to interpret the data
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Describe quantitative study?

A
  • Literature used to deduce hypotheses, to test theoretical concepts
  • Observations are made on a larger number of cases, by means of standardized measures
  • Results are reached by working with number
  • Statistical test are used to determine test the hypotheses
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What kind of research is UCD?

A

UCD implies applied research.
Studies that are aimed at the use of knowledge to change or improve situations.
The goal is to improve UX, not build a theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Is a UCD quantitative or qualitative?

A

UCD processes may be quantitative or qualitative, but they are mostly quantitative.

The qualitative part is doing interviews to determine the user requirements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Describe how to do an interview, name 4 things?

A
  • Start by explaining your idea
  • Ask what they think about it, and what their needs and wishes are.
  • Ask open-ended questions that can elicit thoughtful answers about the participant’s experience.
  • Initial frameworks for opening the interview conversation rather than recipes to follow.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What steps to follows to prepare an interview?

A
  1. Decide on the topics, research questions
  2. Group block of questions
  3. Organize them into a logical sequence, but don’t impose this order
  • It reminds you of the topics and questions that matter
  • It focuses on data collection
  • It will help you in your analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How are user requirements defined?

A

Based on the results of the interviews, you formulte user requirements. You convert the users’ requests, comments, remarks, observed behaviours, etc. into a list of meaningful needs and wishes.
The user needs…
The user wishes…

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are functional requirements and how are they determined?

A

The funtioncal requirements are based on the user requiremetns. Funtional requirements are specifications of the user documentation you are going to design.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are important things to keep in mind when interviewing?

A
  • Be kind to interviewees, they are helping you.
  • Introduce yourself and the interview purpose
  • Inform them before the interview that their data will be confidential and anonymous
  • If you’d like to make recordings, ask for permission
  • Give them your email address, so they can contact you if they have any questions.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are some example of empirical data?

A

Stories told by participants, quotes, observations, photographs, case descriptions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What does qualitative data reflect?

A

Qualitative data reflects peoples experiences of daily life. By studying the data social scientists are able to understand aspects of the social world.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Why is qualitative data not an exact representation of life experiences?

A
  • These data are the result of an interaction between the participant and the researcher
  • These data depends on the participants’ ability to reflectively distinguish aspects of their own thought, idea, observations and experiences and to effectively communicate what they perceive through language
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is the goal of interviews?

A

The goal is to see a slice of social world from the particitant’s perspective and the interviewer is mearely facilitating the process. Interviewing is a demanding enterprise dor researchers, as they have to decide on the spot which questions to ask, how to formulate them and in which order they should be posed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

How can raw data be prepared for analysis?

A
  1. Store the different data files so that they can easily be retrieved.
  2. Transcribe the audio sources, this means that the data are altered, some information is lost.
  3. Take out all information that can identify participants and violate the promises of anonymity and confidentiality.
  4. Prepare the data so that they can be processed.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

How should the data be prepared?

A
  • Listen to the data and read the notes that you took during the interview
  • Transcribe the interviews, you don’t have to transcribe the whole interview, but you should transcribe the “important parts”, parts that might result in a user requirement
  • Analyze the transcribed parts and formulate preliminary user requirements
  • Categorize these preliminary requirements, group, regroup
  • Discuss which requirements are important, which are less important
  • Discuss contradictory requirements, take a decision
  • Formulate the final user requirements
  • Based on the user requirements, formulate functional requirements
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is the difference between user requirements and functional requirements?

A

User requirements: the users’ needs and wishes.

Funtional requirements: specifications of the app / user documentation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Name 5 categories on which requirements can be formulated?

A
  • Content
  • Structure
  • Lay-out
  • Modality
  • Style
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What are research/tools that should be used before development?

A
  • Market research
  • Internal information
  • Site visits / contextual inquiry
  • Affinity diagramming, it is a technique for organizing fidnings into grouping and then assigning labels to each group.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What is a user profile?

A

Conceptual model of the target group that helps the developers of a technology focus on the users.
A repository used to categorize, characterize and prioritize a technology’s target groups, often represented as a table of descriptors.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is a user persona?

A

A fictional and super-typical characterization of a user created to represent a user group.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What are the three ideas about expert-focused evaluation vs. user-focused?

A

Expert-focused evaluation: an evaluation by people with expert-knowledge or peers.
User-focused evaluation: an evaluation by potential users.

  1. potentially equivalent competitors
  2. Different objectives, complementary methods
  3. Expert-focused mainly targets “low hanging fruit”
    Can increase the effectiveness of the user-evaluation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What is the signal detection theory?

A

Can help you figure out which problems are the most important when improving the prototype of a technology

User + Expert problem HIT
User problem, Expert no problem MISS
User no problem, Expert problem FALSE ALARM
User + Expert no problem CORRECT REJECTION

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What is the difference between unguided and guided expert evaluation?

A

Experts judge product/user support in a self-chosen process, using their own criteria, solely based on their expertise.
Experts evaluate the product/user support using a set of evaluation criteria or design guidelines. Also called heuristic evaluation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What can be the downsides of an unguided expert review?

A
  • Results may be far removed from user experiences.
    Many user problems may be overlooked.
    Many problems mentioned do not match with reader problems.
  • Experts often disagree, with little overlap between experts.
34
Q

How to do guided expert evaluation: heuristic evaluation?

A

The set of evaluation criteria or design guidelines may be available in the literature or may be developed by the team.
The set of evaluation criteria or design guidelines may focus on specific aspects or may be comprehensive.

35
Q

Name 10 usability heuristics?

A
  1. Visibility of system status
  2. Match between system and the real world
  3. User control and freedom
  4. Consistency and standards
  5. Error prevention
  6. Recognition rather then recall
  7. Flexibility and efficiency of use
  8. Aesthetic and minimilist design
  9. Helps users recognise, diagnose, and recover from errors
  10. Help and documentation
36
Q

What are the advantages of usability heuristics?

A
  • Complements experts’ personal expertise and knowledge
  • Provides a structure for the evaluation
  • Specific aspects of the product/user support can be addressed
  • Makes discussion of problems and features easier
  • Many resources are available
37
Q

What is scenario evaluation in guided expert evaluation?

A
  • They are assumed to follow the scenarios and take notes on all potential problems that they encounter
  • The scenarios represent a range of realistic usage of the product/user support
  • The scenarios may also contain possible characteristics of the users
38
Q

What are the advantages of scenario evaluation in guided expert evaluation?

A
  • Focusses the experts’ attention to the needs of users
  • Prevents a superficial review mode
  • Enhances empathy with users by taking the perspective of the user, drawing attention to users and their shortcomings, having experts experience problems themselves
39
Q

What are human rights?

A

Safety, trust and confidentiality.

40
Q

What are the risks and benefits to ethics in research?

A

Risks

  • Dragging it all up
  • Exploitation
  • Coercion
  • Sanctions

Benefits

  • Feeling relieved
  • Being a worthwhile participant
  • Helping others
  • Benefits in institutional research
41
Q

What are the 4 considerations of ethics in research?

A

Informed consent

  • Outline the nature of the data collection
  • Make participants aware of the situation
  • Use an “informed consent form” and if needed an information brochure

Privacy, confidentiality & anonymity

  • Participants should be in control of the information that they give about themselves
  • Make sure that participants can’t be identified through the data

Data storage

  • Make sure the collected data is stored safely and securely
  • Make sure that you are in control over where your data is stored
  • Avoid using unsecured data transferring methods

Ethics committee
All research with humans participants should be submitted for ethical assessment.

42
Q

What is data anonymizing?

A

Remove all names from the data.

Remove any information by which a participant could be identified

43
Q

What is impartial analysis?

A

Seperate your own opinions and need from the research, analyzing data in a neutral way ensures the validity of the research.

44
Q

What is user-focused evaluation, its goal and what kind of methods are used?

A

An evaluation by potential users.

  • Goal: collect feedback in order to formulate improvements or recommendations
  • Includes a broad range of issues, including usability and UX
  • Usually based on a combination of qualitative methods
45
Q

How is user-focused evaluation structured?

A
  1. Introduction of the study
  2. Participants are given specific tasks, while working with the product or user support
  3. Feedback is gathered from participants using specific methods(s)
  4. Debriefing of the study
46
Q

What are the differences between the in-use vs. non-use methods?

A

in-use OBSERVATION

  • Methods to collect realistic data under close-to-normal usage conditions
  • Good for testing comprehension and usability

non-use ASKING QUESTIONS

  • Methods assume that participants imagine using product or user support
  • Good for testing appreciation and user experience

Combining both types of methods could be useful.

47
Q

What are the differences between concurrent vs. retrospective?

A

Concurrent methods: data collection during usage
Example: think-aloud testing
Risks: reactivity, incomplete data

Retrospective methods: data collection after usage
Example: interviews, retrospective think-aloud testing
Risks: memory bias

48
Q

Name four types of bias that can occur with retrospective methods?

A

Rosy retrospection,
the tendency to rate past events more positively than they had actually rated when the event occurred.

Self-serving bias,
perceiving oneself responsible for desirable outcomes but not responsible for undesirable ones.

Egocentric bias,
recalling the past in a self-serving manner, e.g. remembering one’s exam grades as being better than they were, or remembering a caught fish as being bigger than it was.

Hindsight bias,
Filtering memory of past events through present knowledge so that those events look more predictable than they actually were; also known as the ‘I-knew-it-all-along-effect”.

49
Q

What are observations, what to keep in mind when conducting them?

A

Participants perform tasks with product or user support, while a researcher takse notes on their perfromance.

  • Allows participants to focus purely on the task, which makes for a more realistic scenario
  • Does not provide in-depth information, unless combined with other methods

Data: process data and notes
Process: task execution and task success

50
Q

How are tasks defined within user-focused evaluation?

A

First participants are given specific tasks involving using the product and user support.
Make sure that:
- Tasks depict a realistic usage scenario
- Tasks are manageable within a short amount of time
- The combination of tasks adequately test the different elements of both the product and the user support

Methods to collect data in this phase: observation with or without think-aloud testing.

51
Q

What should be done after tasks have been performed in a user-focused evaluation?

A

After the tasks have been performed, some scientific methods can be used in order to collect more data:

  • The experience that the participants had of using the product or user support
  • The problem that the participants encounter during the tasks

ASKING QUESTIONS

52
Q

What are the different types of think around research methods?

A

Concurrent think-aloud testing: participants perform tasks with the product and are asked to think aloud while working on the tasks.

  • Facilitator prompts the user to keep on thinking aloud
  • Recordings are mode
  • A researcher can take additional notes if needed

Retrospective think-aloud testing: Participants perform tasks silently, and afterwards comment on their work on the basis of a recording of their performance

  • Participants are presented with a recording of the execution of their tasks and are asked to think aloud while watching it
  • Allows participants to focus more on the tasks while performing them, at the risk of memory bias
53
Q

What does a facilitator do during think-aloud testing?

A
  • Just prompting

- Interact with the participant, only if necessary

54
Q

What is considered to be the data generated by think-aloud methods?

A

Process data and verbalizations

55
Q

What are some less strict think-aloud methods?

A

Constructive interaction: two participants work together in performing their tasks, thereby verbalizing their thoughts through interacting, they are assumed to collaborate.
Coaching method: also in pairs, but now one of the two users is a researcher, who leaves the initiative to the real participant, and answers questions to the best of his/her knowledge.
Cooperative facilitator: same as other think-aloud methods, but the facilitator is more actively present
- Active listening behaviour
- Asking an open-ended question
- Helping participants when they cannot proceed

56
Q

Name an advantage and disadvantage of the cooperative facilitator method?

A

Advantage: more natural situation
disadvantage: clear guidelines for facilitator behaviour are lacking

57
Q

Compare the three different types of less strict think-aloud methods.

A
  • No difference in quantity and relevance of problems detected
  • Concurrent think-aloud results in more problems detected by means of observation only, while retrospective think-aloud results in more problems detected by means of verbalization only.
  • Constructive interaction takes more time to finish the tasks
  • No difference in the successfulness of task completion
  • Constructive interaction is evaluated more positively by participants
58
Q

Name two tracking based usability testing?

A

Eye-tracking: in-use method, participants’ eye movement are measured
Mouse-tracking: in-use method, participants’ mouse movements are measured

59
Q

Compare think-aloud with eye-tracking?

A

Silences most often occurred at moments that participants were scanning pages for information. Apparently, scanning is a quick and cognitive complex task that is difficult to verbalize. Participants seem to stop verbalizing their thoughts at that time to reduce the cognitive load.

60
Q

Describe interviews usability testing method?

A

Non-use method, participants answer in-depth questions about the designed product. Data: verbalizations.

  • Can provide many details on experiences, encountered problems, and how to improve the product.
  • Flexible in terms of structure.
  • Easy to combine with other methods often combined with think-aloud

Timing of the interview questions, participants answer in-depth questions about the designed product after the participant has finished all tasks or after each task.

61
Q

Describe a focus group or group interview, name 5 points to note about focus groups?

A

Non-use method, participants are put in groups and have an in-depth discussion about a designed product or prototype.

  • Participants share their opinion and experiences, but also listen to other participants
  • Together, participants can come up with creative solutions
  • Requires careful facilitation of the discussion
  • Data: outcomes of the discussion

requires a minimum of 5 participants per group

62
Q

What are product reaction cards?

A

A participant selects cards from the deck of 118 words/phrases spread out on a table. The product reaction cards are placed at random on a table for use at the end of the test session.

63
Q

What are measuring emotions?

A

Lots of different emotions are illustrated, where the participant can choose from.

64
Q

Describe the plus-minus method?

A

Mostly non-use method, participants read a document or look at a website and put plusses and minuses in the document/website, indicating positive and negative experiences.

  • Does not require a product to be used
  • Does not prove enough information by itself
  • Should be combined with an interview, focus on the reasons behind every plus and minus, what causes the problem, the exact location of the problem, how to solve it?
65
Q

How can surveys be used in usability testing?

A

Participants rate the product or user support based on a system usability scale.

66
Q

Describe the 8 steps of testing planning?

A
  1. Establish test goals
  2. Determine how to test the product
  3. Agree on user subgroups
  4. Determine participants incentives
  5. Draft screeners for recruiting participants
  6. Create scenarios based on tasks that match test goals
  7. Determine quantitative and qualitative feedback methods
  8. Set dates for testing and deliverables
67
Q

What is the most important for test preparation?

A

Good tasks/scenarios
Good participants
Good moderations
Good note-taking

68
Q

Describe the 10 steps of test preparing?

A
  1. Recruit participants
  2. Assigning team roles and responsibilities
  3. Developing checklists for hey team roles
  4. Writing the moderator’s scripts
  5. Preparing or using other forms
  6. Creating questionnaires
  7. Using standard posttest questionnaires
  8. Creating or using qualitative feedback methods
  9. Testing the test
  10. Manging all these test preparations
69
Q

What kind of data does qualitative and quantitative generate?

A

Qualitative: verbalizations, noted, recordings, etc.
Quantitative: task completion times, number of errors mode, etc.

70
Q

What is the main problem, solution when it comes to think-aloud and interviews?

A

Recodings/transcripts of think-aloud methods and interviews are quite large and unorganized.

  • Makes the analysis structured and reliable
  • Allows you to identify topics within the data
  • Makes general themes and patterns more apparent
71
Q

What is segmenting?

A

First, transcribe all qualitative data, then divide your transcripts into relevant segments

  • Can be part of a sentence, or multiple sentences combined
  • A segment should be a meaningful whole, mainly deals with one subject
  • A segment should be relevant to the research, off-topic remarks may be excluded
72
Q

What is coding?

A

Coding concerns detinguishing themes or catagories in the data and namung segments of data by attributing a code.

73
Q

Code =?

How to make codes?

A

A label that describes the core topic of a segment.

  • Go through your segments
  • Assign one or multiple codes to each segment
  • Continue until all segments have at least a code assigned

This results in a coding scheme, list of codes.

74
Q

What is a coding scheme?

A

An overview of all codes, including descriptions, may include a hierarchy with higher-level codes and sub-codes.

75
Q

What is the inductive vs. deductive approach in coding?

A

Inductive focuses on developing new concepts.
Open coding: defining codes as you go through the transcripts, based on observed themes.

Deductive uses existing concepts.
The coding scheme is made before going through the transcripts, based on existing concepts from literature.

A combination of both can be possible.

76
Q

How to make the coding more reliable?

A

Interrater reliability
Coding process:
- A portion of the data is coded by two or more researchers, independently
- Differences between coding are discussed, after which an updated coding scheme is created
- All of the segmented data is coded by one researcher
- Codes are reevaluated and rearranged, axial

77
Q

What is interrater reliability?

A

The extent to which two indepentent coders agree with each other on the same portion of text.

  • Two researchers code the same portion of the transcript, using the same coding scheme
  • Codes of the two different researchers are compared
  • Differences between cosing are discussed
  • Coding scheme is adapted accordingly
78
Q

What are other approached to improve interrater reliability?

A

Percentage of agreement in coding, amount of similar codes/total amount of codes.

Cohen’s Kappa
The coefficient for interrater reliability
Takes chance into account

79
Q

What is axial coding?

A

Put the codes in to categories, too better organize data.

In usability testing this is not necessary, the the amount of data is small.

80
Q

What is selective coding?

A

Find relation between categories if there are any.

Exams (3 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions