Lecture 5-Data Collection

Question 1

What are the five key issues to to collecting data?

Answer 1

1.Setting goals: goals will influence how you gather data.
2.Identifying participants/the study population : the more participants the better statistical results can be stated in confidence.
3.Relationship with participants
4.Triangulation : look at data from more than one perspective
5.Pilot studies : make sure proposed method is viable before doing the real study.

Question 2

What is the definition of saturation?

Answer 2

Collect data until no relevant information emerges.

Question 3

What are the 3 types of population sampling?

Answer 3

-Saturation sampling : all members of target population are accessible. RARE
-Random sampling : choose participants at random
-Stratified sampling: divide population into groups then apply random sampling.

Question 4

What is methodological triangulation?

Answer 4

Collect more than one type of data like qualitative data from experiments and qualitative data from interviews.

Question 5

What is triangulation of data?

Answer 5

Drawn form different sources at different times, place, different people, different sampling…

Question 6

What is the triangulation of theories?

Answer 6

Use different theoretical frameworks through with to view data or findings.

Question 7

Why do we triangulate?

Answer 7

-Can use qualitative and quantitative methods in juxtaposition with each other.
-Ensures a stable and solid research design

Question 8

What are examples of data recording ?

Answer 8

-Notes & photographs: least technical but most flexible
-Audios & photographs: less intrusive than video
-Videos : easy to use

Question 9

What are the two types of interview questions?

Answer 9

-Closed questions: have a predetermined answer format like yes or no.EASIER TO ANALYZE
-Open questions: do not have a predetermined format

Question 10

What are the four types of interviews?

Answer 10

-Unstructured
-Structured
-Semi-structured
-Focus groups

Question 11

Describe unstructured interviews

Answer 11

-Similar to conversations
-Open questions
-Rich data
-Deep understanding of topic
-Time consuming to analyze

Question 12

Describe structured interviews

Answer 12

-Closed questions
-Same questions used with each participant
-Useful when goals are clearly understood and specific questions can be identified.

Question 13

Describe semi-structured interviews

Answer 13

-Open and closed questions
-Same topic is covered for each participant but then probes the interviewee to say more

Question 14

Describe focus groups interviews

Answer 14

-Group interview
-Discussed led by trained facilitator
-Preset agenda with flexibility
-THEY DONT WORK LMAO

Question 15

What questions to avoid in interviews? (4)

Answer 15

-Long questions
-Compound sentences
-Hard language
-Leading questions that make assumptions

Question 16

What are the 5 parts of an interview?

Answer 16

-Introduction
-Warm-up : easy questions
-Main body:logical order
-A cool-off period: easy questions
-Closure

Question 17

Interviews summary: What are the advantages (3) and disadvantages (2) of it?

Answer 17

Advantages :
-Can be varied to suit context
-Issues can be explored more fully
-Can elicit user views and identify unanticipated problems

Disadvantages:
-Very subjective
-Time consuming

Question 18

What are two examples of questionnaire formats?

Answer 18

-Likert scales
-Semantic scales

Question 19

What are likert scales?

Answer 19

-Used for measuring opinions, attitudes, beliefs…
-Ideally 5-7 balanced responses people can choose from.
-Often has a neutral midpoint

Question 20

What are semantic differential scales?

Answer 20

-Designed to measure the connotative meaning of objects, events, and concepts
-People are asked to choose where his or her position lies on a scale between two polar adjectives.

Question 21

What are advantages(2) and disadvantages(2) of online questionnaires?

Answer 21

Advantages :
-Easy and quick to distribute
-Time required for data analysis is reduced

Disadvantages:
-Sampling problematic if population size is unknown
-cant prevent people from responding more than once

Question 22

Questionnaires summary: What are the advantages (2) and disadvantages (2) of it?

Answer 22

Advantages:
-Quick and reaches large user group
-Can be analyzed more rigorously

Disadvantages:
-Less flexible
-Less probing

Question 23

Why is direct observation in the field used?

Answer 23

-As designer hard to get a full true story just from interviews or questionnnaires
-BUT can be complicated and harder to do, may result in a lot of data

Question 24

What are the 3 part of structuring frameworks to guide observation? (PPT)

Answer 24

-Person : who is using the technology at any particular time?
-Place : where are they using it?
-Thing: what are they doing with it?

Question 25

What is ethnography?

Answer 25

It’s a philosophy with a set of techniques that include participant observation and interviews.
-Collection of comments, incidents, and artifacts are made

Question 26

Why is direct observation in controlled environment used?

Answer 26

-More formal than in the field, user may feel more apprehensive
-Can have different data recording techniques

Question 27

What is Think Aloud?

Answer 27

-User observed performing task
-User asked to describe what he is doing and why, etc.

Question 28

Think aloud : What are the advantages (3) and disadvantages (2) of it?

Answer 28

Advantages :
-Simplicity
-Can provide useful insight
-Can show how system is actually use

Disadvantages:
-Subjective
-Selective

Question 29

Why is indirect observation used?

Answer 29

-When direct observation not possible because (1) too intrusive (2) observers can’t be present.

Question 30

What are examples of indirect observation? (3)

Answer 30

-Diaries
-Interaction logging
-Video and photographs collected by equipment