Lecture 5-Data Collection Flashcards
What are the five key issues to to collecting data?
1.Setting goals: goals will influence how you gather data.
2.Identifying participants/the study population : the more participants the better statistical results can be stated in confidence.
3.Relationship with participants
4.Triangulation : look at data from more than one perspective
5.Pilot studies : make sure proposed method is viable before doing the real study.
What is the definition of saturation?
Collect data until no relevant information emerges.
What are the 3 types of population sampling?
-Saturation sampling : all members of target population are accessible. RARE
-Random sampling : choose participants at random
-Stratified sampling: divide population into groups then apply random sampling.
What is methodological triangulation?
Collect more than one type of data like qualitative data from experiments and qualitative data from interviews.
What is triangulation of data?
Drawn form different sources at different times, place, different people, different sampling…
What is the triangulation of theories?
Use different theoretical frameworks through with to view data or findings.
Why do we triangulate?
-Can use qualitative and quantitative methods in juxtaposition with each other.
-Ensures a stable and solid research design
What are examples of data recording ?
-Notes & photographs: least technical but most flexible
-Audios & photographs: less intrusive than video
-Videos : easy to use
What are the two types of interview questions?
-Closed questions: have a predetermined answer format like yes or no.EASIER TO ANALYZE
-Open questions: do not have a predetermined format
What are the four types of interviews?
-Unstructured
-Structured
-Semi-structured
-Focus groups
Describe unstructured interviews
-Similar to conversations
-Open questions
-Rich data
-Deep understanding of topic
-Time consuming to analyze
Describe structured interviews
-Closed questions
-Same questions used with each participant
-Useful when goals are clearly understood and specific questions can be identified.
Describe semi-structured interviews
-Open and closed questions
-Same topic is covered for each participant but then probes the interviewee to say more
Describe focus groups interviews
-Group interview
-Discussed led by trained facilitator
-Preset agenda with flexibility
-THEY DONT WORK LMAO
What questions to avoid in interviews? (4)
-Long questions
-Compound sentences
-Hard language
-Leading questions that make assumptions
What are the 5 parts of an interview?
-Introduction
-Warm-up : easy questions
-Main body:logical order
-A cool-off period: easy questions
-Closure
Interviews summary: What are the advantages (3) and disadvantages (2) of it?
Advantages :
-Can be varied to suit context
-Issues can be explored more fully
-Can elicit user views and identify unanticipated problems
Disadvantages:
-Very subjective
-Time consuming
What are two examples of questionnaire formats?
-Likert scales
-Semantic scales
What are likert scales?
-Used for measuring opinions, attitudes, beliefs…
-Ideally 5-7 balanced responses people can choose from.
-Often has a neutral midpoint
What are semantic differential scales?
-Designed to measure the connotative meaning of objects, events, and concepts
-People are asked to choose where his or her position lies on a scale between two polar adjectives.
What are advantages(2) and disadvantages(2) of online questionnaires?
Advantages :
-Easy and quick to distribute
-Time required for data analysis is reduced
Disadvantages:
-Sampling problematic if population size is unknown
-cant prevent people from responding more than once
Questionnaires summary: What are the advantages (2) and disadvantages (2) of it?
Advantages:
-Quick and reaches large user group
-Can be analyzed more rigorously
Disadvantages:
-Less flexible
-Less probing
Why is direct observation in the field used?
-As designer hard to get a full true story just from interviews or questionnnaires
-BUT can be complicated and harder to do, may result in a lot of data
What are the 3 part of structuring frameworks to guide observation? (PPT)
-Person : who is using the technology at any particular time?
-Place : where are they using it?
-Thing: what are they doing with it?
What is ethnography?
It’s a philosophy with a set of techniques that include participant observation and interviews.
-Collection of comments, incidents, and artifacts are made
Why is direct observation in controlled environment used?
-More formal than in the field, user may feel more apprehensive
-Can have different data recording techniques
What is Think Aloud?
-User observed performing task
-User asked to describe what he is doing and why, etc.
Think aloud : What are the advantages (3) and disadvantages (2) of it?
Advantages :
-Simplicity
-Can provide useful insight
-Can show how system is actually use
Disadvantages:
-Subjective
-Selective
Why is indirect observation used?
-When direct observation not possible because (1) too intrusive (2) observers can’t be present.
What are examples of indirect observation? (3)
-Diaries
-Interaction logging
-Video and photographs collected by equipment
