Week 5 and 6 Flashcards
Research question development framework
Spider question framework
PEO Question Framework
Good survey questions
▪ Measures the concept it is trying to examine
▪ Doesn’t measure irrelevant concepts
▪ Means the same thing to all participants
▪ Example: In general, how would you rate your health?
▪ Excellent
▪ Very Good
▪ Good
▪ Fair
▪ Poor
General rules for writing survey question
Avoid technical terms and jargon
Avoid vague or imprecise terms
▪ Example: How important is it to you that your supervisor meets with your regularly?
Define things very specifically
Avoid complex sentences:
Provide reference frames:
▪ Example: How supported do you feel by your supervisor?
▪ How supported have you felt by your supervisor in the past week?
Make sure scales are ordinal
▪ Example: All the time, some of the time, most of the time, half of the time, none of the time
Avoid double barrelled questions – Questions need to measure ONE thing.
▪ Example: Does your supervisor provide you with written and verbal feedback?
Responses should anticipate all possibilities
▪ Include an other, please specify category
Make sure your responses are unique
▪ Example: 0-4 hours, 5-9 hours, 10-14 hours, 15-19 hours, 20+ hours
Avoid questions using leading, emotional or evocative language
▪ Example: Do you support the use of student evaluation forms for supervisors to ensure that
terrible supervisors are not allowed to supervise students ever again?
survey question types
survey question types
5 types
Tips for questions
▪ Make sure you have clear instructions at the start of your survey/questionnaire
▪ How will you administer the survey/questionnaire?
▪ Facebook/Twitter
▪ Email
▪ Hard copy in person
▪ Mail
▪ Phone
▪ If administering survey over the phone – limit the number of questions and the
response options
▪ Pilot your questions!
▪ Do not develop them on your own!
Interviews
Advantages
▪ In-depth
▪ Semi-structured
▪ Key Stakeholder
▪ Narrative
▪ Life History
▪ Dyad
▪ Think aloud
Why use interview?
To increase rapport with participants
▪ Face-to-face contact
Provides support to participants
▪ Direct – “No-one has ever talked to me about this before”
▪ Indirect – through provision of feed-back, referral…
Increases response rate
Allows immediate clarification of your interpretation
▪ Increases validity of your data
Interview guides- what is the purpose of?
▪ Useful in structured and semi-structured
interviews
▪ May provide suggestions of prompts
▪ Allow for flexibility
▪ You may need to follow-up information that is given, yet
that you have not considered previously
▪ Allows researcher to pursue new avenues
of enquiry, based upon the responses given
Interview questions
Use—- question
Don’t use —-
Interview tips
✓Build rapport, allocate time to chat and build rapport
✓LISTEN, express interest
✓Encourage participant to expand - give more details
e.g. Can you tell me more about that?
✓Let responses guide the direction - keep within topics of interest
✓Use participant’s language – reflect it back
✓80% of interview must be participant
✓Avoid excessive use of ‘why’
Stages of interview
▪ Stage 1. Arrival and introduction
▪ Establish rapport
▪ Stage 2. Introducing the research
▪ Scope of interview but emphasise the ‘openness of responses’
▪ Stage 3. Beginning the interview
▪ Provide some context
▪ Stage 4. During the interview
▪ Use semi structured approach to make sure you cover the areas needed
▪ Stage 5. Ending the interview
▪ Give some advice ‘almost at end’ and then end positively
▪ Stage 6. After the interview
▪ Thanks for participation and the value they have provided.
▪ Provide them ongoing contacts, in case there are concerns
focus groups and co-design workshops
Advantages
▪ Group interactions brings out different data (experiences/perspectives) to
individual interviews
▪ Exploratory – little known about participants or topic
▪ Testing ideas e.g. acceptability of a new program
▪ Evaluations
▪ Multi-method studies – triangulation
▪ Co-design
focus groups and co-design activities
-Q-sorting or Card Sorting:
Participants categorize or rank cards representing concepts, revealing patterns or priorities.
River of Life: Participants visualize life experiences along a river, sharing narratives on challenges and aspirations.
Listing, Rating, Ranking: Participants generate lists, rate, or rank items, prioritizing ideas or identifying consensus.
Sentence Completion: Participants complete prompts, expressing thoughts and experiences freely.
Collages: Participants create visual representations using images, words, or symbols to convey perspectives creatively.
focus group tips
All will have a perspective on this topic
▪ All ideas are valid, may be different from each other
▪ No judgement/ no personal attacks from anyone please
▪ Healthy discussion and different views welcome
▪ We want to hear from each of you
▪ Might be asked directly for a response
▪ May be asked not to answer next
▪ Please no talking over anyone else
Participant observation
Data management
“Research Data Management covers all of the decisions made during the research lifecycle to
handle research data, from the planning stage of your project up to the long-term preservation
of your data.” (University College London, Research Data Policy)
◦ Where is your data stored?
◦ How will it be analysed?
◦ Who will have access to the data?
◦ What are the requirements for sharing data?
◦ What quality checks will you conduct?
Research data
“Data are facts, observations or experiences on which an argument or theory is constructed or
tested. Data may be numerical, descriptive, aural or visual. Data may be raw, abstracted or
analysed, experimental or observational. Data include but are not limited to: laboratory
notebooks; field notebooks; primary research data (including research data in hardcopy or in
computer readable form); questionnaires; audiotapes; videotapes; models; photographs; films;
test responses. Research collections may include slides; artefacts; specimens; samples.”
(University College London, Research Data Policy)
Data entry and coding
Store
Closed ended Q
Database to store the data e.g. Excel or REDCapTM – secure server, password protection
Data storage for returned surveys (locked cabinet)
Values to be entered for close-ended questions e.g. 1, 2, 3 vs A, B, C
Set up data dictionary
Data coding
Examples of data coding:
◦ Assigning a number to a group of objects
→ use an unique number for categories
0 = No, 1 = Yes
0 = female, 1 = male
0 = <30 years; 1 = 30 – 39 years; 2 = >40 years
Data management For Qualitative data
Privacy
Remove identifiable information from file names and documents.
Have a spreadsheet with identifiable information that is password protected and saved in a
different location
Data Verification
Sources of error how to manage
Sources of error
◦ Data entry mistakes
◦ Data omissions
◦ Data errors
Mitigate errors
◦ Internal system checks e.g. permissible values
◦ Data integrity checks e.g. audit data (Data Integrity is the accuracy, completeness, and consistency of data throughout its lifecycle)
◦ Third party verification e.g. compared to admissions data