Critical Evaluation Flashcards
Data Advocacy
Developing an inquiring mindset, learning what data drives the business and where it can be found, developing parternships across the orgz to promote EBDM.
Data Gathering
Knowing what constitues sufficient, credible, and objective evidence and being able to find it.
Data Analysis
Being able to organize data so that it reveals patterns and to analyze it to detect logical relationships.
Steps in EBDM
Being able to apply the results of data gathering and analysis to make better business decisions.
Ask Acquire Appraise Aggregate Apply Assess
Advantages and Challenges to Interviews
Advantages: safer, confidential, comments can suggest direction for futher group research.
Challenges: time sensitive, need strong relationship building skills, requires vigilence to avoid bias
Advantages and Challenges to Focus Groups
*A structured discussion with a facilitator and group:
Advantages: flexible and comfortable for discussion, group brainstorming, learn about EE needs.
Challenges: fosters ‘group think’, participants can go off on tangent, no deep discussion
Focus Group Tools ‘Mind Mapping/Affinity Diagramming’
Mind Mapping: Begins the discussion with core ideas, group members add related ideas and indicate logical connections, eventually grouping similar ideas.
Affinity Diagramming: Affinity is a way of sorting a large amount of data that has already been collected, data is categorized until relationships are clearly drawn.
Focus Group Tools ‘Nominal Group Technique’
Rounds in which participants each suggest ideas, the rounds continue until no further ideas are proposed. Then redundancies are removed.
Focus Group Tools ‘Delphi Technique’
Progressively collects information from a group on a preselected issue, the first respondent proposes information, the next person adds something different, and so on, until a list is compiled.
People are anonymous
2nd round the reasearcher circulates the list and asks each respondent to refine previous ideas.
Surveys and Questionnaires as Data Source
- Obtaining a valid sample
- Designing the survey with analysis in mind (to compile and compare responses easier)
- Asking the right questions
Advantages and Challenges to Surveys/Questionnaire
Advantages: efficient, easy to quantify data
Disadvantages: obtain an acceptable response rate, follow up on anonymous data, time and statistical expertise
Reliabiltiy
Ability of a data gathering instrument or tool, such as a survey, to provide results that are consistent.
Validity
Ability of an instrument to measure what it is intended to measure.
Statistical Sampling
Often used when the population to be analyzed is verly large or when data cannot be obtained from the entire population.
The sample must be representative, it must reflect key characteristics of the enitre population being studied.
Median
The middle value in the range of values