Ch 6: Collecting, Analyzing and Feeding Back Diagnostic Info Flashcards
What are the methods of collecting data?
Surveys and questionnaires
Interviews
Observations
Unobtrusive measures
Adv and Dis of questionnaires
ADV
Member beliefs and attitudes can be quantified easily
Can gather a large amount of data from many people
Inexpensive on a per-person basis
DIS
Relatively impersonal
Mechanistic and rigid—assumes all
the right questions are asked
Easy to “over interpret” the data
Response bias
Adv and Dis of Interviews
ADV
Very flexible—can adapt to the interviewee and data collection subject
Data is “rich”
The interview process builds rapport and empathy
DIS
Relatively expensive
Interviewer responses can be biased
Difficult to code and interpret
Self-report bias- the tendency to try to make a good impression of them. Or can occur when unsure of how to answer a question.
Observations Adv and Dis
ADV
Collects data on actual behavior, rather than reports of behavior
Real time, not retrospective
Adaptive and objective
DIS
Difficult to code and interpret
Sampling may be inconsistent- get this
Observer bias and reliability can be
questioned
Can be expensive
Unobtrusive
measures adv and dis
adv
No response bias
High face validity
Easily quantified
dis
Privacy, access, and retrieval difficulties
Validity concerns
Difficult to code and interpret (in context of org.)- get this
What are the two issues in sampling?
Sample design: Size. Note Larger pop=more difficult to get right size. Larger pop. also = more confidence in quality of data
Sample selection: How sample is selected (random, stratified random for complex population/subsets need to be represented)
What are the qualitative methods in Analysing data?
Content Analysis: specially used for interviews- attempts to summarize data into meaningful categories
Force-field Analysis: Groupd info into 2 categories, forces for change and forces against
What are the steps in content analysis
Read comments to understnd comment range
Based on comments generate themes/categories that capture repeated responses
Fill in each response into each category
Categories with most responses are often those that are mentioned
Steps in force-field analysis
Use data collected and determine forces that are for/against change
Then based on OD or member view, determine the most powerful positive and negative forces
You can rank in order as they come or by strength
What are the 3 qualitative tools for analysis
- Means (average scores), SD(spread of responses) and FD(how often certain response is given)
- Scattergrams(relationship between 2 variables) and Correlation Coefficients (number that summarizes scatter plot data- range from -1 to +1)
- Difference Tests: used to compare sample groups against some standard. Can also be used to see whether two samples are different from each other in relation to one variable- like job satisfaction(variable) between departments
What are the nine characteristics of good content of feedback
Relevant- useful
Understandable- readily interpreted
Descriptive- good examples and detailed illustrations
Verifiable- accurate.valid
Timely- asap
Limited- don’t overload- give what can be realistically processed at one time
Significant- limit to what people can actually work on
Comparative- have comparisons so they can see how their group fits in /measures up in a larger context
Unfinalized- data should lead to further discussion, not be the end all
What are the 5 characteristics that aid ownership of feedback data?
Motivation to work with data
Structure for meeting
Appropriate attendance
Appropriate power
Process help
Survey Feedback process:
members in org plan the survey-
The survey instrument is administered to all members of the organization or work
group.
The OD practitioner usually analyzes the survey data, tabulates the results, suggests
approaches to diagnosis, and trains client members to lead the feedback process
.
Data feedback usually begins at the top of the organization and cascades downward
to groups reporting to managers at successively lower levels.
. Feedback meetings provide an opportunity to work with the data.
What are the 4 limitations related to survey feedback?
- Ambiguity of purpose
- Dustrust
- Unacceptable Topics
- Org. Disturbance