Critical Evaluation Flashcards
Statistical method that examines data from different points in time to determine if a variance is an isolated event or if it is part of a longer trend.
Trend analysis

- Trend analysis describes patterns in the past and projects future conditions based on those patterns.*
- For example, HR can see when declines in certain types of degrees will become problematic for the organization and require a strategic response.*
Value that occurs most frequently in a set of data.

Mode
Technique in which participants each suggest ideas through a series of rounds and then discuss the items, eliminate redundancies and irrelevancies, and agree on the importance of the remaining items.

Nominal group technique (NGT)
Average of data that adds factors to reflect the importance of different values.

Weighted mean

- useful in situations where there are significant outliers in the spread of data*
- Example: HR could use this in assesing job candidates when some req. like certain degrees or credentials are considered to be more important than others*
Small group of invited persons (typically six to twelve) who actively participate in a structured discussion, led by a facilitator, for the purpose of eliciting their input.
Focus group

Raw average of data that gives equal weight to all values, with no regard for other factors.

Unweighted mean

Type of analysis that starts with a result and then works backward to identify fundamental cause.
Root-cause analysis

Comparing the sizes of two variables to produce an index or percentage; commonly used to analyze financial statements.

Ratio analysis
Net profit margin, for example, is a ratio that compares net revenue with costs. Many commonly used HR metrics are ratios, such as the turnover rate (comparing the number of terminations or resignations in a time period with the average number of employees in that period).
Average score or value.

Mean
Mean is synonymous with average
Middle value in a range of values.
Median (50th percentile, middle value in a range of values)
Preferred measure of central tendency
Statistical method used to test the possible effects of altering the details of a strategy to see if the likely outcome can be improved.
Scenario/what-if analysis

Distance of any data point from the center of a distribution when data is distributed in a “normal” or expected pattern.
Often shown as a “bell curve”

Standard deviation
68% of data lies within one standard deviation
Example of it’s use on page 279 or Frequency Distributions

Data-sorting technique in which group members add related ideas and indicate logical connections, eventually grouping similar ideas.
Mind mapping

Statistical method for identifying the degree of difference between planned and actual performance or outcomes.
Variance analysis

Technique that progressively collects information from a group of anonymous respondents.
Delphi technique
members work as a group without ever meeting
prevents “group think”

Data-sorting technique in which a group categorizes and subcategorizes data until relationships are clearly drawn.
Affinity diagramming

Statistical method used to determine whether a relationship exists between variables and the strength of the relationship.

Regression analysis
EBDM

evidence-based decision making
Steps in Evidence-Based Decision Making

Ask ~ when faced w/a problem, translate the situation into a Q that can be answered through info gathering.
Aquire ~ Gather info from varied sources
Appraise ~ Is the evidence relevant, valid, reliable, accurate, complete, and unbiased?
Aggregate ~ Combine + organize data for analysis
Apply ~ Use data to draw conclusions, develop solutions, win support for and take action
Assess ~ Monitor the solution

Consists of objective measurements that can be verified and used in statistical analysis—for example, the number of employees in an organization, the number of female employees in the organization, or the average number of hires each quarter.
Quantitative data

Involves a subjective evaluation of actions, feelings, or behaviors.
Qualitative data

Graphically depicts as portions or slices of a circle the constituents that comprise 100% of a data group. Textual data information can be included in callouts or in an attached table for more precise communication.
Pie chart

Graphically depicts the sorting of data into groups arranged in the shape of a statistical distribution, showing a central tendency and dispersion around that tendency. This appears as columns of varying heights or lengths. Can include a comparative referent, such as a target or range of values. They can also be designed to show comparisons over time (usually through multiple columns for each category).
Histogram

Plots data points on two axes. The horizontal axis usually represents time, while the vertical axis represents volume.
Trend diagram

Ranks categories of data, 80% of problems are caused by 20% of causes
Pareto Chart

Plots data points against two variables that form the chart’s x and y axes. Each axis is scaled. The pattern formed by the plotted data describes the correlation between the two variables:
Scatter diagram

- A scatter diagram shows possible relationships between two variables.*
- For example, if an HR professional wants to find out if there is a relationship between years of education and amount of income, he or she could create a scatter diagram with the years of education placed on one axis and the amount of income on the other.*
A sample may not represent the general population. For example, HR is studying the effects of an engagement strategy on retention. The sample, however, contains a higher proportion of older workers than are in the organization’s workforce.
Sampling bias
When participants are not randomly assigned to control and experimental groups. (Controlled studies assign participants to a control group that does not experience the intervention or condition being tested and one or more experimental groups that do experience the intervention or condition.)
Bias can also occur when researchers choose to enroll only certain types of participants. In a study testing the effects of a remote working policy, for example, the researchers enroll only employees who have been rated highly by their supervisors.
Selection bias
This is the inverse of selection bias. The researchers invite a representative sample to join a study, but the group that accepts or responds is not representative. For example, HR invites all employees to participate in a survey to determine new benefits. The group that responds is composed disproportionately of young parents.
Response bias
Participants in a controlled study behave differently because they are being studied. A famous example of this is the Hawthorne Works experiment. The experiment was designed to measure the effect of improvement in various factory conditions on worker productivity, but the increases in productivity were only temporary and appeared to be related primarily to the experiment’s design. The workers appreciated the increased attention to their welfare.
Performance bias
Raters are measuring incorrectly, either unintentionally (because of lack of training or difficult measurement procedures) or intentionally (the result of some type of personal bias).
Measurement bias
How to become an HR data advocate

1) Develop a questioning mind (why is X happening?)
2) Build fluency in the scientific literature for HR (regularly scan resources to ID new and reliable sources of date)
3) Gather data on a continuious basis (efficacy + efficiency of legacy systems, shareholder interests)
4) Use evidence when communicating w/stakeholders (include data to support recommendations)
5) Institutionalize the competency in the HR function (est. journal study groups, talk groups)
6 Q’s to ask when assessing validity of data sources

Does the source have authority?
What are the source’s possible biases?
Are the sources for data used in a publication clearly cited?
Are the facts relevant?
Is the data current?
If the data is being offered as proof of an argument, is the argument itself sound?

Name some examples of data sources


Effective interviewing tips for individuals
Convenient time + location
Reasonable interview length of time
Confidence respected
Neutral and non-judgemental reactions
Start with safe questions to build rapport
Focus group tools

Mind-mapping
Affinty diagramming
Nominal group technique
Delphi technique
Ways to conduct more effective focus groups
Free from distractions + interruptions
Refreshments + breaks
Planned objectives clearly defined
Context that a focus group would occur
Good facilitator
Recorder/note taker
Refers to the collection, organization and analysis of large amounts of numerical data
Statistics

The process of sorting data in different ways to provide a more accurate and in-depth understanding of what the data is showing
Descriptive statistics
Quartiles and percentiles
Quartiles divide a data set into quarters (for example: Q1, Q2, Q3, Q4)
A percentile indicates the proportion of the dataset at a certain percentage

Name data analysis approaches
Variance, ratio, trend, regression, root-cause and scenario
Name the various graphic analysis tools used to support and visualize the results of an analysis

Pie chart, histogram, trend diagram, pareto chart and scatter diagram
Interview advantages and challenges

Survey/questionnaire advantages and challenges

Observation advantages and challenges

Existing data advantages and challenges

Artifacts advantages and challenges

Reliabilty + Validity definitions and examples

Data analysis methods
