Chapter 2- Methods and Statistics in I-O Psychology Flashcards

1
Q

Research Design

A

Provides the overall structure or architecture for the research study: allows investigators to conduct scientific research on a phenomenon of interest.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Experimental Design

A

Participants are randomly assigned to different conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Quasi-experimental Design

A

Participants are assigned to different conditions, but random assignment to conditions is not possible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Non-experimental design

A

Does not include any “treatment” or assignment to different conditions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Observational Design

A

The researcher observes employee behavior and systematically records what is observed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Survey Design

A

Research strategy in which participants are asked to complete a questionnaire or survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Quantitative methods

A

Rely on tests, rating scales, questionnaires, and physiological measures, and yield numerical results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Qualitative Methods

A

Rely on observation, interview, case study, and analysis of diaries or written documents and produce flow diagrams and narrative descriptions of events or processes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Introspection

A

Early scientific method in which the participant was also the experimenter, recording his or her experiences in completing an experimental task; considered very subjective by modern standards

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Triangulation

A

Approach in which researchers seek converging information from different sources.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Generalize

A

To apply the results from one study or sample to other participants or situations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Experimental Control

A

Characteristic of research in which possible confounding influences that might make results less reliable or harder to interpret are eliminated: often easier to establish in laboratory studies that in field studies.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Statistical Control

A

Using statistical techniques to control for the influence of certain variables. Such control allows researchers to concentrate exclusively on the primary relationships of interest.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Descriptive Statistics

A

Summarize, organize, and describe a sample of data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Measure of Central Tendency

A

Statistic that indicates where the center of a distribution is located. Mean, median, mode are measures of this

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Variability

A

The extent to which scores in a distribution vary

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Skew

A

The extent to which scores in a distribution are lopsided or tend to fall on the left or right side of the distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Mean

A

The arithmetic average of the scores in a distribution; obtained by summing all of the scores in a distribution and dividing by the sample size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Mode

A

The most common or frequently occurring score in a distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Median

A

The middle score in a distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Inferential Statistics

A

Used to aid the researcher in testing hypothesis and making inferences from sample data to a larger sample or population

22
Q

Statistical significance

A

Indicates that the probability of the observed statistic is less than the stated significance level adopted by the researcher (commonly p<_ .05). This finding indicates that, if the null hypothesis were true, the results found are unlikely to occur by chance, and the null hypothesis is rejected

23
Q

Statistical Power

A

The likelihood of finding a statistically significant difference when a true difference exists

24
Q

Measurement

A

Assigning numbers to characteristics of individuals or objects according to rules

25
Correlation coefficient
Statistic assessing the bivariate, linear association between two variables. Provides information about both the magnitude (numerical value) and the direction (+ or -) of the relationship between two variables.
26
Scatterplot
Graph used to plot the scatter of scores on two variables: used to display the correlational relationship between two variables
27
Regression Line
Straight line that best "fits" the scatterplot and describes the relationship between variables in the graph: can also be presented as an equation that specifies where the line intersects the vertical axis and what the angle or slope of the line is.
28
Linear
Relationship between two variables that can be depicted by a straight line
29
Nonlinear
Relationship between two variables that cannot be depicted by a straight line sometimes called "curvilinear" and most easily identified by examining a scatterplot
30
Multiple Correlation Coefficient
Statistic that represents the overall linear association between several variables (e.g. cognitive ability, personality, experience) on the one hand, and a single variable (e.g. job performance) on the other hand.
31
Meta-analysis
Statistical method for combining and analyzing the results from many studies to draw a general conclusion about relationships among variables
32
Statistical artifacts
Characteristics (e.g.- small sample size, unreliable measures) of a particular study that distort the observed results. Researchers can correct for artifacts to arrive at a statistic that represents the "true" relationship between the variables of interest
33
Micro-research
The study of individual behavior
34
Macro-research
The study of collective behavior
35
Meso-research
The study of the interaction of individual and collective behavior
36
Reliability
Consistency or stability of a measure
37
Validity
The accurateness of inferences made based on test or performance data; also addresses whether a measure accurately and completely represents what was intended to be measured
38
Test-retest Reliability
Calculated by correlating measurements taken at time one with measurements take time two
39
Equivalent forms reliability
Calculated by correlating measurements from a sample of individuals who complete two different forms of the same test
40
Internal consistency
form of reliability that assesses how consistently the items of a test measure a single construct: affected by the number of items in the test and the correlations among the test items
41
Generalizability theory
A sophisticated approach to the question of reliability that simultaneously considers all types of error in reliability estimates (e.g. test-retest, equivalent forms and internal consistency)
42
Predictor
The test chosen or developed to assess attributes (e.g. abilities) identified as important for successful job performance
43
Criterion
An outcome variable that describes important aspects or demands of the job: the variable that we predict when evaluating that validity of a predictor
44
Criterion-related validity
validity approach that is demonstrated by correlating a test score with a performance measure: improves researcher's confidence in the inference that people with higher test scores have higher performance
45
Validity coefficient
Correlation coefficient between a test score (predictor) and a performance measure (criterion)
46
Predictive validity design
Criterion-related validity design in which there is a time lag between collection of the test data and the criterion data
47
Concurrent validity design
Criterion- related validity design in which there is no tome lag between gathering the test scores and the performance data
48
Content-related validation design
Demonstrates that the content of the selection procedure represents an adequate sample of important work behaviors and activities and/or worker KSAOs defined by the job analysis
49
Construct Validity
Validity approach in which investigators gather evidence to support decisions or inferences about psychological constructs: often begins with investigators demonstrating that a test designed to measure a particular construct correlates with other tests in the predicted manner
50
Construct
Psychological concept or characteristic that a predictor is intended to measure: examples are intelligence, personality, and leadership