Training Flashcards

1
Q

3 Components of an Organizational Needs Assessment System

  • Training is not always the answer, and a needs analysis will tell us if we need training
  • When finished, we know:
    i. If training is needed
    ii. What kind of training is needed and in what areas
    iii. What content do we need to train on
    iv. Who do we need to train
A

Organization-wide analysis, an analysis of the work performed, and an analysis of the persons performing the work.

  • Organizational analysis
  • Work Analysis
  • Task Analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Organizational Analysis- Determining where training emphasis can and should be placed within the organization based on its objectives and resources

A
  • Establish top relationships/ org. members to establish goals of the org., identify resources, training climate, etc.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q
Task Analysis (Job Analysis)-  Determining the content of training in terms of what the employee must do to perform a task, job, or assignment effectively
** Requires a job analysis
A

Define target of job, choose methods, identify participants, determine points of contact, anticipate problems. develop protocol

Identify relevant tasks and KSAs

Perform Linkage analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

JOB ANALYSIS REVIEW

A

Techniques- interview, survey, observation (direct/indirect), panel, O*Net
Types of Job Analysis - Job vs. Worker - developing work to be employed vs. employees

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Person Analysis- determining KSAOs an employee must develop to perform tasks involved in his or her job.

A

Develop performance indicators, KSA gaps in target participants, determine approach to resolve gaps.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q
  1. Is the individual trainable?
  2. How should the training program be arranged to facilitate learning?
  3. What can be done to ensure what was learned during training will be retained and transferred on the job?
A

Trainability- only train employees who are trainable

  • Selection into training - same laws as selection into the organizations
  • Training as short as possible, not to pull workers
  • Need ability and motivation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Active Practice - people are engaged in skills (related to active learning)

Overlearning- you have to get the task right many times, not just once
** Promotes automaticity (if the goal is to make the behavior or skill automatic, continuously practice it)

A

Massed vs. Distributive - Distributive is better for physical tasks/motor skills because with rest periods you can make up for fatigue.
-Effectiveness is less clear-cut when you are trying to learn factual information.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Blocked vs. Random Task Order- Randomly presenting training order can improve learning because you learn the relationships of different parts more deeply.

A

Whole Training- Train everything together and in order - when things are related this works best, but when they aren’t as related, partial trainings are more effective

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Feedback- allows for corrections/adjustments, increases interest/stimulation, leads to goal-setting

Task-related, not personal, timing should be immediate but not too much

Meaningfulness of material- effective for training/engaging/effortful- reduces cognitive load

A

High Aptitude vs. Low Aptitude Trainers - learn differently so using diff. methods/treatments for people of varying levels of ability might lead to better outcomes
Personality traits, cultural background, etc.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Individual diff. that Influence Training: Cognitive ability, self-efficacy, previous experience, age, motivation, non-ability related differences (openness, goal orientation, neuroticism, anxiety, motives)
Performance Avoidant individuals would not do well in error management type of training

A

Bandura- Social Learning Theory- basis for behavioral modeling

Creating an environment for learning - influences how individuals connect and support which makes it easier for people to learn

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q
  1. Motivation
    a. Encourage self-regulated learning
    i. Self-regulated learning: the process by which we set and achieve goals or alter goals if necessary – setting learning goals and activities and altering them
    ii. E.g., the goal is do to well on comps, so review information and test myself
    b. Goal setting
    i. Trainers ask trainees what their goal is and give feedback
    c. Reinforcement theory
    i. Principles of this theory (skinner) can influence how you design your training environment – designing feedback
    d. Expectancy theory
    i. If you think your effort will be rewarded, you will be more motivated to work
    ii. Valence: do I care
    iii. Instrumentality: will I get the reward
    e. Self-efficacy
    i. Close relationship with transfer because if you believe you can do the training tasks on the job, you will be more motivated for training
A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q
  1. What is Engagement?
    a. Level of interest, how attentive/active someone is towards a task
    b. Can be measured in different ways (cognitive, affective, behavioral)
  2. Why is it important?
    a. Must be engaged to learn – the more engaged, the more you learn
    b. Learners who are engaged more learn more from interventions
    c. Associated with more favorable learner reactions
  3. How to we promote it?
    a. 3 conditions to promote engagement:
    i. Meaningfulness
  4. Receive return on investment of effort
    ii. Safety
  5. Being able to express yourself without fear of repercussions (predictable situations)
    iii. Availability
  6. Enhanced when individuals possess physical/cognitive/physiological resources to invest in job efforts (e.g., sleep, time)
A

iii. How do changes in the workforce (e.g., age, diversity), training design (e.g., e-learning) and training content (teamwork training, soft skills training) inform training motivation?
1. Connection between workforce changes and content (older workers are less motivated to learn new hard skills and more motivated to learn new soft skills)
2. Easier to see value in hard skills

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

iv. Learner Control
1. What is it?
a. Providing autonomy, discretion, responsibility to the individual learner to make decisions about the learning process/environment/etc.
i. E.g., pace, content, structure
2. Under what conditions is it expected to help vs. hinder learning?
a. Control might hinder ability if learners have lower ability or less experience, or if the task is complex
b. Control over content will hinder learning, but control over pace will help
c. Do not provide control over deep features (content, order, organization)
d. Brown et al. (2016)
i. As people gain ability and experience, you might be able to provide more control (as people learn, they could be trusted with having more control)
3. What recommendations would you make for training designers regarding learner control?
a. Make sure there is adequate support – don’t provide autonomy without having an avenue to reach out for help

A

ii. Skill Acquisition
1. What is skill acquisition?
a. Performance criterion
i. Can be operationalized as proficiency on an exam
b. Amount of material covered
i. Errorless trials – hope that people get good enough
c. Amount of time spent
i. Number of hours practicing driving or with a patient
d. Mental model/knowledge structure
i. Cognitive map
1. Closeness of two nodes shows how closely related they are, and number of links is important (a lot suggests you don’t know much about a topic)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Skill Retention & Decay

  1. Decay: loss of knowledge or skill after some period of non-use
  2. Retention: amount of knowledge or training that has been retained after the period of non-use
  3. Influential Characteristics that influence the strength of decay or retention:
    a. Retention interval
    i. Longer interval = more decay
    b. Degree of overlearning
    i. No significant effect for overlearning – but argue that not many people measure overlearning
    c. Task characteristics (closed/open; physical/cognitive)
    i. Closed-looped: ordered tasks
    ii. Open-looped: less sequential
  4. Closed-looped tasks = less retention than open-looped
    iii. Physical tasks are more prone to decay than cognitive based tasks
    d. Acquisition criteria
    i. Speed is less resistant to decay than accuracy
    e. Conditions of retrieval
    i. The more similar the environment, the more resistant to decay (strongest moderator)
    f. Instructional/design strategies
    g. Individual differences
  5. Can attitudes decay?
    a. Self-efficacy
    b. Job satisfaction
    c. Organizational commitment
    d. Attitudes towards others (e.g., opposite sex, races)
    e. *Environmental factors can effect attitudes – attitudes change over time, and the changes are meaningful
    i. Chen et al. (2005) measure job satisfaction at many points over time to capture the dynamic nature
A

Opportunity to Perform - 3 Factors

  1. Job Characteristics (depends)
  2. Work Environment (supports or not)
  3. Trainee Motivation - the extent to which the trainees seek out opportunities to implement their skills

No opportunity to perform = decay is more likely
Refresher training

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Other Contextual Factors
Framing of the Training - How you introduce individuals to the training can influence learning & decay

Higher self-efficacy and lower anxiety - more success when framed positively

Training Climate- supports and rewards training and promotes creativity
**Needs assessment for successful transfer of training and longer retention! ** They are moderators to training design/individual diff. - learning outcome.

Cheng & Ho (2001) social support and continuous learning culture; evidence that supportive climate moderated the effectiveness of goal-setting intervention on training transfer

A
Individual Factors that Affect Transfer:
1. Cognitive Ability (Strongest)
2. Conscientiousness 
3. Neuroticism 
4 Learning Goal- Orientation
5. Performance Avoidance Orientation
6. Pre-training Self-Efficacy 
7. Motivation
8 Voluntary participation or Job Involvement
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Transfer of Training - being able to perform in different situations (adaptability); changing things about the situation measuring the success

Maintenance: maintaining skills (retention)

Positive: after training there is an improvement in performance

Negative: decrease in performance levels/well learned behavior can interfere with the ability to perform a new task

Zero: training has no effect on subsequent performance

Near: similar task characteristics across environments
Far: different task characteristics across environments

A

To make the adaptive transfer of diff. task characteristics across environments:

Introduce concepts randomly
Design the training to be more difficult, encourage ppl to make mistakes and solve problems on their own, limit feedback when experience is more, this makes people more resistant to give up

If training is designed to be exact same as the job, then trainees will be more resistant to decay but will not be as effective in working their way through problems when they arise

  • Generalization
  • Maintenance
17
Q

Training Evaluation- systematic collection of information to make decisions; descriptive information (where you stand) and judgmental information (Goldstein & Ford)

  • Lacks management support
  • Lack of knowledge and skill
  • Unclear what to evaluate
  • Potential for negative feedback

Benefits that overcome these barriers:
-Identify ways to save money (utility analysis/cost-benefit analysis, avoid potential lawsuits)

A
18
Q

Kirkpatrick’s 4 Levels of Analysis (1959)

A
  1. Reaction- most shallow, did you like the training/did you think it was useful? (I.e. Teaching evaluations, most commonly measured)
  2. Learning- 2nd most shallow, declarative/procedural test
  3. Behavior- 2nd deep, performance appraisal, transfer
  4. Results- most deep, usually org. level criteria (i.e., absenteeism, reduced turnover)

Relationship btwn levels- small relationship between reactions and learning (.08)
Criteria was multidimensional

Criticisms of Kirkpatrick’s- think the levels are too broad and unidimensional

19
Q

Alliger et a. (1997) - Expansion of Kirpatrick’s Model

A
  1. Affective Reactions
    - Utility Judgments- most strongly related to transfer and learning than affective reactions/more important over immediate learning
  2. Learning - immediate knowledge, knowledge retention, behavior/skill demonstration
  3. Behavior (transfer)
  4. Results
  5. Evidence found for convergent and divergent validity (suggesting that there is multidimensional criteria and more than one type of training evaluation should be applied)
20
Q

Why Reactions are Important?

A
  1. Technology is used, affective reactions become more important (pay special attn. to the satisfaction of trainees)
  2. Reactions can be sensitive to factors during training or in the training environment (i.e., instructor style/human interaction)
  3. Reactions can be related to both post-training knowledge and transfer (therefore they can be predictors of performance)
  4. Self Efficacy is also a predictor of knowledge and Transfer
21
Q

iii. Training Evaluation
1. Systematic collection of information to make decisions
2. Descriptive Information: means and SD
3. Judgmental Information: “you need a score of X to succeed on the job”
4. Collect the information to make effective training decisions (i.e., how to modify training)
5. Validity!
a. Research: appropriateness of inferences we draw from research or test scores
b. Measurement
c. Training

A

Research Validity

  1. Internal Validity
    a. Confident that the change in scores was caused by the treatment
    b. History, maturation, testing [alpha, beta, gamma], instrumentation, statistical regression, differential selection, experimental mortality, experimenter bias
    i. Alpha: what we want – the change in scores is due to the intervention
    ii. Beta: the change in scores is due to understand the scale better
  2. (E.g., a supervisor raters themselves as average, but after training they still rate themselves as average)
    iii. Gamma: a change due to understanding the construct better
  3. External Validity
    a. Order effects, pretesting effects, Hawthorne effect, treatment diffusion
    i. Order effects: order of measures (combat by counterbalancing measures)
    ii. Pretesting effects: desensitizes trainees to the training (they tend to focus on what they were tested on (combat by using alternate forms or items, or use a posttest only control group)
    iii. Treatment diffusion: treatment groups communicate between each other and blend the experiment
  4. Construct Validity
    a. Adequacy of our operational definition
    i. E.g., does the SJT actually measure their ability to make informed decisions?
  5. Statistical Conclusion Validity
    a. Validity of our conclusions based on the statistics we decided to run
22
Q

Construct Validity - Test convergent (similar) and divergent (dissimilar) validity - looks for measures that are similar to the construct that we are measuring, but not similar to another construct

A

Content-Related Validity- ask a group of SMEs “we developed a test to evaluate knowledge in observation training: do you think this represents the knowledge learned in training?

23
Q

Criterion-Related Validity- closely tied to transfer of training and compare scores to performance (criterion)- do they predict performance?

A

Training Validity- effects the performance of trainees on immediate measures of training effectiveness; Learning in Kirkpatrick’s model’ the experimental group does better than the control group on the assessment

Transfer Validity- behavior in Kirkpatrick’s model; training effects the job performance of trainees

Intra-organizational Validity- training will be equally effective for subsequent trainees as it was for original trainees

Inter-organizational Validity- training in one organization will be effective in another organization

24
Q

Experimental Design- Stronger vs. Weaker Designs

A
  1. Prove cause an effect; control group; separation in time
  2. Weak- Subjective design, using postest with nothing to compare it to
  3. Not using a control group

Weak Design: One group; pre-test
One group; post-test
One group; pre-, post-test **None of these have a control group

Strong Experimental Designs-
Two groups, pre-, post-test
Four groups, pre-, post-test

Soloman 4-group design– gold standard of training, never happens because of the ‘n’ and amount of time needed
People usually use two groups pre/post test to get around this

Strong Quasi Experimental Design-
One group, time series

Longitudinal Evidence- 2 nonequivalent groups, pre-post-test

25
Q

Effect Sizes
What is the statistical significance? “It is unlikely that this difference between groups (or change in scores) is due to chance”

A

Practical- small incremental “boost” (effect size) may not be a meaningful result (is this able to be extended beyond the immediate setting)

Scientific- about the broader scientific community- can we meaningfully contribute to the current research?

Effect sizes aid communication

Effect sizes should always be reported in psychologically-based research

26
Q

Training Delivery (Goldstein & Ford)- training delivery or instructional technique refers to the physical means by which training content is communicated.

A

Can use lectures through different mediums (taking class in person vs. online) but this method is still lecture.

**Training content should determine the delivery method
Many Decision Points:

  1. Onsite vs. Off-site - where are doing the training occur?
    On-site: at the workplace (apprenticeship, job rotation)
    Offsite (classroom, simulators)
  2. Individual vs. Collective - individuals - in a group setting or team training
  3. Self-paced vs. Fixed-paced
    Confounded with e-learning techniques

Delivery Methods are combined in varied configurations

27
Q

Training Delivery Methods

A
  1. Lecture/discussion
  2. Behavioral modeling
  3. Team Training
  4. Programmed instruction
  5. Error-management instruction
  6. Technology-based methods (audiovisual, e-learning, simulators, VR, gamification)
  7. Coaching, Mentoring, Job Rotation
  8. On-the-job training, apprenticeship
28
Q

Lecture & Discussion

A

Effective Method, people learn (Arthur et al. 2003)

  1. Easy to design the content- to identify the KSAOs - efficient for time, space, and people
  2. Do not cost a lost
  3. Widely accepted
  4. Standardized

Drawbacks?

  1. Engagement
  2. Might be communicating too much knowledge
  3. Lack of customization
  4. Might be better for certain types of KSAOS- in one way delivery of info.

**ESPECIALLY EFFECTIVE WHEN COMBINED WITH OTHER METHODS

29
Q

Behavioral Modeling

A

Roots in Bandura’s Social Cognitive Theory

  1. Description of the behaviors to be learned
  2. Model who demonstrates the behaviors to be learned
  3. Opportunity to practice the modeled behaviors
  4. Feedback focused on the performance of the practiced behavior

Requires: attention, production, motivation

Effectiveness? Depending on the outcome, effective for procedural knowledge, useful when used in conjunction with other methods

30
Q

Team Training- What constitutes a team? Are we training individuals to work with specific set of team mates?

When do we need to train teams as teams? When do we need to train teams as individuals who are capable of working on a team?

A

Teamwork Training: team processes (i.e., communication; intergroup conflict) training people how to be good teammates

How do we determine training effectiveness? Do we measure individual, or team performance or both?
Both- team outcomes (performance & processes) individual outcomes (affect & cognition)

Team task analysis - moderators = team size, team membership stability, training content
After-action reviews
Dyad pairing
Day et al. (2005)
1. Low and high ability partners
2. High ability partners performed best
3. Low ability partners improved the most over time
4. ASA prevents people from being put in this dynamic of uneven skill levels

Cross-Training

Benefits - Team Performance - Shared Mental Models - people on a team may approach the same way with a shared mental model

Transactive Memory- knowing what team member knows what

31
Q

Programmed Instruction- used reinforcement principles of shaping, prompting, discrimination training, stimulus fading & feedback
3 Components:
1. Antecedent stimuli requiring a response
2. Opportunity to respond
3. Outcome presenting information about the correctness of response (feedback)

The mode involved, targeted, and personalized feedback an instructor gives learners, the more effective the training will be

A

Error Management Training
Active Exploration/ Error Encouragement

How does it work?
Self-regulation of emotions and cognition

Moderators are effective