The kirkpatrick model: evaluating training effectiveness

Training is a big investment for any organisation, whether it's developing new skills or refreshing existing ones. But how do you know if that investment is truly paying off? How can you measure the real impact of your training programmes? This is where the Kirkpatrick Model comes in handy. It's a widely recognised and practical framework that helps you evaluate the effectiveness of any learning initiative, ensuring your efforts lead to tangible improvements for individuals and the organisation as a whole.

What is the Kirkpatrick Model?

The Kirkpatrick Model, developed by Donald Kirkpatrick in the 1950s and later updated by his son James and their team, is a step-by-step approach to evaluating training programmes. It breaks down evaluation into four distinct levels:

1. Reaction: How did learners feel about the training?
2. Learning: What did learners actually learn or gain from the training?
3. Behaviour: How has the training changed learners' on-the-job behaviour?
4. Results: What organisational impact has the training had?

By following these four levels, you can systematically assess the value of your training, identify areas for improvement, and demonstrate its return on investment (ROI).

Level 1: Reaction - how did they feel?

Definition

This first level focuses on the immediate reactions of your learners to the training programme. It's all about their perception, engagement, and satisfaction. Did they enjoy it? Did they find it relevant and useful? Their answers provide valuable insights into the quality of the training delivery and environment.

Why it matters

While positive reactions don't guarantee learning, negative ones can certainly hinder it. If learners are bored, frustrated, or feel the training is a waste of time, they are less likely to absorb information or apply it later. Good reactions create an open mind and willingness to learn.

How to measure

• Satisfaction surveys/feedback forms: These can be distributed immediately after the training. Include questions about the content, trainer, facilities, and overall experience.
• Informal feedback: Observe body language, listen to comments during breaks, and engage in casual conversations.
• Polls: Quick, anonymous polls can gather immediate feelings.

Practical takeaway

Ask clear, focused questions. For example: "Did you find the content relevant to your role?" or "Was the trainer engaging and knowledgeable?" Use a Likert scale (e.g., 1-5, strongly disagree to strongly agree) for easy analysis.

Level 2: Learning - what did they learn?

Definition

Level 2 evaluates whether learners actually acquired the knowledge, skills, or attitudes that the training aimed to impart. It moves beyond good feelings to assess the actual increase in their capabilities.

Why it matters

This level is crucial because without learning, there can be no change in behaviour or results. It confirms that the key messages and skills were successfully transferred to the learners.

How to measure

• Pre and post-tests: Administer tests before and after the training to measure the change in knowledge.
• Skills assessments: Observe practical application of new skills, perhaps through role-playing or simulated tasks.
• Quizzes: Short quizzes during or after modules can check understanding.
• Certifications: If applicable, formal certifications can demonstrate proficiency.

Practical takeaway

Ensure your assessments directly relate to the learning objectives. If your objective is for employees to "understand safe lifting techniques", test their understanding of those techniques, not just general health and safety knowledge.

Level 3: Behaviour - how did things change?

Definition

This level looks at whether the learning from the training has led to a change in the learner's on-the-job behaviour. Are they applying new skills? Are they using new knowledge? This is where the training starts to have a tangible impact on daily work.

Why it matters

Learning is only truly valuable if it translates into improved performance. Without a change in behaviour, the training's impact remains theoretical. This level bridges the gap between knowing and doing.

How to measure

• Observations: Managers or supervisors can observe employees' performance before and after training.
• Performance reviews: Look for changes in specific behaviours that were targeted by the training.
• 360-degree feedback: Gather feedback from peers, subordinates, and superiors about changes in the employee's work habits.
• Self-assessment: Ask employees to reflect on how their behaviour has changed and provide examples.
• Checklists: Create checklists of desired behaviours for managers to use.

Practical takeaway

The key to this level is time. Behaviour change doesn't happen overnight. Plan to measure this several weeks or months after the training. Also, ensure the work environment supports the new behaviours; otherwise, the training's impact will be quickly lost.

Level 4: Results - what was the impact?

Definition

The highest and most challenging level, Level 4 measures the ultimate impact of the training on the organisation's key business objectives. This is about linking training directly to business outcomes and return on investment (ROI).

Why it matters

This is where you demonstrate the true value of your learning and development efforts to senior leadership. It proves that training isn't just an expense, but a strategic investment that contributes to the bottom line.

How to measure

• Quantitative data:
  • Increased sales or revenue
  • Reduced costs (e.g., fewer errors, less waste)
  • Improved productivity or efficiency
  • Higher customer satisfaction scores
  • Lower employee turnover
  • Improved quality metrics
  • Reduced safety incidents
• Return on Investment (ROI) calculation: Comparing the monetary benefits of the training against its cost.

Practical takeaway

Identify relevant metrics before the training takes place. What are the business problems you're trying to solve through learning? For example, if training is designed to reduce customer complaints, track complaint numbers before and after the training. Quantifying results can be complex and requires careful planning and data collection.

Applying the Kirkpatrick Model: a step-by-step guide

1. Define your objectives: Before any training, clearly state what you want learners to react to, learn, do, and what results you expect for the organisation.
2. Plan your evaluation: Decide how you will measure each level for each objective. What tools will you use? Who will collect the data? When?
3. Collect data: Implement your evaluation plan at appropriate times.
4. Analyse and report: Interpret the data from each level. What story does it tell? Share your findings with stakeholders.
5. Use the insights: This is critical! Use your findings to improve future training, justify investment, or adapt current programmes. The model is not just for assessment, but for continuous improvement.

In conclusion

The Kirkpatrick Model offers a thorough yet straightforward way to look at how effective your training programmes are. By systematically evaluating at all four levels - Reaction, Learning, Behaviour, and Results - you can move beyond just hoping your training works. You can actually see its impact, justify your investment, and continually fine-tune your learning initiatives to achieve the best possible outcomes for your team and your organisation. It's a powerful tool for anyone serious about maximising the value of their development efforts.