THE IMPORTANCE OF MEASURING IMPACT

Did Your Learning Actually Make a Difference?

1,247 people completed the course. 96% passed. The average satisfaction score was 4.6 out of 5.

Excellent. But did anything actually change? That's a much harder question. And it's one L&D needs to get better at answering.

The importance of measuring learning impact

We have access to more learning data than ever. An LMS can tell us who started a course, who completed it, how long they spent there and what they scored in the assessment.

All of that can be useful. But none of it necessarily tells us whether the learning worked.

Imagine the purpose of a management programme is to reduce employee turnover. Knowing that 500 managers completed it tells us about participation. Knowing that they scored 90% in an assessment tells us something about their knowledge.

But the organisation invested in the programme because it wanted something to change.

Did managers behave differently? And did that make a measurable difference to the business?

That's where impact becomes interesting.

Start with the problem, not the course

One of the easiest mistakes in learning impact evaluation is waiting until a course has launched before asking how you'll measure it. By then, it may be too late.

Impact measurement should begin before the learning has been designed. Start with the reason the project exists. Perhaps the organisation wants fewer safety incidents, better customer satisfaction, increased sales, fewer errors or more confident managers.

Then ask what people need to do differently to contribute to that outcome. This creates a line between the business problem, the required behaviour and the learning. It also gives you something meaningful to measure.

Look beyond the LMS

Some of the most valuable evidence of learning impact may have nothing to do with learning data.

Imagine you're delivering face-to-face sales training. The assessment scores improve and participants give the workshop excellent feedback. That's encouraging. But sales data might tell you whether customer conversations are producing better results.

The same applies to digital learning solutions. Compliance learning could be compared with incident or error rates. Leadership learning might be explored through employee feedback or retention data. Process training could be connected to productivity, quality or rework.

Not every course will produce a neat financial return. Nor should we force one where it doesn't make sense. But we can usually go further than completion and satisfaction.

Don't confuse correlation with causation

There is an important catch. If performance improves after training, that doesn't automatically mean the training caused it. Perhaps a process changed. Perhaps managers became more involved. Maybe a new system was introduced at the same time. Real organisations are messy, and learning rarely happens in isolation.

Good learning impact evaluation acknowledges this. Rather than hunting for a spectacular ROI figure, look for multiple sources of evidence. Combine learning data with behavioural measures, business performance, observations, interviews and feedback.

The aim isn't to prove that L&D deserves all the credit. It's to understand the contribution learning made.

Use the findings to make learning better

Impact measurement shouldn't simply produce a report that gets presented to senior leaders and forgotten. It should influence what happens next.

If behaviour hasn't changed, why not? Did people lack opportunities to practise? Did managers fail to reinforce the learning? Was the course aimed at the wrong problem? Or did people learn exactly what we wanted them to learn, but discover that something in the workplace prevented them from applying it?

Those are useful findings. Sometimes discovering that learning didn't solve the problem is just as valuable as proving that it did.

The importance of measuring impact: change the conversation

Perhaps L&D needs to stop leading with numbers such as completions, hours of learning and satisfaction scores. They're useful measures. They're just not the whole story.

Instead of asking 'How many people completed the training?', start with a more important question: 'What changed because we did it?' That question moves the conversation beyond learning activity and towards organisational value. And if we expect businesses to keep investing in learning, it's a question we should be prepared to answer.

Frequently asked questions

What is learning impact?

Learning impact is the change that happens as a result of a learning intervention. This might include changes in knowledge, skills and behaviour, alongside wider organisational outcomes.

Is learner satisfaction a measure of impact?

It can be useful, but it primarily tells you how learners perceived the experience. A highly rated course hasn't necessarily changed behaviour or improved performance.

Can you calculate ROI for every learning programme?

Not always, and attempting to attach a financial value to every outcome can create misleading results. The right measures should reflect the original business problem and the outcomes the learning was designed to influence.