You’ve just spent £50,000 on a leadership development program. The feedback forms are glowing. Participants loved the facilitator. They learned new frameworks. But when your CFO asks, "Did this actually make us money?" you’re left scrambling with anecdotes instead of answers. This is the gap that Phillips ROI Methodology was built to close.
Most companies stop at measuring happiness or knowledge retention. That’s like checking if the oven turned on but never seeing if the cake baked. Jack Phillips, an American consultant and author, developed this framework in the 1980s because he realized traditional evaluation models ignored the bottom line. He added a fifth level to the famous Kirkpatrick Model, forcing trainers to prove financial value. If you’re in Learning and Development (L&D) or HR, understanding this isn’t just academic-it’s how you keep your budget next year.
The Five Levels: Going Beyond Smiley Sheets
To grasp Phillips ROI, you first need to respect what came before it. The Kirkpatrick Model, created by Donald Kirkpatrick, is the industry standard for four levels of evaluation. It’s solid, but it stops short of money. Phillips took those four levels and added the crucial fifth step.
- Level 1: Reaction: Did they like it? (Satisfaction)
- Level 2: Learning: Did they get it? (Knowledge/Skills)
- Level 3: Behavior: Did they use it? (Application on the job)
- Level 4: Results: Did it help the business? (Key Performance Indicators)
- Level 5: ROI: Was it worth the cost? (Financial Return)
Here’s the catch: most organizations fail at Level 3 and 4. People learn a skill but don’t change their behavior because their manager doesn’t reinforce it. Or, behavior changes, but no one tracks which KPI moved. Phillips forces you to isolate the training’s effect from other factors-like market trends or seasonal spikes-to see if the training itself drove the result.
Calculating the ROI: The Formula That Matters
Don’t let the math scare you. It’s simpler than it looks. The core concept is comparing the net benefits of the program against its total costs. You aren’t looking for perfection; you’re looking for a credible estimate. Even a conservative estimate beats zero data.
The basic formula is:
| Component | Description | Example Data Point |
|---|---|---|
| Total Benefits | Monetary value of improvements in KPIs (e.g., sales increase, error reduction). | £120,000 saved from reduced customer complaints. |
| Total Costs | All expenses: design, delivery, participant time, materials, follow-up. | £40,000 total investment. |
| Net Benefits | Total Benefits minus Total Costs. | £120,000 - £40,000 = £80,000. |
| ROI Percentage | (Net Benefits / Total Costs) x 100. | (£80,000 / £40,000) x 100 = 200%. |
A 200% ROI means for every £1 spent, you got £2 back in pure profit, plus your original pound back. Most businesses aim for a positive ROI, but some accept lower returns for strategic initiatives like compliance training where risk avoidance is the benefit.
Isolating the Effect: The Hard Part
This is where skeptics push back. "Sales went up," says the VP, "but we also launched a new marketing campaign." How do you know the training caused the lift? Phillips provides five techniques to isolate the effect of training. You don’t need all of them; picking one or two credible methods is enough.
- Control Groups: Compare a group that received training with a similar group that didn’t. If both groups’ performance rises equally, training might not be the driver. If only the trained group improves, you have evidence.
- Trend Lines: Look at historical data. If errors dropped after training but usually stay flat, that’s a signal.
- Expert Estimates: Ask managers or experts what percentage of improvement they attribute to training. Use their judgment, but discount it conservatively (e.g., use 70% of their estimate).
- Participant Estimates: Ask learners themselves how much of their performance gain comes from the course. Again, apply a confidence factor.
- Case Studies: Deep-dive into specific success stories to find causal links.
In my experience working with UK firms, expert estimates are often the most practical method. Getting perfect control groups in dynamic SME environments is tough. Asking a department head, "How much do you think this contributed?" and then applying a safety margin gives you defensible numbers without halting operations.
Converting Data to Money: Not All Metrics Are Created Equal
You can’t put a price tag on everything easily. How do you monetize "improved morale"? Phillips offers guidelines for converting non-financial data into monetary values. This is often the most creative part of the process.
For example, if training reduces employee turnover, you calculate the cost of replacing an employee (recruitment fees, lost productivity during vacancy, onboarding time). If training speeds up production, you calculate the value of extra units produced per hour. If it reduces defects, you calculate the cost of rework and waste.
Be careful here. Don’t double-count. If you count increased sales as a benefit, don’t also count the same revenue as "increased customer satisfaction" unless you can separate the value streams. Stick to direct, measurable impacts first. Save soft skills like "better communication" for qualitative reports unless you have clear metrics linking them to hard outcomes.
Common Pitfalls to Avoid
Many L&D teams try to implement Phillips ROI and quit within six months. Why? Because they make it too complicated. Here are the traps I see repeatedly:
- Measuring Everything: Don’t try to measure ROI for every single workshop. Pick high-cost, high-impact programs. A £500 lunch-and-learn doesn’t need a full ROI study. A £20,000 certification program does.
- Late Involvement: Evaluation starts before the training begins. If you don’t define KPIs and baseline data beforehand, you can’t measure change later.
- Ignoring Follow-Up Costs: Many forget to include the cost of coaching, job aids, or manager meetings required to sustain behavior change. These are part of the total investment.
- Overclaiming: If you claim 500% ROI, executives will doubt you. A realistic 150% with transparent assumptions builds more trust than an inflated number.
Remember, the goal isn’t to prove training is magic. It’s to prove it’s a sound business investment. Sometimes, the answer is "No, this program had negative ROI." That’s valuable too. It tells you to redesign or scrap the initiative rather than pouring money down the drain annually.
Practical Steps to Start Tomorrow
You don’t need to overhaul your entire L&D strategy overnight. Start small. Choose one upcoming program that has clear business objectives. Work backwards from Level 5 to Level 1 when designing it.
- Define Success: What specific KPI should move? (e.g., Reduce call handling time by 10%).
- Set Baseline: Measure current performance before training starts.
- Plan Data Collection: Decide now how you’ll isolate the effect (e.g., compare two teams).
- Execute & Collect: Run the training, gather reaction and learning data immediately.
- Follow Up: Wait 3-6 months. Check if behavior changed and if the KPI moved.
- Calculate & Report: Apply the formula. Present findings to stakeholders with clear assumptions listed.
This disciplined approach shifts the conversation from "We did training" to "We improved efficiency by X%, generating £Y in savings." That’s language executives understand and fund.
Is Phillips ROI better than the Kirkpatrick Model?
It’s not about better; it’s about completeness. Kirkpatrick is excellent for operational feedback and improving course content. Phillips extends it to prove financial value to senior leadership. You typically use Kirkpatrick levels 1-4 as the foundation, then add Level 5 for strategic decision-making.
How long should I wait to measure ROI?
It depends on the program. For simple skills training, 3 months might suffice. For complex leadership development, 6 to 12 months is more realistic to see sustained behavioral change and resulting business impact. Measuring too early leads to inaccurate data.
Can I measure ROI for soft skills training?
Yes, but it requires proxy measures. Instead of measuring "communication," measure its outcome: e.g., reduced project delays due to miscommunication, faster resolution times, or fewer customer escalations. Convert these operational improvements into monetary values using standard company costs.
What if the ROI is negative?
Negative ROI is a valid finding. It suggests the program needs redesign, better facilitation, stronger management support, or perhaps shouldn’t exist in its current form. It prevents future waste. Always present negative ROI with root cause analysis to show you’re solving problems, not just reporting failures.
Do I need software to calculate Phillips ROI?
Not necessarily. Excel is sufficient for most calculations. Specialized LMS or analytics tools can automate data collection, especially for large enterprises, but the methodology relies on logic and assumptions, not software features. Start with spreadsheets to master the process.