NOA End-User Benchmarking Workshop
Wednesday 9th February 2011
It is generally agreed that a common source of failure of outsourcing agreements is that the arrangement put into place does not work for all parties involved. Benchmarking data can be used to manage and improve provider performance not just at the start of a contract but throughout the duration of the collaboration.
The NOA’s End-User Benchmarking Workshop was held with the aim of discussing best practices, lessons learned and how to mitigate risks in the ever-changing IT outsourcing market.
Chris Smith, Vice President, UK and Ireland Benchmark Analytics, Gartner chaired the workshop and focused on three key benchmarking issues.
• How should benchmark data be used to improve provider performance?
• Should you plan benchmarking activity or wait until there is a cause?
• What should you measure to ensure a good deal going forward?
Chris commented: “Providers can see benchmarking as a threat but it can help with the overall transparency and understanding of outsourcing charges. Benchmarking clauses are really about contract optimisation not primarily cost savings.
“When applying benchmarking in a deal, it is good practice to jointly agree to a benchmarking process to promote cooperation and openness. Decide on an independent third party, conduct an initial benchmark and routinely schedule benchmarks which can be used to adjust deals as needed.”
Benchmarking Benefits
• Encourages discussion and alignment of your deal in context
• Provides a measure for continuous improvement
• Drives provider behavior to reduce charges
• Tests the validity of fees for specified services
• Evaluates relative performance within a peer group
• Creates leverage for price adjustments
• Quantifies the appropriate price/service delivery balance
Clauses
Gartner IT Key Metrics Data 2010 showed that 39% of end-users use a third party benchmarking firm to satisfy their contractual benchmarking clauses while 24% have no clauses at all.
It was emphasised that specific areas need to be benchmarked at the beginning of a contract and any intentions to benchmark any discrete service area or all of the service areas in the contract.
Be clear, in the contract, of the date of execution for the benchmark, such as 12-18 months after the contract start date and if a delay occurs, contractually document the delay and new start date. Do not let a slipped date be the catalyst to not benchmark.
It is always best practice to benchmark before outsourcing which provides a starting point to set forth a clear reference between current state and future measureable benefits from outsourcing.
Stipulate Benchmarking Methodology and Provider Selection Criteria
Define the benchmarking methodology, different third-party Benchmarkers perform benchmarks and comparisons differently.
Often, one methodology and/or third-party Benchmarker is preferred by clients or service provider. Disagreements about who will perform the benchmark can lead to derailment of the benchmark.
Define How Peers Will Be Selected and Compared
Peer group selection should be left to the third-party benchmarker; however, the characteristics need to be negotiated and defined in the outsourcing contract and realistic benchmarking comparisons must be defined. Peer comparisons, such as top 10% of group, top 25% and average of peer group, must be defined in the contract.
Define How Benchmarks Will be Staffed, Managed and Funded
The service provider should include all costs to support the benchmark activities (that is, resources to gather data and manage the service provider portion of the process, and review meetings), into their cost models for the outsourcing deal.
If benchmarks are established and defined in the contract, the service provider will have a clear understanding of the level of work and expectations. Benchmarks can be funded in different ways such as payment by the service provider, payment by the client and payment split 50/50.
Stipulate, in the contract, who will fund the benchmark; otherwise the question will quickly arise and can delay or halt the benchmarking exercise, as well as create ill-will between the parties.
Define How Benchmarking Results Will be Used in the Deal
Benchmarking results can be a powerful tool in determining whether the price and value of the deal are in line with market-based pricing and value expectations, but you must stipulate in the contract how the analysis will be used. For example, a contractual trigger to adjust prices during a certain time period along with service-level changes. The contract must also state what will be done with the outcome of the benchmark results.
Conclusion
The workshop concluded with a question and answer session which focused around Gartner’s own four key benchmarking questions:
1) Vision and Alignment - Can both parties meet their strategic & operational goals, and respond to business and technology changes?
2) Price & Service Levels - Do the Scopes-of-Work, delivered service & price meet the business requirements and are they reasonable?
3) Customer Satisfaction - Are the business unit users and managers satisfied?
4) Contract & Relationship - Does the management of the contract and relationship meet the needs of both parties?
Attendees included: Chris Smith – Vice President, UK and Ireland Benchmark Analytics: Gartner, Adrian Turner - European Head Corporate Procurement: Apple Europe Ltd, Stephen Green - Head of Operations: ATOC Ltd, Alasdair Wann - Group Procurement Global Sourcing: BT, Sav Thevendria - Service Manager: Carphone Warehouse, Marelize Verdoes - Vendor Test Manager: Carphone Warehouse, Duncan Falconer - Application Technology Consultant: Carphone Warehouse, Neil Wright - Head of Customer Services: Everything Everywhere, Danny Booth - Group IT & Communications Director: Hyperion, Peter Thurley - Supplier Relationship Manager: Metropolitan Police Service, Francis Kendall - Site Head of Statistical Programming: Roche, Mary Coyne - Head of IT and Indirect Procurement: TUI Travel, Michael Ruddock - Finance Director: Westbourne Terrace Management Services and Paul Corrall, Editor: Sourcingfocus.com