Impact assessment

Impact Assessment 2022 to 2023

Published 17 July 2023

1. Summary

The Competition and Markets Authority (CMA) is the UK’s lead competition and consumer authority and its primary duty is to promote competition, both within and outside the UK, for the benefit of consumers. The CMA has a wide range of tools to use in addressing competition and consumer problems including carrying out investigations into mergers and markets, enforcing competition and consumer law, and working with sector regulators. The CMA also has a function to consider regulatory references and appeals.

As part of the framework agreement between the CMA and the Department for Business, Energy & Industrial Strategy,[footnote 1] the CMA is required to report annually on:

  • the delivery of a target of expected direct financial benefits to consumers of at least ten times its relevant costs to the taxpayer (measured over a rolling three-year period); and
  • the ratio of direct financial benefits to consumers and costs for its principal tools.[footnote 2]

In this ninth CMA Impact Assessment, we report on the performance against this target for the financial year 2022 to 2023. As the target is measured as a three-year rolling average, for 2022 to 2023 the calculation is based on the performance of the past three financial years.

For the period 2020 to 2021, to 2022 to 2023, the estimated direct financial benefit to consumers was £8,141.5 million in aggregate, representing annual average consumer savings of £2,713.8 million. The average ratio of direct benefits to cost over the last three years was 25.8 to 1. The largest projects contributing to this year’s estimates were the Veolia / Suez merger inquiry[footnote 3] and the Mobile ecosystems market study.[footnote 4]

Table 1: Estimated average annual CMA consumer savings and costs for 2020 to 2021 and 20222 to 2023

Area of CMA work Direct benefits (£m)
Competition enforcement 132.3
Consumer protection enforcement 185.6
Merger control* 652.2
Market studies and market investigations 1743.7
Total benefits 2713.8
Costs 105.1†
Benefit/costs 25.8:1

*The CMA has a duty to investigate mergers that legally qualify for scrutiny. This means that CMA merger control work is demand-led and not discretionary, unlike most other areas of the CMA’s work. Given that the number of qualifying mergers can vary considerably from year-to-year (because of fluctuations in the economic cycle for example), the number of investigated mergers and the direct consumer benefits of the CMA’s merger control work can also vary significantly from year-to-year.

†This is total CMA costs (actual spend) minus the costs of the CMA work on regulatory appeals.

The assessment is undertaken by the CMA itself and is reviewed by an external expert. This year the expert was Dr Franco Mariuzzo of the University of East Anglia.[footnote 5] The methodology used by the CMA is based on that developed and used by the Office of Fair Trading (OFT) and the Competition Commission (CC),[footnote 6] validated by successive independent academic reviewers and consistent with approaches now regarded by the OECD as international good practice.[footnote 7]

Impact assessments for cases are conducted immediately after they have finished. They are based only on information available during the case and on assumptions regarding the expected impact of our interventions and, as such, are considered to be ‘ex ante’ evaluations.[footnote 8] For example, for market studies and investigations the impact estimates capture the expected future benefits of remedies, rather than an ex post assessment of their effectiveness in practice. In general, the assumptions we apply are cautious and, hence, we consider our estimates to be conservative. To gain further understanding of the impact of the CMA’s work, we also conduct ex post evaluations for a small subset of cases that help us to critically assess the effects of past interventions, drawing lessons and implications to inform future decision making at the CMA.[footnote 9]

Our estimates exclude the impact of a number of cases where the CMA’s intervention is likely to generate considerable consumer benefits, but these benefits were difficult to quantify in a sufficiently robust manner. The estimate of benefits excludes the CMA’s compliance work,[footnote 10] international activities,[footnote 11] and regulatory appeals.[footnote 12] In the latter case this is because the CMA’s role is an appellate one rather than being the primary regulator.[footnote 13] The benefits from our advocacy to government are also excluded.[footnote 14]

In addition, the focus on direct financial benefits means that we exclude many important wider impacts of the competition regime. For example, we do not take into account the deterrence effect of our work, such as the deterrence of anti-competitive mergers or of anti-competitive conduct. Evidence from existing academic studies,[footnote 15] previous OFT research,[footnote 16] and an ex-post evaluation conducted in 2018,[footnote 17] indicate that such deterrence can be significant albeit very difficult to measure precisely. The impact of this deterrence is likely to be particularly strong in the areas of competition and consumer protection enforcement.

Studies also show that increases in competition in a market are often associated with increases in productivity, and that competition policy interventions can, therefore, improve productivity.[footnote 18] This impact on productivity is not captured in our impact assessment. In sum, evidence suggests that the direct impact of interventions is only a part of the overall positive impact of the CMA’s work.

2. Overview of our methodology

The impact estimates included within this report focus on the direct financial benefits to consumers of the CMA’s work completed over the past three financial years. We average the benefits over three years to reduce yearly fluctuations in the impact estimates due to uneven caseload[footnote 19] and to reflect the fact that some of our cases take more than one year to complete. The direct financial benefits to consumers may include, for example, the direct reduction in prices to consumers or the value to consumers of improvements in quality, service, or information provision following an intervention.

We present estimates of the impact of our work for each of the following areas:

  • Competition law enforcement
  • Consumer protection enforcement
  • Merger control
  • Market studies and market investigation references (collectively referred to as ‘markets work’ in this document)

For merger control and markets work, the CMA is both the phase 1 and phase 2 authority in a two-stage process (phase 1 cases being referred to phase 2 where there are sufficient competition concerns to require further, more in depth, investigation). Although the decision makers at phase 2 comprise a group of independent members drawn from the CMA panel (to ensure a transparent and distinct process), the CMA has responsibility for both phases including their resourcing. Where cases have been referred to phase 2, benefit estimates are only made once the phase 2 process has been completed, although both phase 1 and phase 2 costs are part of the impact assessment.

For confidentiality reasons, we do not publish impact estimations for individual cases and projects. However, our estimates have been independently reviewed by Dr Franco Mariuzzo to ensure that our benefit estimates are reasonable and robust.[footnote 20]

The CMA impact assessment estimates include benefits from cases where the outcome is under appeal at the time of publication of the report. We include these benefits as we consider this ensures the impact assessment is the best estimate of the likely impact of CMA cases at the time of the publication of the report. In addition, this approach also ensures that the benefit estimates are included in the impact assessment at roughly the same time as the costs the CMA incurred in carrying out the case.[footnote 21]

To calculate the impact of any case or project, the CMA usually estimates the following components based on information and evidence available from the original investigation:

  • The size of the affected turnover.
  • The price, quality or other negative effect removed or avoided due to the CMA’s intervention (usually increased price, but may be in the form of decreased quality, decreased choice, etc).
  • The length of time the detriment (e.g. higher prices) would have prevailed absent the intervention.

First, we estimate the annual impact on consumers by multiplying the turnover of the affected goods and services by the assumed price increase that was removed or avoided due to our action. Second, we estimate future consumer savings by multiplying the annual impact by the number of years we believe the detriment to consumers would have prevailed. We discount future accruals of benefits (see paragraph 2.13).

Data on the size of the turnover affected by our intervention (referred to as ‘affected turnover’) is usually gathered by the case team as part of its evidence-gathering and can be recalled from the original investigation. To be conservative, the CMA typically applies a narrow definition of the affected turnover by estimating it as the turnover of the directly affected firms. That is, we typically assume that the price of the goods or services competing with those offered by the firm(s) subject to the investigation in the market are unaffected, even though it is likely that, in some circumstances, they would also be affected by our intervention. At other times, where the CMA tackles a sector more widely (for example, through markets or consumer protection work), to estimate the affected turnover we need to make assumptions on the size of the market that is affected by our action.

In relation to the effect avoided or removed due to the CMA’s intervention, where possible, we base our estimates on information collected during the original investigation. This may be, under rare circumstances, information on the actual effect (for example, the price overcharge due to an unfair pricing practice, or the amount refunded to customers after cancellations due to restrictions related to Covid-19). More frequently, this is an estimation of the likely effect on consumers (which can be informed by the magnitude of upward pricing pressure resulting from a merger) as assessed by the case teams during the original investigation. Where such information and data are unavailable, we apply rules of thumb that are conservative interpretations of estimated effects and consistent with recent academic research.

Similarly, when estimating the expected future duration of the detriment prevailing absent our intervention, we draw on information collected at the time of the original investigation. As a starting point, we tend to take a default duration value that is based on, but not necessarily equal to, existing international practice and academic research, and we adjust this value where case-specific information suggests this would be appropriate.

Ex ante estimates of impact are based on the best information available at the time of estimation, which is typically when the decision or recommendations have been made but the full impact is not yet observable. In contrast, ex post evaluations are usually more robust and are based on information gathered after the recommendations or remedies have been implemented and the resulting impact realised, often several years after the case has been completed. The CMA commissions independent ex post evaluations on a regular basis to consider the effects of enforcement and merger review in key markets.

For example, in 2022 the CMA hired the economic consultancy E.CA Economics to undertake an ex-post assessment of merger control decisions involving vertically-related firms.[footnote 22] E.CA Economics evaluated the CMA’s assessment of vertical theories of harm in four merger clearance decisions.[footnote 23] The project drew on evidence relied upon by the CMA during the original investigation as well as additional evidence gathered ex-post to determine (among other things) whether the CMA made the right decision. Other ex-post evaluations include an evaluation of the impact and deterrence effect resulting from five competition enforcement cases, carried about by the economic consultancy DotEcon and published in 2018.[footnote 24] This review estimated the change in behaviour and competition awareness of firms in industries where the CMA had previously taken enforcement action. The review found that awareness of competition law was higher in both the industry where the CMA took enforcement, and in adjacent industries, than the average across businesses in the UK. It also found that some businesses had modified (or intended to modify) an agreement or commercial initiative as a result of enforcement action in their industry.

In line with central government techniques for discounting future accruals of benefits or costs, we discount future consumer savings by the HM Treasury endorsed Social Time Preference Rate (3.5%).[footnote 25]

Under certain circumstances we also need to use the Consumer Price Index to bring the benefits to the price level of the current year. This is the case when, due to the CMA’s investigation, consumers are able to seek redress for any past harm suffered.

3. Consumer savings by area

Competition enforcement

The CMA engages in a range of activities aimed at ensuring compliance with the Competition Act 1998 (CA98), including formally investigating and taking enforcement action against anti-competitive practices and using ‘softer’ tools such as providing guidance and targeted compliance initiatives.[footnote 26] Under the Enterprise Act 2002 (EA02), the CMA can also investigate and prosecute individuals for certain breaches.

We estimate that the CMA’s interventions in this area saved consumers at least £397.0 million in aggregate during the financial years from 2020 to 2021, to 2022 to 2023, representing annual average consumer savings of £132.3 million. These figures are based on anticipated price reductions that are likely to follow the break-up of a cartel or the termination of other unlawful conducts.

Our impact figure for the 2022 to 2023 financial year is based on two competition enforcement investigations concluded by the CMA in this period. The two investigations were into a capacity sharing agreement between P&O Ferries and DFDS[footnote 27] and into conduct of Education Software Solutions Limited.[footnote 28] This represents a substantial decrease from 2020 to 2021 when 11 such cases were concluded but is not greatly different from 2021 to 2022 when only 1 such case was concluded. Competition enforcement cases often last for multiple years, so the number of cases concluding in a particular year does not necessarily reflect the amount of work undertaken in that year.

There were competition enforcement cases that concluded in 2022 to 2023 where the offending practice ceased prior to our investigation meaning that we have not included them in the impact assessment.[footnote 29] Whilst these cases do not involve direct benefits, they are likely to have significant deterrent effects, as demonstrated by the DotEcon report on the deterrence effect of competition enforcement cases mentioned earlier.[footnote 30]

Consumer protection enforcement

The CMA’s consumer protection enforcement work seeks to change trader behaviour that appears to contravene consumer protection legislation using a range of interventions such as publishing guidance, issuing informal warnings, accepting undertakings under the EA02, or obtaining court orders. All interventions are aimed at protecting consumers, particularly vulnerable consumers, from rogue trading, unfair commercial practices, and other breaches of consumer protection legislation.

The CMA often works together with other organisations, for example Trading Standards,[footnote 31] who are also responsible for consumer protection enforcement and tackling unfair trading practices. It also cooperates with other national authorities within the Consumer Protection Cooperation Network to apply and enforce consumer rights legislation. In our impact assessment, we include consumer benefits resulting from these joint actions, where these have been led or significantly influenced by the CMA, by allocating a proportion of the benefits to the CMA.

For the financial years 2020 to 2021, to 2022 to 2023, the aggregate consumer benefit from relevant consumer enforcement work is estimated to be £556.8 million, giving an average of £185.6 million per year. These benefits may include a reduction in consumer detriment as a result of stopping unlawful practices, or the estimated price impact of the CMA’s interventions, for example as a result of increased transparency and more informed consumer decisions. The CMA’s PCR Travel Tests investigation accounts for the largest part of the 2022 to 2023 impact figure for consumer enforcement.[footnote 32]

Our estimates, as already noted, do not include the deterrence effect of the CMA’s consumer protection activities, even though we tend to prioritise cases where we expect that changing the behaviour of one business would set an important precedent or have other market-wide implications.

Merger control

The CMA operates both stages of the UK two-stage merger regime. Businesses can (voluntarily) notify a merger to the CMA and, in addition, the CMA has a duty to keep merger activity under review and can investigate mergers that have not been notified to it. At phase 1, the CMA reviews merger situations falling within its jurisdiction[footnote 33] and refers to phase 2 any cases where there is a realistic prospect of a substantial lessening of competition (SLC) in a UK market. The CMA has the power to accept undertakings in lieu (of reference to phase 2) (UiLs) from the merging parties at phase 1, if these are deemed to address potential concerns identified in the course of its investigations.

At phase 2, a CMA panel of independent members conducts an in-depth investigation to assess if a merger is expected to result in an SLC. If an SLC is expected, the CMA panel decides on the remedies required and can impose remedies by order if it is not able to agree on them with the businesses.

Our estimates of consumer savings in this area include merger proposals amended through UiLs, mergers that are abandoned, and mergers amended or prohibited by the CMA at phase 2.

The impact of phase 1 mergers is scaled down by the ‘SLC rate’ (which is defined below) to reflect the fact that not all cases where the merger parties remedied the CMA’s concern, either through UiLs or abandoning the merger, would have resulted in an SLC at phase 2. The SLC rate is calculated as the proportion of phase 2 mergers completed in the past three years which resulted in SLCs after the parties had offered UiLs that were rejected in phase 1. This approach is in line with our updated methodology explained in detail in the 2016 to 2017 report.[footnote 34] The SLC rate used to scale down the impact of all phase 1 mergers in the 2022 to 2023 assessment is 75%.[footnote 35]

Using the approach described above, our estimates show that during the past three financial years (2020 to 2021, to 2022 to 2023) the merger regime saved consumers £1,956.5 million in total, giving an average of £652.2 million per year.[footnote 36]

Our impact figure for the 2022 to 2023 financial year is based on 15 phase 1 and 8 phase 2 merger inquiries. This represents a significant increase relative to last year, where the impact figure was based on 7 phase 1 and 6 phase 2 merger inquiries. The merger inquiry which made the most substantial contribution to our overall impact figured was Veolia/Suez, where the CMA required a divestiture, having found substantial lessening of competition in 7 theories of harm in waste or water management.[footnote 37]

The benefits from the UK merger regime are dependent on the cases that come to the CMA for assessment and are, therefore, driven in part by the economic climate and can vary significantly from year to year. Benefit figures for mergers do not include the wider benefits, such as deterrence, of the CMA’s mergers work and the wider merger regime. We would expect deterrence effects to be significant and, therefore, that having an effective merger control regime in itself prevents anticompetitive mergers from being proposed.[footnote 38]

Market studies and market investigations

Market studies are examinations of why particular markets are not working well for consumers and often lead to proposals as to how they might be made to work better. They take an overview of regulatory and other economic drivers in a market and patterns of consumer and business behaviour.

Markets may be referred for a market investigation for further analysis where there are reasonable grounds for suspecting that any feature, or combination of features, of a market in the UK is preventing, restricting, or distorting competition. In estimating consumer savings, we consider the impact of both market studies that have not resulted in a market investigation and completed market investigations. Given the wide variety of projects that our markets work covers, the exact method used to estimate impact differs from case to case. We include ex ante estimates of impact from those projects where the CMA’s recommendations and/or orders are expected to be implemented by the relevant bodies (e.g. regulators and other government departments) and, therefore, have a positive impact on consumers.

When estimating our impact from any markets project, we also consider how likely the recommendations or orders are to be implemented by the relevant bodies. To account for the uncertainty associated with the market and policy context and, therefore, with the overall effectiveness of the remedies, we use cautious assumptions when estimating the benefits. Moreover, where we think that the proposed remedies may not be fully implemented, estimates are further scaled down according to the assumed likelihood of implementation.

We estimate that the direct consumer benefits from the CMA’s interventions through the markets regime were £5,231.2 million in total during the financial years from 2020 to 2021, to 2022 to 2023, giving an average of £1,743.7 million per year.

The mobile ecosystems market study was the only markets case concluded in the financial year 2022 to 2023.[footnote 39] The CMA subsequently launched a mobile browsing and cloud gaming market investigation into some of the areas identified by this market study, in other areas the CMA recommended these be addressed by the DMU once established. The impact figure for this case is based on the areas the CMA recommended be addressed by the DMU. Similar to how the impact estimate was calculated for the online platforms and digital advertising market study in 2020 to 2021, we have attributed only a portion of the benefits resulting from these actions to the 2022 to 2023 estimates.

4. Costs

To ensure that yearly fluctuations in the cost figure which are not reflective of the true cost of running the CMA do not distort the picture for the CMA’s impact, we use a three-year moving average for total costs. This is consistent with the way in which we report estimated benefits.

For the purposes of calculating the benefit to cost ratio, the total costs of the CMA exclude the costs incurred in fulfilling the CMA’s function with regard to the determination of regulatory appeals as we do not include any benefits from these in the impact assessment.

On this basis, the average annual CMA cost over the financial years 2020 to 2021, to 2022 to 2023 is estimated to be £105.1 million.

  1. BEIS (August 2021), Framework Agreement Between: The Competition And Markets Authority and The Department for Business, Energy and Industrial Strategy

  2. Ibid, paragraph 9.2. 

  3. Veolia / Suez, Inc merger inquir

  4. Mobile ecosystems market study 

  5. Dr Franco Mariuzzo is an Associate Professor in Econometrics at the University of East Anglia. 

  6. OFT (July 2010), Guide to the OFT’s impact estimation methods

  7. OECD (April 2014), Guide for assessing the impact of competition authorities’ activities

  8. In rare circumstances we have used ex post information to improve our impact assessments. 

  9. See examples in paragraph 2.12. 

  10. For example, engaging with small and medium enterprises, their trade associations and intermediary advisors in England and the Devolved Nations. 

  11. For example, engaging with international networks and organisations. 

  12. For example, the 2020 to 2021 appeal of the Ofwat PR19 Price Determinations

  13. The CMA’s duty in this area is to act according to the relevant legal framework rather than necessarily acting in the immediate interest of consumers. 

  14. This includes advice, support and recommendations to government to help promote competition and consumer interests in the policymaking process. 

  15. As collated in the CMA’s 2017 literature review, The deterrence effect of competition authorities’ work – literature review

  16. See The impact of competition interventions on compliance and deterrence, OFT1391 and The deterrent effect of competition enforcement, OFT 962

  17. DotEcon (2018), Evaluation of direct impact and deterrent effect of CA98 cases

  18. CMA (2015), Productivity and competition: a summary of the evidence

  19. Although some areas of the CMA’s work are proactive, such as market studies and investigations, other areas depend on factors outside of the CMA’s control. For further discussion of this issue see paragraph 3.16. 

  20. Consistent with the purposes of the review exercise, we asked Dr Mariuzzo to confirm the accuracy of the calculations of impacts. He also commented on the consistency of the estimates with our published guidance, and consistency of approach taken between different cases. He was not asked to comment on the underlying assumptions where these were based on analysis carried out as part of individual cases (for example, the estimates of affected turnover in the SLC market). In his report he made several suggestions for the revision of the methodological guidelines for consideration in future impact assessments. 

  21. It can be several years before appeals are concluded leading to a significant lag between the inclusion of the benefits and costs of certain cases. 

  22. E.CA Economics (April 2022), Ex-post evaluation of vertical mergers. 

  23. Tulip/Easey, Heineken/Punch, Mastercard/Vocalink, and Tesco/Booker. 

  24. DotEcon (2018), Evaluation of direct impact and deterrent effect of CA98 cases. Based on the results of a survey of businesses, DotEcon assessed awareness of five CA98 cases and of competition law more generally, and sought to quantify the indirect, deterrent effect on firms not subject to the original enforcement action. DotEcon found a clear link between CMA/OFT intervention and greater levels of awareness and understanding of competition law, specifically in relation to the illegality of specific infringing behaviour in the selected CA98 cases. Furthermore, there is evidence to support the view that awareness of cases pursued by the CMA/OFT changes the perception of being caught and prosecuted, ultimately deterring infringing behaviour by other firms. DotEcon estimated that the indirect deterrence effect is plausibly a multiple of the direct effect. Although the effect per firm is small, there is a significant benefit due to the large number of businesses being deterred from engaging in anti-competitive behaviour. 

  25. See HM Treasury, The Green Book: Appraisal and Evaluation in Central Government

  26. The benefits from these softer tools are not typically included in the quantified estimate of benefits. 

  27. Investigation into a capacity sharing agreement between P&O Ferries and DFDS 

  28. Investigation into conduct of Education Software Solutions Limited 

  29. For example, Domestic Lighting: anti-competitive practices concerning resale price maintenance 

  30. DotEcon (2018), Evaluation of direct impact and deterrent effect of CA98 cases. For further discussion, see paragraph 2.12. 

  31. For an evaluation of the activities of Trading Standards, see OFT (June 2009), An evaluation of the impact of the fair trading work of local authority Trading Standards Services in the UK, OFT1085

  32. PCR Travel Tests 

  33. Up to 31 January 2020, mergers that fulfilled certain conditions fell within jurisdiction of the European Commission. 

  34. CMA (July 2017), CMA impact assessment 2016/17

  35. In 2021 to 2022 it was 71% and in 2020 to 2021 it was 75%. 

  36. Estimates exclude any impact to non-UK customers. In particular, we use the conservative approach of accounting for the impact of mergers with a global frame of reference only on UK sales. For example, if we had accounted for the impact of phase 1 merger Tronox/Tizir which concluded in 2020 to 2021 on the global market instead of the UK only, its estimate would have been more than 14 times larger. 

  37. Veolia / Suez, Inc merger inquir

  38. We note that there can also be an effect of ‘chilling’ where pro-competitive or benign mergers are deterred due to the merger control regime; however, we would expect this effect to be low because the CMA operates in a voluntary notification framework. 

  39. Mobile ecosystems market study