Research and analysis

Sources of demand-side problems

Published 3 August 2017

The content is divided into ‘core reading’ and ‘further reading’ lists. Core reading captures fundamental and/or important documents of use primarily to inexperienced users while further reading lists capture more specific material intended for experienced practitioners.

1. Overview of demand-side problems

1.1 Core reading

Document Topics covered Notes
CC (2013), ‘Guidelines for market investigations: Their role, procedures, assessment and remedies’ (Part 3: ‘weak customer response’) Weak consumer response, features harming competition, competitive markets, market characteristics. Part 3 of this guidance addresses the 3 key analytical issues the CMA looks at in market investigations:
- the characteristics of the market and the outcomes of competition within it
- the definition of the market
- the state of competition in the market whether there are any features harming competition
Paras 295-318 of this guidance set out the factors the CMA will consider in relation to ‘weak customer response. This includes difficulties customers may face in accessing information, identifying best value offers and switching suppliers.
FCA (2016), ‘Economics for Effective Regulation’ Issue diagnosis, intervention design, impact assessment. The paper presents a market-based approach to the design of regulation. It produces a combined assessment of all the main problems facing regulators who want to make markets work well: information asymmetries, externalities, market power, and behavioural distortions, as well as the effects of previous intervention.

1.2 Further reading

Document Topics covered Notes
UKRN (2015), ‘Consumer engagement and switching’ Barriers to consumer engagement, switching, behavioural remedies. Report analyses past and ongoing work on consumer engagement and switching already undertaken by participating regulators. It also identifies and groups 12 key barriers that make it difficult for consumers to engage, assess and/or act.
Europe Economics (2007), ‘An analysis of the issue of consumer detriment and the most appropriate methodologies to estimate it’ – report for DG SANCO (Parts 1 and 2)
Handbook to Assess consumer detriment) – report for DG SANCO (Parts 1 and 2)
Handbook to Assess consumer detriment
Consumer detriment, markets, consumer welfare, consumer dissatisfaction. The purpose of this paper is to review theoretical and empirical literature which shed light on the following:
- How consumer detriment can arise and the factors that may affect its magnitude
- How consumer detriment might be measured
- How markets could be monitored for the possible presence of consumer detriment
Luke Garrod, Morten Hviid, Graham Loomes and Catherine Waddams, CCP (2008), ‘Assessing the effectiveness of potential remedies in consumer markets – OFT994’ (in particular, section 3) Consumer remedies, market investigations, behavioural remedies, economic theory, bounded rationality, search costs, switching costs. This paper summarise the existing economic theory and empirical evidence underlying a number of remedies in consumer markets.
Section 3 of this paper provides a discussion of why consumers may be inactive in a market.
Specifically, there is a brief review of the impact on consumer behaviour and competition of:
- search costs
- switching costs
- bounded rationality and non-standard preferences.
In addition, there is discussion of what makes a successful remedy.
Stefano Della Vigna (2009), ‘Psychology and Economics: Evidence from the field’ Consumer preferences, consumer behaviour, empirical analysis, decision making. The paper looks at research in Psychology and Economics, and specifically:
(1) nonstandard preferences
(2) nonstandard beliefs
(3) nonstandard decision making
The paper surveys the empirical evidence from the field on these 3 classes of deviations.

2. Informational market failures, search and switching costs

2.1 Core reading

Document Topics covered Notes
OFT655 (2003), ‘Switching Costs’
Annex A, ‘Literature review’
Annex B, ‘Empirical methods’
Annex C, ‘Case studies’
Switching costs, search costs, imperfect information, effect on competition, intervention design, empirical analysis, literature review. The paper looks at different types of switching costs and provides an overview of the economics of switching costs and how they can affect competition, including a review of literature on switching costs. It also discusses the implications for competition policy and interventions and provides a practical guidance for the assessment of the effect of switching costs (including annexes focusing on empirical methods and case studies).
Search costs are discussed in detail in Chapters 2 – 4 and Annex A.
Information market failures are discussed in detail in Chapter 4 – The economics of switching costs and Annex A.
OFT (1997), ‘Consumer Detriment under Conditions of Imperfect Information’ Imperfect information, search costs, intervention design. The paper looks at the markets with imperfect information and search costs, examines how consumers make choices in such markets and how this may effect competition and consumer welfare. The paper develops a framework which helps to identify markets where consumer detriment is likely to be a problem and devise appropriate remedies.

2.2 Further reading – informational asymmetry

Document Topics covered Notes
OFT1531 (2014), ‘Competing on quality – literature review’ Increased competition, competing on quality, price setting, price regulation. The paper consists of 2 separate reports: a general literature review (General Report) and a literature review focusing on the healthcare sector (Healthcare Report).
Both reports emphasise the challenges around the objective and robust measurement of quality and both find that the literature can provide only limited insights into the relationship between competition and quality when suppliers are free to set both quality and prices. In contrast, when suppliers are not free to set prices – for example, because prices are regulated – the literature points toward a positive relationship between increased competition and improved quality.
Hunter J, Ioannidis C and Iossa E (2001), ‘Measuring Consumer Detriment under Conditions of Imperfect Information’ Imperfect information, search costs, product quality The paper discusses different models and empirical techniques to measure consumer detriment due to the presence of imperfect information about prices and quality.
Akerlof G (1970), ‘The Market for “Lemons”: Quality uncertainty and the Market Mechanism’ Imperfect information, product quality, consumer uncertainty. The classic article examines the effect of information asymmetries on competition.
The paper concludes that it is difficult to distinguish between good quality and bad; and that this may explain many economic institutions and may be one of the more important aspects of uncertainty.

2.3 Further reading – search costs

Document Topics covered Notes
Baye M, Morgan J and Scholten P (2006), ‘Information, Search, and Price Dispersion’ Search costs, empirical analysis. The paper provides a unified treatment of several theoretical models that explain the price dispersion observed in many homogeneous product markets.
Ellison G and Fisher Ellison S (2009), ‘Search, Obfuscation, and Price Elasticities on the Internet’ Search costs, online platforms, empirical analysis. The paper examines a model of competition between internet retailers who operate in an environment where a price search engine plays a dominant role. The authors discuss several consumer obfuscation models and examine their effects on demand and mark-ups empirically.
Stigler G (1961), ‘The Economics of Information’ Search costs, price dispersion, consumer choice, search engines. The paper examines the effect of search cost on competition and price dispersion. The paper finds that the identification of sellers and the discovery of their prices are only one of the roles of search information in economic life.
The paper finds that the search for knowledge on the quality of goods is equally important.
Diamond P (1971), ‘A Model of Price adjustment’ Search costs, competitive prices, consumer choice. The paper examines the implications of the existence of search costs on competition. It finds that in a market with search costs, firms have incentives to increase prices above competitive levels, as a result of consumers having no incentives to search and choosing a firm randomly.
Salop S and Stiglitz J (1977), ‘Bargains and ripoffs: a model of monopolistically competitive price dispersion’ Search costs, price dispersion, price discrimination The paper examines a model where in a market with search costs, firms price discriminate across informed and uniformed consumers.

2.4 Further reading – switching costs

Document Topics covered Notes
Farrell J and Klemperer P (2007) ‘Coordination and Lock-In: Competition with Switching Costs and Network Effects’ Switching costs, network effects, lock-in, network externalities, co-ordination, indirect network effects. The paper examines the implications of consumer switching costs in a market with network effects.
The paper finds that even inefficient incompatible competition is often more profitable than compatible competition, especially for dominant firms with installed-base or expectational advantages.
Wilson C and Waddams Price C (2005), ‘Irrationality in Consumers’ Switching Decisions: When More Firms May Mean Less Benefit’ Switching costs, empirical analysis, consumer behaviour. The paper examines irrational consumer behaviour (for example: not switching, switching from to a more expensive supplier) in UK’s electricity market.
Luis Cabral (2015), ‘Dynamic Pricing in Customer Markets with Switching Costs’ Switching costs, equilibrium prices, competitive markets, duopoly model. The paper looks at conditions under which switching costs decrease or increase equilibrium prices. Taken together, the results suggest that, if markets are very competitive to begin with, then switching costs make them even more competitive; whereas if markets are not very competitive to begin with, then switching costs make them even less competitive.
Klemperer P (1987), ‘Markets with Consumer Switching Costs’ Switching costs, monopoly power, consume switching, consumer choice. The paper examines consumer switching costs and their potential effect on competition. Using a two-period model the author shows that the existence of switching costs may lead to firms gaining monopoly power in the second-period. However, in the first-period firms engage in vigorous competition for market share before consumers have attached themselves to a particular supplier.
Farrell J and Shapiro C (1988), ‘Dynamic competition with Switching Costs’ Switching costs, duopoly model, barriers to entry. Using a duopoly model of dynamic competition with switching costs, the authors show that firms with larger customer base are less aggressive in seeking to attract new customers.
The paper also examines the effect of switching costs on entry by firms, showing that they do not always act as a barrier to entry.

3. Behavioural economics

Document Topics covered Notes
BIT (2016), ‘Applying behavioural insights to regulated markets’ Behavioural economics, behavioural biases, supply side, demand side, intervention design, application to regulated markets, vulnerable consumers. The paper provides an overview of the key behaviour biases present in regulated markets and provides examples of interventions used to address them also discussing their effectiveness.
Appendix A provides detailed examples of suggested behaviourally-informed interventions.
FCA (2013), ‘Applying Behavioural Economics at the FCA Behavioural economics, behavioural biases, behavioural io, intervention design, demand side, supply side, information asymmetries, effect on consumer welfare, effect on competition. The paper provides a good overview of behavioural economics, behavioural consumer biases and how they can be exploited by firms leading to consumer detriment. Provides guidance to regulators on how behavioural economics can be put into practice.
The annex lists 10 key biases, their effects, firm responses and potential remedies to address each of them.
OFT1224 (2010), ‘What does Behavioural Economics mean for Competition Policy?’ Behavioural economics, behavioural IO, behavioural biases, access assess act framework, demand side, supply side, effect on consumer welfare, effect on competition, intervention design, irrational firms. The paper provides an overview of demand-side behavioural biases and how they can affect competition. It looks at how behavioural biases may affect consumers (demand side), how firms may exploit these biases (supply side) and how this may effect consumer welfare. It also provides a discussion of how behavioural biases may affect antitrust enforcement and interventions.
The paper also explores how behaviour by irrational firms (supply-side biases) may affect competitive outcomes.
OECD, Pete Lunn (2014), ‘Regulatory Policy and Behavioural Economics’ Behavioural economics, regulatory policy, public policy. This study offers an international review of the initial applications of behavioural economics to policy, with a particular focus on regulatory policy. It describes the extent to which behavioural findings have begun to influence public policy in a number of OECD countries, referring to a total of more than 60 instances, the majority of which concern regulatory policy.

3.1 Further reading – behavioural biases

Document Topics covered Notes
OFT1324 (2011), ‘Consumer behavioural biases in competition: A survey’ Behavioural economics, behavioural biases, behavioural IO, literature review, demand side, supply side, search costs, imperfect information, intervention design. The paper provides a review of literature which discusses models witch take into account the existence of various behavioural biases. The paper also discusses potential remedies which may bused to address these issues and describes empirical strategies to identify the presence of behavioural biases.
Oxera (2016), ‘Behavioural insights into Australian retail energy markets’ Behavioural biases, behavioural economics, consumer engagement, access assess act framework, demand side, supply side, energy markets, intervention design. The paper provides a summary of different behavioural biases, their effect on consumer behaviour (demand side), how firms may exploit these biases (supply side) and how this may affect market outcomes. The paper also discusses policy implications and provides an overview of different interventions and their effectiveness in resolving behavioural biases.
BIS (2016), ‘Evidence review of Trigger Points in Regulated Markets’ Behavioural biases, consumer engagement, intervention design, vulnerable consumers. The paper provides an overview of behavioural biases and discusses tools which could be used to increase consumer engagement triggers and the effectiveness of some of them. Also looks at issues facing vulnerable consumers.
Ellison G ‘Learning from Personal Experience: One Rational Guy and the Justification of Myopia’ Consumer choice, rational behaviour, behavioural economics, risk awareness and choices The paper examines a large population of fictitious play in which players learn from personal experience, focusing on what happens when a single rational player is added to the population. The paper finds that because the learning process generates contagion dynamics, the rational player at times has an incentive to act non-myopically. The paper finds that in 2X2 games the dynamics are asymmetric and favour risk dominant equilibria. The paper presents a variety of other examples.
Ellison G and Fudenberg D ‘Word of Mouth Communication and Social Learning’ Social learning, consumer choice, communication. The paper looks at how word-of-mouth communication aggregates the information of individual agents. The paper finds that the structure of the communication process determines whether all agents end up making identical choices, with less communication making this conformity more likely. The paper also finds that word-of-mouth communication may lead all players to adopt the action that is on average superior.
Ellison G and Fudenberg D ‘Rules of Thumb for Social Learning’ Social learning, consumer choice, behavioural economics, behavioural bias. This paper present 2 models of how economic agents decide which of 2 technologies to use when the relative profitability of these technologies is unknown. The paper looks at ‘social learning’ (where agents base decisions on the experience of their neighbours) and how that is a very important factor in the process of technology adoption.
Scheibehenne B, Griefeneder R and Todd PM (2010), ‘Can there ever be too many options? A meta-analytic review of choice overload’ Choice overload hypothesis, consumer choice, consumer behaviour, RCTs. The paper looks at the ‘choice overload hypothesis’. A number of previous studies found strong instances of choice overload in the lab and in the field, but others found no such effects or found that more choices may instead facilitate choice and increase satisfaction. The authors found a mean effect size of virtually zero but considerable variance between previous studies. While further analyses indicated several potentially important preconditions for choice overload, no sufficient conditions could be identified. The paper reviews these studies and identifies possible directions for future research.
Gabaix, Xavier and Laibson, David (2006), ‘Shrouded attributes, consumer myopia, and information suppression in competitive markets’ Behavioural biases, consumer myopia, economic behaviour. The paper looks at how some firms exploit myopic consumers through marketing schemes that shroud high priced add-ons. In turn, sophisticated consumers exploit these marketing schemes. The authors show that informational shrouding flourishes even in highly competitive markets, even in markets with costless advertising, and even when the shrouding generates allocational inefficiencies.
Simon HA (1986), ‘Rationality in psychology and economics’ Behavioural biases, consumer rationality, economic behaviour. The paper examines the differences between economic and psychologic/behavioural concepts of consumer rationality.
Keller, Harlam, Loewenstein, and Volpp (2011), ‘Enhanced active choice: A new method to motivate behaviour change (Journal of Consumer Psychology)’ Consumer choices, behavioural biases, active choice, effective decisions. The paper presents a series of studies, including 2 field experiments, that test the effectiveness of an alternative, ‘active choice’ policy in which there is no default, but decision makers are required to make a choice (Carroll, Choi, Laibson, Madrian, & Metrick, 2009; Spital, 1993, 1995). In addition, The authors propose and test a modified version of active choice, ‘enhanced active choice’ that favours one alternative by highlighting losses incumbent in the in the non-preferred alternative.

3.2 Further reading – behavioural industrial organisation

Document Topics covered Notes
Spiegler R (2011), ‘Bounded Rationality and Industrial Organization’ Behavioural IO, consumer behaviour. The book covers various behavioural IO topics. It seeks to summarise and synthesise recent developments in the theory of IO that incorporate departures from the standard model of consumer behaviour.
FCA (2016), ‘Occasional Paper No 13 - Economics for Effective Regulation’ Intervention design, impact assessment, behavioural economics, information asymmetries, behavioural IO. The paper provides an overview of a market-based approach to the design of regulation and the assessment of the effects of interventions. The approach is split into 3 key stages: problem diagnosis, intervention design and impact assessment.
Behavioural IO is covered in Chapter 2.
Appendix 3 contains examples of 11 systematic drivers of poor market outcomes and Appendix 4 provides an overview of the types of harm that can arise.
Spiegler R (2006), ‘Competition over agents with boundedly rational expectations’ Behavioural IO, behavioural economics. obfuscation. The paper examines the implications of market competition in markets where consumers are not perfectly rational. The paper shows that interventions which foster competition in market with rational consumers (for example: increasing the number of competitors, introducing an attractive outside option) may have adverse welfare effects when consumers are limited in their ability to evaluate complex objects. The reason is that firms respond by obfuscating, rather than by acting more competitively.
UEA (2013), ‘Behavioural economics in competition and consumer policy’ Behavioural IO, behavioural economics, behavioural biases, intervention design, demand-side, supply-side, pricing practices. The paper provides an introduction to consumer biases and behavioural economics and discusses their implications for competition and consumer policy.
The paper also examines consumer irrationality and how firms can exploit such behaviour. Includes a discussion of remedies for interventions founded on behavioural economics. It also discusses the effects of price complexity and pricing practices adopted by firms and how people’s choices may change as a result of social influences.
Della Vigna S and Malmendier U (2004), ‘Contract Design and Self-Control: Theory and Evidence’ Behavioural IO, time-inconsistency. The paper examines the market interaction between profit-maximizing firms and consumers with time-inconsistent preferences and naive beliefs. The authors find that that in such markets firms deviate from marginal-cost pricing, charge back-loaded fees, and design contracts with automatic renewal and endogenous switching costs. The paper also discusses welfare effects.

3.3 Further reading – application to vulnerable consumer groups

Document Topics covered Notes
FCA (2014), ‘Occasional paper No. 8 – consumer vulnerability’ Vulnerable consumers, consumer choices. The paper discusses the issues surrounding vulnerable consumers. It provides an overview of the sources for consumer vulnerability, discusses potential problem areas and discusses the role of regulators (FCA) in protecting vulnerable consumer groups.
Lunn P and Lyons S (2010), ‘Behavioural Economics and ‘Vulnerable Consumers’: A Summary of Evidence’ Vulnerable consumers, behavioural biases, consumer choices. The paper summarises evidence from behavioural economics relating to vulnerable consumers and discusses whether they are more or less prone to certain behavioural biases. It also discusses the implications this may have for policy and regulation.
Centre on Regulation in Europe (2017), ‘Empowering electricity consumers in retail and wholesale markets’ Consumer choices, switching, vulnerable consumers. The report tries to shed light on the problems raised by the lack of engagement of electricity consumers in market activities and to examine the solutions that are currently put forward. The paper focuses on 2 solutions currently considered in several EU countries: incentivising switching to low price retailers and promoting demand response.

3.4 Further reading – pricing practices

Document Topics covered Notes
OFT1291 (2010), ‘Advertising of Prices’ Pricing practices, price framing, drip pricing, time limited offers, baiting sales, reference price, volume offers. The study examines the effects of price framing on consumer’s assessment of the value of the offer. The study also looks at the effects of DCTs and how they could mitigate the concerns around misleading price advertising (although this information might be a bit dated now).
Ellison G (2005), ‘A Model of Add-on Pricing’ Pricing practices, price framing, drip pricing. The paper examines 2 models of price discrimination: a standard competitive price discrimination model in which consumers observe all prices and an ‘add-on pricing’ game where the add-on prices are unobserved. The paper finds that add-on prices can raise equilibrium prices by creating an adverse selection problem that makes price-cutting unappealing for firms.
OFT1501A (2013), ‘Partitioned Pricing Research – The economics of partitioned pricing’ Pricing practices, price framing, drip pricing, consumer choice. The paper presents an economic experiment focusing on how different price framing mechanisms can impact consumer behaviour. It looks at ‘partitioned pricing’, ie where the price is split into multiple components, and includes a form of drip pricing. The report finds that price framing may lead to reduced search effort by consumers and that some price frames may also increase the number of mistakes consumers make as compared to straight unit pricing.
Gaudeul A and Sugden R (2012), ‘Spurious complexity and common standards in markets for consumer goods’ Imperfect information, common standard, signalling, choice complexity, behavioural economics The paper examines how firms can exploit consumer biases by introducing complexity into tariff structures, thus weakening price competition. The authors further explore the effect of the introduction of common product standards on consumer choice problems and firms’ incentives to compete.

4. Choices of remedies and types of demand-side interventions

4.1 Core reading

Document Topics covered Notes
Amelia Fletcher, CCP (2016), ‘The Role of Demand-side remedies in driving effective competition – report commissioned by Which?’ Remedies design, remedy choice, consumer engagement, behavioural economics. This paper examines the available evidence to date: what has been tried, what works, and what doesn’t? The evidence is primarily drawn from the UK, and comprises existing evaluations and reviews, as well as relevant academic research. Although the evidence base is limited, and thus any conclusions must necessarily be somewhat tentative, the paper sets out some thoughts on how the design and use of demand-side remedies might be improved in order to enhance their effectiveness.
CC (2013), ‘Market investigation guidelines’ (Part 4: remedial action and Annex B) Guidance, evaluation of detriment, demand-side remedy design, behavioural remedies. structural remedies. market opening measures. information remedies. controlling outcomes. Part 4 discusses the remedial action the CC may prescribe, if it has found there to be an AEC; this may include divestiture, behavioural remedies or recommendations for action by Government or others.
This part of the Guidelines first sets out the framework for consideration of remedies. It then provides an overview of different types of remedy – including ‘demand-side’ remedies - and their characteristics before setting out some of the main considerations that go into the selection of remedies from the options available.
Annex B offers a more detailed discussion of particular types of remedy discussed in Part 4. This annex summarizes some of the key considerations relevant to the evaluation, design and implementation of different classes of remedies. Section 2 of this annex seeks to outline the CC’s general approach to behavioural remedies, making reference to the types of measure that have been implemented in investigations at the time of writing, rather than dealing with all possibilities. A variety of behavioural remedies are considered, under the broad headings of enabling measures and measures to control outcomes.
FCA (2016), ‘Economics for Effective Regulation’ Interventions, regulation, evaluation of detriment, quantifying impact of remedies. The paper is split into the following sections:
(1) Overview
(2) The conceptual framework: working out when it makes sense to intervene in markets
(3) The process: diagnosing root causes of problems
(4) The process: designing effective interventions
(5) The process: assessing impacts of interventions
Appendix 1 – Describing the markets and its participants
Appendix 2 – Information gathering methods
Appendix 3 – Systematic drivers of poor market outcomes
Appendix 4 – Assessing types of harm
Appendix 5 – Types of harm: an illustration
Appendix 6 – Analysing the likely impacts of interventions on market outcomes
Appendix 7 – methods of (partly) quantifying indirect impacts
Luke Garrod, Morten Hviid, Graham Loomes and Catherine Waddams, CCP (2008), ‘Assessing the effectiveness of potential remedies in consumer markets – Report commissioned by OFT Remedies design, remedy choice, consumer engagement, behavioural economics. This paper presents and evaluates a number of remedies that can be used to encourage consumers to play a more active role in finding the best deal. This paper:
- identifies the potential benefits and costs of different types of remedy
- identifies the conditions under which a remedy is likely to have maximum positive impact on a market
- A broad conclusion of this study is that the power of the remedy is generally weaker the further that consumers are along the consumption path (that is, it is harder to change customer behaviour, once they have started to take a particular course of action).

4.2 Further reading – ‘paternalist’ remedies: benefits and risks of intervening on consumers’ behalf

Document Topics covered Notes
John Y Campbell (2016), ‘Restoring Rational Choice: The Challenge of Consumer Financial Regulation’ Financial regulation, welfare economics, paternalistic intervention This paper is the summary of a lecture given by John Campbell as part of the Richard T. Ely Lecturers for the American Economic Association. The paper considers the case for consumer financial regulation in an environment where many households lack the knowledge to manage their financial affairs effectively.
The lecture argued that financial ignorance is pervasive and unsurprising given the complexity of modern financial products, and that it contributes meaningfully to the evolution of wealth inequality.
The lecture used a stylised model to discuss the welfare economics of paternalistic intervention in financial markets, and discusses several specific examples including asset allocation in retirement savings, fees for unsecured short-term borrowing, and reverse mortgages.
Camerer C and others (2003), ‘Regulation for Conservatives: Behavioral Economics and the Case for ‘Asymmetric Paternalism’’ Behavioural economics, policy and regulation, paternalistic regulations This paper looks at ‘paternalistic’ regulations that are designed to help on an individual basis. Paternalism forces or prevents choices for the individual’s own good.
The paper proposes an approach to evaluating paternalistic regulations and doctrines that the writers call ‘asymmetric paternalism.’ A regulation is asymmetrically paternalistic if it creates large benefits for those who make errors, while imposing little or no harm on those who are fully rational.
The authors document existing and potential regulatory responses to decision-making errors that satisfy this criterion.
Berg N and Girgerenzer G (2007), ‘Psychology implies paternalism? Bounded rationality may reduce the rationale to regulate risk-taking’ Normative economics, behavioural economics, policy, ecological rationality, satisficing, libertarian paternalism, as-if, methodology, choice under uncertainty, procedural rationality. This paper considers whether to regulate risk-taking behaviour in a population whose individual-level behaviour may or may not be consistent with expected utility maximization. Using a social welfare function, the paper argues that psychological theories that depart from axiomatic decision-making norms (for example ‘behavioural biases’) do not necessarily strengthen the case for ‘paternalism’, and conformity with such norms is generally not an appropriate policy-making objective in itself.

4.3 Further reading – ‘nudges’

Document Topics covered Notes
Sunstein C (2014), ‘Nudging: a very short guide’ Types of nudges, behavioural insights unit. This paper offers a general introduction to the idea of nudging, along with a list of ten of the most important ‘nudges’.
The paper also provides a short discussion of the question whether to create some kind of separate ‘behavioural insights unit’, capable of conducting its own research, or instead to rely on existing institutions.
Sunstein C (2013), ‘Nudges.gov: behavioural economics and regulation’ Behavioural economics, nudge, regulation, energy efficiency. The paper discusses how behavioural economics is influencing regulatory initiatives in many nations and how it is likely to increase in the next generation.
The paper finds that choice architecture – including default rules, simplification, norms, and disclosure – can affect outcomes even if material incentives are not involved. Furthermore, behavioural economics has helped to inform recent and emerging reforms in areas that include savings, finance, distracted driving, energy, climate change, obesity, education, poverty, health, and the environment.
Johnson and others (2012), ‘Beyond nudges: Tools of a choice architecture’, Marketing Letters, 23, 487-504 Choice architecture, decision support, options and alternatives, describing attributes. This paper outlines the tools available to choice architects, which is anyone who present people with choices. The authors divide these tools into 2 categories:
- those used in structuring the choice task and
- those used in describing the choice options.
The paper discusses implementation issues in using choice architecture tools, including individual differences and errors in evaluation of choice outcomes.
This paper also presents a few applications that illustrate the positive effect choice architecture can have on real-world decisions.
Sunstein C (2016), ‘Nudges that fail’ Behavioural Insights Team, counter-nudges, choice architects, nudge. The paper looks at why some nudges are ineffective, or at least less effective than choice architects hope and expect. Focusing primarily on default rules, this paper emphasizes 2 reasons.
- The first involves strong antecedent preferences on the part of choosers.
- The second involves successful ‘counter-nudges’, which persuade people to choose in a way that confounds the efforts of choice architects.
The paper looks at a number of reason why nudges might be ineffective, and less effective than expected:
- Some nudges produce confusion on the part of the target audience.
- Some nudges have only short-term effects.
- Some nudges produce ‘reactance’ (though this appears to be rare).
- Some nudges are based on an inaccurate (though initially plausible) understanding on the part of choice architects of what kinds of choice architecture will move people in particular contexts.
- Some nudges produce compensating behaviour, resulting in no net effect.
Sunstein C (2016), ‘Do people like nudges?’ Nudge, choice architecture, default rules, social norms. The paper looks at the debate about the ethical questions associated with ‘nudges’, understood as approaches that steer people in certain directions while maintaining their freedom of choice.
The paper finds that there is widespread support for nudges ie people do not have similar objections to nudges. However, the support evaporates when people suspect the motivations of those who are engaged in nudging.
There appears to be somewhat greater support for nudges that appeal to conscious, deliberative thinking than for nudges that affect subconscious or unconscious processing.
People’s assessment of nudges in general will be greatly affected by the political valence of the particular nudges that they have in mind.
Transparency about nudging will not, in general, reduce the effectiveness of nudges, because most nudges are already transparent, and because people will not, in general, rebel against nudges.
There is preliminary but suggestive evidence of potential ‘reactance’ against certain nudges.
Cabinet Office (2012), ‘Applying behavioural insights to reduce fraud, error and debt’ Behavioural insights team, fraud, error and debt, central government. This paper does 2 things:
- Part 1 sets out 7 of the most important insights that can be used by public bodies to reduce fraud, error and debt.
- Part 2 describes 8 trials which the BIT has launched with a range of different government departments, agencies and local authorities to test these insights in practice.
FCA/Oxera (2016), ‘Increasing engagement in the annuities market’ Annuities, prompts, consumer choices, behavioural economics. This paper talks about the test to whether, and if so how, ‘prompts’ might encourage consumers to shop around for their annuity.
The experiment focused on the particular point when consumers receive an annuity quote from their pension provider. In particular, the experiment tests the impact of different prompts in the provider’s written communication. Although the experiment focuses on prompts in the annuities market, it is also likely to provide more general lessons about the effectiveness and use of prompts relevant to other markets and sectors.

4.4 Further reading – providing information to customers

Document Topics covered Notes
FCA (2016), ‘Full disclosure: a round-up of FCA experimental research into giving information’ Disclosure of information, communication, trials, experiments. This paper looks at the results of 8 experiments into communications and disclosure covering topics ranging from compliance to choosing a payday loan. This paper summarises a number of previously unpublished trials, which the FCA conducted when it first began using experiments for regulation, as well as newer research conducted in collaboration with others.
Ofcom (2013), ‘A review of consumer information remedies’ Disclosure, information remedies, intervention design. The paper looks at different types of information remedies, provides a review of how to use information-based remedies and summarises practices across a wide range of sectors. The paper looks both at cases where a well-designed information remedy can be effective and cases where an information remedy could lead to unintended or negative consequences.
Oxera (2014), ‘Review of literature on product disclosure – Prepared for Financial Conduct Authority’ Product disclosure, behavioural economics, regulatory, academic, qualitative market research. This paper summarises the literature on product disclosure, identifying elements of behavioural economics that are crucial to consumer understanding and behaviour, this report looks at both academic and regulatory evidence of ‘best practices’ for product disclosure.
The report also provides an overview of approaches for evaluating product disclosure. These include methods that can be used to inform prototype disclosure design, such as literature reviews and qualitative market research techniques.
Sunstein CR (2011), ‘Informing Consumers through Smart Disclosure. Memorandum for the Heads of Executive Departments and Agencies’ Disclosure, regulatory techniques, consumer behaviour. The purpose of this paper is to set out guidance for agencies to inform and facilitate the use of disclosure, specifically ‘smart disclosure’. As used here, the term ‘smart disclosure’ refers to the timely release of complex information and data in standardized, machine readable formats in ways that enable consumers to make informed decisions.
In some cases, agencies or third-party intermediaries may also create tools that use these data sets to provide services that support consumer decision-making. Such decision-making might be improved, for example, by informing consumers about the nature and effects of their own past decisions (including, for example, the costs and fees they have already incurred).
Oren Bar Gill (2012), ‘Seduction by contract’ Public disclosure, psychology, economics. Using both general theory and detailed case studies, this book explains the costs – to consumers and society at large – imposed by seductive contracts, and outlines a promising legal policy solution: Disclosure mandates. Simple, aggregate disclosures can help consumers make better choice. Comprehensive disclosures can facilitate the work of intermediaries, enabling them to better advise consumers. Effective disclosure would expose the seductive nature of consumer contracts and, as a result, reduce sellers’ incentives to write inefficient contracts.
Ryan Bubb (2015), ‘TMI? Why The Optimal Architecture of Disclosure Remains TBD’, Michelin Law Review, Vol. 113 Disclosure, regulatory techniques, behavioural economics, consumer behaviour. The book provides a critique of the traditional approach to mandatory disclosure. The book follow on from previous analysis of a particular rationale for disclosure regulation: providing information to improve deliberate decision-making. The previous studies showed that this model of disclosure often gets the psychology wrong.
The book examines an alternative mode that aims simply to influence rather than instruct via disclosure.
Ben-Shahar and Schneider (2014), ‘More than you wanted to know. The failure of mandated disclosure’ Disclosure, regulatory techniques, behavioural economics, consumer behaviour. The paper looks at whether Mandated Disclosure as a regulatory technique in American law works in practice.
That paper finds that disclosure can be useful given that information to consumers can be vital, in most circumstances. However, the paper finds that mandated disclosure is used with unrealistic expectations and yields inappropriate results that it should be barred.
Loewenstein, Sunstein and Golman (2013), ‘Disclosure: Psychology changes everything, Harvard Law Working Paper’ Regulation, public disclosure, psychology, economics. The paper reviews the literature examining the effects of laws and regulations that require public disclosure of information. The paper takes into account the economic literature relevant to such disclosure, and then discusses how different psychological factors complicate, and in some cases radically change, the economic predictions.
The paper finds that in many cases disclosure does not much affect the recipients of the information, but does significantly affect the behaviour of the providers, sometimes for the better and sometimes for the worse.
The paper also looks at research suggesting that simplified disclosure, standardized disclosure, vivid disclosure, and social comparison information can all be used to enhance the effectiveness of disclosure policies.
FCA (2016), ‘Occasional Paper No. 19: Attention, Search and Switching: Evidence on Mandated Disclosure from the Savings Market’ Disclosure of information, randomised controlled trials, regulatory intervention, consumer decision making. The paper looks at disclosure of information and the key part it plays in consumer decision making since this has been one of the most popular types of regulatory intervention in retail financial markets across the world. The paper stresses the importance of understanding how to design disclosure works and when it should be used.
The authors tested the importance of disclosure design in protecting consumers and improving competition. They used data from 5 RCTs with over 130,000 savings account holders, who had an opportunity highlighted to them to switch to an equivalent but better paying product, in some cases when the interest rate on their savings was decreasing. Working with 5 UK providers, they tested potential regulatory interventions in 3 areas: search and comparison, ease of implementation, and attention to the task.
OFT (2005), ‘Evaluating the impact of the supply of extended warranties order’ Extended warranties, disclosure, consumer protection. The paper focuses on the evaluation of extended warranties order. In 2001 the OFT launched an inquiry into the extended warranty market. It concluded that the market for extended warranties did not appear to be working effectively and that consumers were not adequately informed or protected. In 2002 the OFT referred the market to the CC for a more in-depth study. The CC reported in December 2003 and recommended a number of remedies which were implemented by the Supply of Extended Warranties on Domestic Electrical Goods Order 2005.
The paper assesses how the extended warranties market has changed since the implementation of the Order drawing on 4 sources of information: OFT own research; interviews with stakeholders; a consumer survey, and a mystery shopper exercise.
CC (2013), ‘Understanding past market investigation remedies, Home credit’ Remedy testing, behavioural economics, consumer choices, disclosure of information, consumer behaviour. The paper finds that the remedy package addressed some of the features identified and significantly reduced the detriment caused by those features. In particular:
- the data-sharing remedy, has reduced information asymmetries, which has helped reduce incumbency advantages
- customers that used LendersCompared.org.uk benefited from reduced search costs and being more aware of price differences between lenders
- the changes to early settlement rebates have led to a transfer from lenders to customers of around £35 million a year.
The paper finds that the remedy requiring on-demand statements appears to have delivered relatively little benefit for customers.
The paper concludes that there have been few, if any, unintended consequences from the CC’s remedies. Looking forward, the paper concludes that maximizing the impact of the website remedy in particular will be important. As and when economic conditions improve, the paper suggests that the data-sharing remedy should have a greater effect than it has had hitherto.
FSA (2009), ‘Occasional paper 32 – Did life and pensions “disclosure” work as expected?’ Disclosure, consumer choices, behavioural economics. The paper looks at how disclosure influences consumer choices. It finds that after disclosure some consumers shopped around more, at least in the period covered by the data.
One argument for benefits is that consumers who shop around are likely to increase the efficiency of their consumption. Another argument for benefits is that, in response to shopping around, firms are likely to seek to improve their offerings. This could be by setting prices closer to marginal cost, thereby improving allocative efficiency. Equally, it could be by improving quality for a given price.
The evidence adduced here, however, is indirect: due to data constraints, inferences about demand-side behaviour have been drawn from supply-side statistics.
Transport Focus/ORR, (2016), ‘Rail delays and compensation- what passengers don’t want’ Quantitative study, market research, consumer satisfaction, consumer research, behavioural remedies. This is a quantitative study, the authors carried out online interviews with over 8000 passengers as part of this research.
The research found that:
- the number of passengers claiming compensation has increased since 2013 from 12% to 35%
- 57% of eligible passengers weren’t aware they could claim compensation or didn’t even think about it
- just 38% of passengers are satisfied with the train company alerting them to their right to claim compensation

4.5 Further reading – shopping around and digital comparison tools

Document Topics covered Notes
UKRN (2016), ‘Price Comparison Websites: Final Report’ Price comparison websites, fair outcomes, consumer engagement. The paper focuses on Consumer Engagement and Switching price comparison websites (PCWs), taking into consideration the impact of innovations and the regulatory challenges that these developments are likely to present. This report covers:
- the role of PCWs
- understanding consumer expectations
- how PCWs are regulated
CMA (2017), ‘Digital comparison tools market study, interim report’ Price comparison websites, fair outcomes, consumer engagement. This paper provides an update on our market study of DCTs. The evidence we have reviewed suggests that many people are likely to be realising significant benefits from DCTs in the sectors we have looked at, but that there is room for improvement.
FCA (2014), ‘Price comparison websites in the general insurance sector’, Thematic Review TR14/11 Price comparison websites, fair outcomes, consumer engagement. The paper looks at consumers’ experience of using PCWs and their understanding of the role played by the PCWs.
The authors conducted a combination of desk-based reviews and consumer research, and challenged firms to demonstrate that the customer is at the heart of their business model.
The review focused on the intermediation of retail GI products (namely private motor, home and travel insurance) because they are the GI products most commonly purchased through a PCW. The paper also considered the extent to which PCWs had implemented the guidance issued by the FSA in 2011.
One of our key areas of focus during the review was whether consumers were likely to achieve fair outcomes when buying GI products through a PCW.
Warwick Economics Research Paper Series (2015), ‘David Ronayne: Price Comparison Websites’ Online markets, price comparison sites, competition, price dispersion. The paper looks into whether PCWs or ‘web aggregators’ benefit consumers by increasing competitive pricing pressure on firms.
The author investigates the impact of introducing PCWs to a market for a homogeneous good. The paper finds that introducing a single PCW increases prices for all consumers, both shoppers and non-shoppers. The paper also finds that in the most profitable equilibrium for competing PCWs, prices tend to rise with the number of PCWs.
FCA (2014), ‘Price comparison website: consumer market research’ Consumer choices, qualitative research, behavioural economics, decision-making. The paper talks a programme of qualitative research with consumers driven by the FCA. The FCA wanted to check if consumers who use PCWs buy products through them with confidence and make well informed decisions.
The key aim of this research was to provide insight into the customer journey when using PCWs, in particular, how consumers approach, use and make decisions using PCWs.

4.6 Further reading – measures to promote switching

Document Topics covered Notes
Social Market Foundation (2015), ‘Should switch won’t switch’ Consumer inertia, switching, policy design and regulation. The paper looks at why so many consumers remain inert, how inertia varies between markets, and how best design policy and regulation can be designed to overcome inertia.
The markets considered are those in which households spend a considerable proportion of their money, including the markets where regulators have noted past challenges with consumer engagement.
Ofgem (2014), ‘Protecting consumers in collective switching schemes’ Collective switching, transparency. The consultation paper outlines proposals for interim regulatory measures to build consumer trust, promote transparency and create positive opportunities for consumers.
DECC/Newcastle City Council (2014), ‘Heating Control Advice in Newcastle’ RCT, behavioural insights, switching This report presents findings of an RCT that aimed to test whether tailored advice from a ‘trusted messenger’ on how to use standard heating controls can reduce energy consumption. Commissioned by DECC, the trial was designed by the BIT and implemented by Newcastle City Council with the assistance of local partners. NatCen Social Research conducted a process evaluation alongside the trial and has been responsible for integrating the results of these activities into this report.
Grubb and Osborne (2015), ‘Cellular Service Demand Biased Beliefs, Learning, and Bill Shock’ Consumer behaviour, inattention, consumer choices. The paper specifies and estimates a model of consumer cellular phone plan and usage choices. The authors identify the distribution of consumer tastes from observed usage and consumers’ beliefs about their future usage from observed plan choices.
An important caveat to the results is that consumers may be unaware of their own inattention.
Heiss, McFadden, Winter, Wuppermann & Zhou, ‘Inattention and Switching Costs as Sources of Inertia in Medicare Part D’ Switching costs, consumer behaviour, consumer choices. The paper finds that consumers are more likely to pay attention to medical plan choice if overspending in the last year is more salient and if their old plan gets worse, for instance due to premium increases. Moreover, conditional on attention there are significant switching costs. The paper recommends separating the 2 stages of the switching decision, this is important when designing interventions that improve consumers’ plan choice.
OECD (2017), ‘Behavioural Insights and Public Policy. Lessons from around the world’ Behavioural insights, public policy. The report looks at the use and reach of Behavioural Insights through a comprehensive international overview of their application. The paper finds that Behavioural Insights have moved beyond just a trend.
Huck S and Wallace B (2011), ‘Experimental work on potential interventions in relation to non-geographic calls: Final Report’, London Economics Consumer behavioural, switching, experimental economics. This paper is a report commissioned by Ofcom from London Economics. The paper is an experimental economics study on different ways of presenting call charge information for non-geographic telephone numbers to consumers.
The strongest finding from this experiment is that any intervention which improves consumers’ price information available at the time the consumer decides to make a call, will help consumers in the field. The study also confirms that such price information does not have to be complete (that is, the total charge) for it to be useful.