Skip to main content

(C) Martin Engel on Unsplash

Understanding which elements of a phone package customers value most

Sector: Technology

Team: Ruth, Umar, Michael, Jess

Partner: CogCo

Choice experiment

Understanding which elements of a phone package customers value most

We conducted a choice experiment to understand which components of a phone package customers value most when choosing a mobile phone contract.

The Challenge

Mobile phone operators have a wide variety of services and products that they can offer to their customers. They can provide more data; better coverage; shorter contract terms; and even free gifts, like a 6 month subscription to Netflix. But each of these elements comes at a cost, so it is useful to know exactly what value customers place on the different component parts of a contract. This might not be a problem, if customers were able to articulate clearly their preferences. But it turns out that we find it very difficult to do so accurately: it is challenging, for example, for any of us to come up with a figure when asked how much you might be willing to pay for a shorter contract.

The Approach

To overcome this challenge, we ran a large-scale, online choice experiment with 2,000 mobile phone customers across the UK. Rather than asking people what they would like in a mobile phone contract (a difficult thing for people to respond to), we asked them to choose between two differently configured contracts (a relatively simple thing for people to do). The contracts differed across seven different elements - including brand; price; how much data was included; and what kind of promotional free gift it included.

In the example shown below (Figure 1), someone may conclude that they would prefer a lower cost, 12 month O2 contract that includes 30GB of data and a Disney+ subscription; to a higher cost Vodafone subscription that is a shorter plan length and includes a free travel mug. Once they had made their choice, they were asked to choose between two more contracts in which different elements had again been varied. By giving thousands of consumers around 12 choices each, we were able to cover every conceivable combination of choices. And in doing so, were able to ascertain the true, underlying preferences of customers.

Figure 1: An example of the choice that participants were asked to make (would you prefer A or B?)

The Results

We discovered that price was the most important attribute of a contract. An £11 contract, for example, was around five times more likely to be chosen than an equivalent contract priced at £23. Data was the second most important. People were three times more likely to choose an unlimited data package to one that only had 1GB. But there was no statistically significant difference between ‘unlimited’ and 30GB of data (presumably because 30GB is more than enough for most people).

As well as the extent to which it drove customers’ preferences, we were also able to discern exactly how much people were willing to pay for each element (see chart below). People were willing to pay £9.05 more for 30GB of data, for example, compared to a 1GB tariff. And they were prepared to pay more for Netflix (£2.56) than they were for Disney+ (£1.55) compared to receiving a free travel mug. The most valuable brand turned out to be O2, for which there was a £3.19 premium above our fictitious ‘Acorn’ brand.

Figure 2: Chart showing the price customers are willing to pay for each ‘attribute’

(C) CogCo

This is just one example of a methodology that CogCo uses to understand what customers and users of products and services really value most. It is driven by the simple insight that individuals find it easier to make a choice between alternatives than they do to explain and articulate why they made that choice, and the monetary value that they might have placed on different elements of it.

"At CogCo we use choice experiments in all kinds of situations to understand which elements of a service or product people value most"

-Ruth Horry, Head of Experimental Methods, CogCo

Read recommended case studies

Understanding the barriers to seeking out debt advice

In 2022, the Money & Pensions Service (MaPS) found that as many as 9.3 million adults across the UK were showing strong indications of needing debt advice. This is an increase of 800,000 compared to 2021, and doesn’t take account of more recent energy bill rises. Amongst other things, this group will be facing serious consequences for not being able to pay a priority bill - such as their rent or energy bill.

Researching people's experience of harmful video content

In recent years, concerns have grown about people - especially young people - encountering harmful content while using online video sharing platforms such as YouTube, Facebook, TikTok, Instagram and Twitch. The Department for Culture, Media and Sport wanted to get a better understanding of the potential harms encountered by young people through the development of more rigorous methods for understanding their experiences. We took on this challenge as part of a wider programme of work with Oliver Wyman, the global management consulting firm.

How digital design changes customer decisions

Online shopping offers customers a smooth, simple way of making a purchase. But Citizens Advice, the charity that offers confidential financial advice to millions of people every year, is concerned that some firms are designing online platforms in ways that act against the interests of customers. Citizens Advice therefore commissioned CogCo, working with Paul Adams, to devise an experiment that tested what the effect of different aspects of digital design had upon the choices and comprehension of customers. They were especially interested in the effect of different digital designs upon consumers’ decisions to choose to pay using ‘Buy Now, Pay Later’ products. These products enable customers to delay payments into the future and now account for 6% of all online purchases in the UK.

Interested in working with us?

Get in touch at info@cogco.co

Copied to clipboard