Post test: Net Promoter Score (NPS)

Net Promoter Score (NPS) is used as a metric of customer loyalty and it correlates well with standard measures of user satisfaction such as SUS (see System Usability Scale (SUS)). NPS is easy to understand and measure, but has limitations for understanding and evaluating UX when used in isolation and it’s best used to assess overall customer satisfaction with an entire company or service, or at least with an entire product, not e.g. lower-level details of a redesign.

However, it can be part of different metrics to measure during your user testing, especially if your organization already are measuring NPS on released products (read: you have a great benchmark), and a good way to secure buy-in for usability and UX from upper management.

When using NPS, you ask your participants:
‘How likely are you to recommend this website/product/service to a friend/relative/colleague?’

The participants score this on a scale from 0-10. The answers fall into three categories depending on the score:

  • 9 – 10 : Promoters this indicates high satisfaction and a strong likelihood to recommend
  • 7 – 8 : Passives this indicates moderate satisfaction and low likelihood to recommenced
  • 0 – 6 : Detractors this indicates dissatisfaction and likelihood to criticism

NPS is calculated by subtracting the percentage of detractors from the percentage of promoters, note that the passives are included in the total number of participants, but else those contributions are not used. All calculations are automatically done in Preely.

As stated in the beginning, NPS has limitations when being used as a usability/UX metric, and it should never stand alone.

Step-by-step guide to setting up NPS in Preely

Click “Create test” and choose device.

1. Welcome your participants
We have written a short welcome to your participants. If you want to change it, just write your own personal welcome.

Welcome text

2. Add tasks and questions
This is where you truly set up your test. Click ‘Insert element’ and create different tasks and ask your participants questions.

Insert task or question

2.1 Tasks
When you want your participants to perform a task in your test, you add a task to your test. You write an introduction and then you formulate the task. Try to break down your tasks into small chunks.

Task or question

Create task

2.2 Add prototype
Click Add prototype and upload your design(s), screenshot, Adobe XD-, Figma- or Sketch artboards, or via InVision Cloud link.

Add prototype

choose design prototype

Step 1. Ask questions
When you have sat up your prototype and task in Preely. You can add NPS as ‘Answer type’ to a question.

Task or question

Question menu

Choose ‘Net Promoter Score (NPS)’.

NPS

Limitations of NPS:

  • NPS is a marketing tool and it does not capture the full picture of usability
  • NPS is a subjective score and sometimes participants will struggle during the test, but still give fairly high score
  • NPS is a quantitative metric, hence it can give you an indicator on how your concept or product is doing, but not answer why it’s the case (however you can add a follow-up and have them elaborate their rating)
  • Again NPS is a quantitative score, so you need a large enough sample size (see Sample Size)
  • A lot of information is ignored due to data being divided into three groups (promoters, passives, and detractors) and passives being completely ignored
  • You’ll not be able to use NPS to track minor UX improvements

A final note – do not get disappointed if your company’s overall NPS remains flat, even though you have made great usability and UX improvements. It’s hard to move the needle much on overall customer loyalty. That is why you need to use more usability and UX metrics to measure user satisfaction.

Get started with a free account

Preely lets you create remote user tests from any kind of design prototype.