Test: Preference test

You just need to show them the design and afterwards ask them.

Examples of questions a preference test can answer:

  • Which design they prefer
  • Which design that looks the most trustworthy
  • Which design that looks the most modern
  • Which design that looks the easiest to use
  • Etc.

Preely offers two ways of setting up a preference test, either: 1. Here you ask your participants to click on the design they prefer; 2.Here you show your design and afterwards ask the questions you want answered.

Step-by-step guide to setting up a preference test in Preely (Questions up front + endpoint)

In this one you ask your participants to click on the design they prefer.

From the start screen click “Create test”. Choose device.

1. Welcome your participants
We have written a short welcome to your participants. If you want to change it, just write your own personal welcome.

Welcome text

2. Add tasks and questions
This is where you truly set up your test. Click ‘Insert element’ and create different tasks and ask your participants questions.

Insert task or question

2.1 Tasks
When you want your participants to perform a task in your test, you add a task to your test. You write an introduction and then you formulate the task. Try to break down your tasks in small chunks.

Task or question

Create task

Introduction: We are testing different design options.
Task: You are going to see different designs for 10 sec. afterward, we are asking you different questions about your experience.

2.2 Add prototype
Click Add prototype and upload your design(s), screenshot, Adobe XD-, Figma- or Sketch artboards, or via InVision Cloud link.

Add prototype

choose design prototype

Remember to set an end screen on your tasks. This can either be a:

‘Endpoint’: This means that your participants should click on this certain spot in your prototype to end the task
‘Timer’: This means that you set a timer on the last screen in your test and after a set amount of time, the task is ended


Add endscreen



Step 3. Ask questions
Click ‘Insert element’ and choose ‘Add question’. Then fill in the questions and choose answer types (rating, multiple choice or free response).

Task or question

Question menu

Examples of questions:

  • What do you think this page was about?
  • What product do you think this company sells?
  • What’s your first impression about the site?
  • What got your attention?

Answer types

Free text response
Ask participants to write a free text response to your question and get raw, unfiltered feedback.

Multiple Choice
Get specific and use multiple choice to learn if participants noticed or didn’t notice exactly what you wanted them to.

Ask participants to rate your design, using different scales (Likert, Semantic Difference, Smiley scales or NPS).