There are often situations when teams have one or more potential solutions that meet user needs and are technically feasible. How should they move forward, when both designs could solve the problem?
In this guide, you will learn about three methods you can use to evaluate designs in Qualtrics:
You can access a sample design evaluation survey in the UX Research & Product library in Qualtrics.
When evaluating designs, it’s best to start by creating a hypothesis about an aspect of the design.
Consider the following questions as you determine your goals and objectives for the study:
After determining what you need to test, you then need to identify ways to measure the success of the design.
Usability metrics help you answer questions about the usability of your design. Whether you have questions about findability or readability or you just want to know the preferred option, usability metrics can outline a clear goal for your study and improve your analysis.
Some common usability metrics include:
NNGroup has a great article that can provide more insight into usability metrics.
First Click Testing enables you to see users’ first instincts when completing a task. In Qualtrics, you can use a combination of Descriptive Text, Heatmap, and Timing question types to create task scenarios and record the respondent’s first click on the image.
After logging into Qualtrics, click on “Projects” in the top navigation and click “Create a new project.”
If you plan to create your own survey from scratch, first you should select “Create a new CoreXM” and then “Create your own survey.”
You can then choose to create a blank project or make a copy of the sample design evaluation survey in the UX Research & Product Library.
The first step in creating a first-click test is to use a
Descriptive Text question to set up the task scenario:
Then you can use the following steps to set up a
After setting up the
Heatmap question, you can create another block in your survey and add a Text Entry question to have the user explain their motivation for clicking in a certain area. You can also use a Multiple Choice question to have them rate their level of confidence.
Preference tests help you choose between design variations by asking users to select their preferred option. You can have the user select a preference based on the appearance of the design, how well it communicates information, or other qualities that evaluate your hypothesis.
Preference testing can be used to evaluate a variety of designs: icons, mockups, color palettes, design components, and more.
In Qualtrics, you should use the ‘Single Answer, Vertical, Graphic’ type of
Multiple Choice question to set up a preference test. Follow that question with a
Text Entry question to understand why they chose that option.
Five-second tests help you to measure how well a design quickly communicates a message. Participants use their memory and impression of a design to answer questions, after seeing it for just 5 seconds.
This test can be created with the Timing question in Qualtrics.
First, you’ll need to set expectations for the test. Create a survey block with a Descriptive Text question that includes text such as
You will see an image on the next page and will have a short time to look at it. Try to remember as much as you can and think about what you can do with the feature in the image.
The next survey block should include a Graphic followed by a
Timing question set to a five-second time limit.
In the next survey block, you can follow up with
Text Entry or
Multiple Choice questions that test the participant’s memory or understanding of the design.