Learn / Guides / UX research process

Back to guides

How to write effective UX research questions (with examples)

Collecting and analyzing real user feedback is essential to delivering an excellent user experience (UX). But not all user research is created equal—and done wrong it can lead to confusion, miscommunication, and non-actionable results.

Last updated

25 Mar 2022

You’ll need to ask the right UX research questions to get the valuable insights necessary to continually optimize your product and generate user delight. 

This article shows you how to write strong UX research questions every time, ensuring you go beyond guesswork and assumptions. It covers the difference between open and closed research questions, explains how to form UX research questions, and provides several UX research question examples to get you started.

Use Hotjar to ask your users the right UX research questions

Put your UX research questions to work with Feedback and Surveys to uncover product experience insights

The different types of UX research questions

Let’s face it, asking the right UX research questions is hard. It’s a skill that takes a lot of practice and can leave even the most seasoned UX researchers drawing a blank.

There are two main categories of UX research questions: open and closed. Both are essential to thorough, high-quality UX research. Qualitative research—based on descriptions and experiences—leans towards open questions whereas quantitative research leans towards closed questions.

Let’s dive into the differences between them.

Open UX research questions

Open UX research questions are exactly what they sound like. Rather than asking someone to choose from established possible answers, open questions prompt longer, more free-form responses.

Open questions are easily recognized because they:

  • Usually begin with terms like how, why, what, describe, or tell me

  • Can’t be answered easily with yes/no or just a word or two

Are qualitative rather than quantitative

If there’s a simple fact you’re trying to get to, a closed question would work. For anything involving our complex and messy human nature, open questions are the way to go.

Yana Barysheva
WattBuy Director of Design

Open research questions are useful for exploratory research. Rather than seeking specific answers, they aim to discover more about research participants and gather candid user insights. 

Some examples of UX research that use open questions include:

  • Usability testing

  • Diary studies

  • Persona research

  • Use case research

  • Task analysis

Check out a concrete example of an open UX research question in action below. Hotjar’s Survey tool is a perfect way of gathering longer-form user feedback, both on-site and externally.

#Asking on-site open questions is a great way to gather honest user feedback while they’re experiencing your product
Asking on-site open questions is a great way to gather honest user feedback while they’re experiencing your product

Open UX research question pros and cons

Like everything in life, open UX research questions have pros and cons.

Advantages of open questions include:

  • Detailed, personal answers

  • Great for storytelling

  • Good for connecting with people on an emotional level

  • Helpful to gauge pain points, frustrations, and desires

  • Researchers usually end up discovering more than initially expected

  • Less vulnerable to bias

 Drawbacks include:

  • People find them more difficult to answer than closed questions

  • More time consuming for both the researcher and the participant

  • Can be difficult to conduct with large numbers of people

  • Can be challenging to dig through and analyze open-ended questions

Closed UX research questions

Closed UX research questions have limited possible answers. Participants can respond to them with yes/no, by selecting an option from a list, by ranking or rating, or with a single word.

They’re easy to recognize because they’re similar to classic exam-style questions.

More technical industries might start with closed UX research questions because they want statistical results. Then, we’ll move onto more open questions to see how customers really feel about the software we put together.

Jonathan Hill
UX/UI Designer

While open research questions reveal new or unexpected information, closed research questions work well to test assumptions and answer focused questions. They’re great for situations like:

  • Surveying a large number of participants

  • When you want quantitative insights and hard data to create metrics

  • When you’ve already asked open UX research questions and have narrowed them down into closed questions based on your findings

  • If you’re evaluating something specific so the possible answers are limited

  • If you’re going to repeat the same study in the future and need uniform questions and answers

#Closed yes/no/neutral UX research questions provide valuable insights and are simple for users to address
Closed yes/no/neutral UX research questions provide valuable insights and are simple for users to address

Wondering how a closed UX research question might look in real life? The example above shows how Hotjar’s Feedback widgets help UX researchers to hear from users “in the wild” as they navigate.

Customer satisfaction (CSAT) surveys

CSAT surveys are closed UX research questions that explore customer satisfaction levels by asking users to rank their experience on some kind of scale, like the happy/angry icons in the image below.

On-site widgets like Hotjar's Feedback tool (below) excel at gathering quick customer insights without wreaking havoc on user experience. They’re especially popular on ecommerce sites or after customer service interactions.

#Feedback tools can be fun, too. Keep your product lighthearted and collect quick user feedback with a widget like this one
Feedback tools can be fun, too. Keep your product lighthearted and collect quick user feedback with a widget like this one

Net Promoter Score (NPS) surveys

NPS surveys are another powerful type of (mostly) closed UX research question. They ask customers how likely they are to recommend a company, product, or service to their community. Responses to NPS surveys are used to calculate Net Promoter Score.

NPS surveys split customers into three categories:

  • Promoters (9-10): Your most enthusiastic, vocal, and loyal customers.

  • Passives (7-8): Ho-hum. They’re more or less satisfied customers but could be susceptible to jumping ship.

  • Detractors (0-6): Dissatisfied customers who are at a high risk of spreading bad reviews.

Net Promoter Scores are a key metric used to predict business growth, track long-term success, and gauge overall customer satisfaction.

#Asking your customers “how likely are you to recommend us to a friend or colleague?” helps calculate Net Promoter Score and gauges satisfaction and enthusiasm
Asking your customers “how likely are you to recommend us to a friend or colleague?” helps calculate Net Promoter Score and gauges satisfaction and enthusiasm

Pro tip: while the the most important question to ask in an NPS survey is readiness to recommend, it shouldn’t be the only one. Asking a follow-up questions can provide more context and a deeper understanding of customer experience. Combining Hotjar Feedback widgets with standalone Surveys is a great strategy for tracking NPS through both quick rankings and qualitative feedback.

Closed research question pros and cons

Closed UX research questions have solid advantages, including:

  • More measurable data to convert into statistics and metrics

  • Higher response rates because they’re generally more straightforward for people to answer

  • Easier to coordinate when surveying a large number of people

  • Great for evaluating specifics and facts

  • Little to no irrelevant answers to comb through

  • Put the UX researcher in control

But closed questions can be tricky to get right. Their disadvantages include:

  • Can lead to response bias

  • Prevent participants from telling the whole story

  • Don’t offer much insight into opinions or emotions

  • Too many possible answers can overwhelm participants

  • Too few possible answers mean the “right” answer for each participant might not be included

How to form your own UX research questions

To form effective UX research questions, start by defining your hypothesis and objectives.

Put simply, your UX research hypothesis is an assumption that you’ll put to the test with user feedback.

A tried-and-tested formula for creating research hypotheses is:

  • We believe (doing x)

  • For (x people)

  • Will achieve (x outcome)

For instance: “We believe adding a progress indicator into our checkout process (for customers) will achieve 20% lower cart abandonment rates.”

Pro tip: research hypotheses aren’t set in stone. Keep them dynamic as you formulate, change, and re-evaluate them throughout the UX research process, until the team comes away with increased certainty about their initial assumption.

When nailing down your hypothesis, remember that research is just as much about discovering new questions as it is about getting answers. Don’t think of research as a validation exercise where you’re looking to confirm something you already know. Instead, cultivate an attitude of exploration and strive to dig deeper into user emotions, needs, and challenges.

Once you have a working hypothesis, identify your UX research objective. Your objective should be linked to your hypothesis and defines what your product team wants to accomplish with your research.

For example: “We want to improve our cart abandonment rates by providing customers with a seamless checkout experience.”

Now you’ve formulated a hypothesis and research objective, you can create your general or “big picture” research questions. These define precisely what you want to discover through your research but they’re not the exact questions you’ll ask research participants. This is an important distinction because “big picture” research questions focus on researchers rather than users.

A “big picture” question might be something like: “How can we improve our cart abandonment rates?”

With a strong hypothesis, research objective, and general research question in the bag, you’re finally ready to create the questions you’ll ask participants. Remember to align your interview questions with your “big picture” research question.

32 UX research question examples to get you inspired

There are countless different categories of UX research questions.

We focus on open, ecommerce-oriented questions here, but with a few tweaks, these could be easily transformed into closed questions or questions for other industries. 

For example, the open question:

“Tell us about your overall experience shopping on our website.”

Could be turned into the closed question…

“Did you have a positive experience finding everything you needed on our website?”

Screening questions

Screening questions are the first questions you ask UX research participants. They help get to know your customers and work out whether they fit into one of your ideal user personas or another niche.

These survey question examples focus on demographic and experience-based questions. For instance:

  • Tell me about yourself. Who are you and what do you do?

  • What does a typical day look like for you?

  • How old are you?

  • What’s the highest level of education that you’ve completed?

  • How comfortable do you feel using the internet?

  • How comfortable do you feel browsing or buying products online?

  • How frequently do you buy products online?

  • Do you prefer shopping in person or online? Why?

Awareness questions

Awareness questions explore how long your participants have been aware of your brand and how much they know about it. Some good options include:

  • How did you find out about our brand?

  • What prompted you to visit our website for the first time?

  • If you’ve visited our website multiple times, what made you come back?

  • How long was the gap between finding out about us and your first purchase?

Expectation questions

Expectation questions investigate the assumptions UX research participants have about brands, products, or services before using them. For example:

  • What was your first impression of our brand?

  • What was your first impression of (X product or service)?

  • How do you think using (X product or service) would benefit you?

  • What problem would (X product or service) solve for you?

  • Do you think (X product or service) is similar to another one on the market? Which?

Task-specific questions

Task-specific questions focus on participants’ experiences when trying to complete actions on your site. Some examples:

  • Tell us what you thought about the overall website design and content layout.

  • How was your browsing experience?

  • How was your checkout experience?

  • What was the easiest task to complete on our website?

  • What was the hardest task to complete on our website?

Experience questions

Experience questions dig deeper into research participants’ holistic journeys as they navigate your site. These include:

  • Tell us how you felt when you landed on our website homepage.

  • How can we improve (x page of our website)?

  • What motivated you to purchase (x product or service)?

  • What stopped you from purchasing (x product or service)?

  • Was your overall experience shopping on our website positive or negative? Why?

Concluding questions

Concluding questions ask participants to reflect on their overall experience with your brand, product, or service. For instance:

  • What are your biggest questions about (x product or service)?

  • What are your biggest concerns about (x product or service)?

  • If you could change one thing about (x product or service), what would it be?

  • Would you recommend (x product or service) to a friend?

  • How would you compare (x product or service) to (x competitor)?

Excellent research questions are key for an optimal UX

To create fantastic UX, you need to understand your users on a deep level.

Crafting strong questions to deploy during the UX research process is an important  way to gain that understanding.

This article has covered the essential information you need to write powerful research questions and provided examples to help you get started. Keep this guidance in mind and you’ll be sure to uncover the insights you need to deliver optimal UX time and time again.

Ultimately, UX research shouldn’t center on what you want to learn but what your users can teach you.

Use Hotjar to ask your users the right UX research questions

Put your UX research questions to work with Feedback and Surveys to uncover product experience insights

UX research question FAQs