What Questions Should You Ask in a Usability Test?

The best questions to ask in a usability test are the ones that help you understand what users are trying to do, what they expect to happen, and where the experience starts to break down. That does not mean asking a lot of questions. In fact, too many can get in the way.

A usability test works best when users spend more time interacting with the product than answering follow-up prompts. Your job is not to guide them through the experience. It is to give them a task, observe what happens, and ask a few well-timed questions that help explain their behavior.

Good usability test questions focus on expectations, decisions, and friction

1. Screening Questions

The goal of screening is to find participants who truly represent your target audience.

• Demographics: Ask about age, gender identity, profession, household income, and education level when demographics are relevant to your target audience.

• Behaviors and Habits: Focus on objective behavioral frequency (e.g., “How many times in the last month have you shopped online?”) rather than asking if someone is an “expert”.

• Technical Context: For mobile testing, ensure participants regularly use their current mobile device so their feedback focuses on the app rather than the phone’s operating system.

2. Pre-Test Questions

Before the actual testing begins, pre-test questions establish rapport and capture the participant’s current state of mind.

• Experience and Brand Knowledge: Ask how often they perform the task your product solves, which competitors they use, and if they have used your brand before.

• Confidence Levels: Have users rate their confidence in using specific technology or performing certain tasks on a scale.

• Expectations and First Impressions: Show the user the product briefly and ask, “What do you think this product is best used for?” or “Who would benefit from using this?”.

3. During the Test (In-Task Facilitation)

The core of the test involves observing users as they complete tasks while verbalizing their thoughts using the “think-aloud” method.

• Neutral Probing: Use open-ended questions like “What are you thinking right now?”, “What do you think of this layout?”, or “I noticed you hesitated there; can you tell me why?”.

• Facilitation Techniques:

  • The Echo: Repeat the user’s last phrase with a questioning tone to encourage elaboration (e.g., “The menu is confusing?”).

  • The Boomerang: Push a user’s question back to them by asking, “What do you think?” or “What would you do if you were at home?”.

  • The Columbo: Act slightly less knowledgeable and trail off your questions to create a vacuum that the user feels compelled to fill with a detailed explanation.

4. Post-Task Questions and Metrics:

Administer after task so participants do not have to rely on memory they can provide more accurate feedback that is still fresh on their minds, 1-3 questions, quick to answer, it helps capture immediate feedback and identify usability issues

• SEQ - How easy or difficult was this task | overall this task was (1-7), why?

• Confidence in completing a task, why?

5. Post-Test Questions

After all tasks are finished, gather feedback on the overall user experience and lasting impressions.

• Overall Impressions: “What was your overall impression of the product?”, “What did you like most/least?”, and “If you could change one thing, what would it be?”.

• Comparison: Ask how the product compares to competitors they have used.

• Standardized Questionnaires: Use validated tools like the System Usability Scale (SUS), a 10-item survey that provides a global view of usability and learnability. Other options include the Net Promoter Score (NPS) for likelihood to recommend or the UMUX-Lite for quick usefulness and ease assessments.

Key Rules for Writing Questions

• Avoid Leading Questions: Never use adjectives like “simple,” “easy,” or “helpful” in your questions (e.g., instead of “Was this easy?”, ask “How was your experience?”).

• Use Open-Ended Questions: Avoid yes/no answers to allow participants to share detailed feedback and stories.

• Stick to One Topic: Do not bundle questions (e.g., “What did you think of the design, copy, and layout?”); ask about each element individually.

• Focus on Behavior: People are poor at predicting their future behavior; focus your inquiries on their past actions and current interactions.

So, what questions should you ask in a usability test? In a usability test, the questions you ask are structured to extract authentic user behavior and latent sentiment while minimizing the researcher’s bias. Ask the ones that help you understand intent, decision-making, and friction. Keep them short, timely, and tied to real behavior. That is usually where the most useful answers live.