At GitLab, we practice both Problem Validation research and Solution Validation research, depending on the questions we need answers to and where we are in the design process. The end result of these methods is a high degree of confidence which results in a better overall user experience. Generating solutions, developing the product experience, and launching to the market is much more effective when we start with a deep understanding of our customer problems. We leverage Opportunity Canvases to track quick iterations on levels of confidence, hypotheses, and lessons learned as our learning about the problem evolves.
Problem validation research seeks to provide decision makers with a well understood and clearly articulated customer problem. At GitLab, problem validation encompasses generative research as well as descriptive and informative research.
Generative research helps develop a deeper understanding of users to uncover opportunities for solutions and innovation.
Descriptive and informative research begins with a problem statement in mind and is used to gain a detailed understanding of the context of the problem.
Generative research is done when we don’t have a good understanding of what the problem is we need to solve. Often this occurs at the very beginning of the product design process. The purpose is to formulate a problem to solve and have a decent level of confidence that the problem is a relevant one.
Descriptive and informative research starts with a problem statement, which provides us a concrete problem to solve. This research is used to gain a better understanding of the context we are trying to solve for through our design and is imperative to fill the knowledge gaps of the solution environment by what our participants know.
When you are conducting a problem validation research effort, make sure to apply the UX Problem Validation label to the research issue.
Generative research provides answers to these questions:
Descriptive and informative research provides answers to these questions:
When choosing the right method for problem validation research, first ask yourself if you need generative or informative research.
Some problem validation research methods include:
Check out our guidance for writing your discussion guide and facilitating user sessions for In-depth interviews.
You can also frame questions using the Taxonomy of Cognitive Domain, which explains how certain verbs target particular thought processes. This is a great way to expand your questioning in order to help trigger specific responses from participants.
| Domain | Critical Thinking Process | Verbs to use | Sample Questions |
|---|---|---|---|
| Knowledge | Remembering Memorizing Recognizing |
Who What When Where How |
|
| Comprehension | Interpreting Translating Describing |
Explain Outline Distinguish Compare Define |
|
| Application | Problem-solving Applying information |
Show Use Complete Classify Relate |
|
| Analysis | Separating Finding structure |
Contrast Categorize Identify Separate Diagram |
|
| Synthesis | Creating Combining |
Create Imagine Design Propose Invent |
|
| Evaluation | Judging Resolving |
Select Decide Prioritize Rate Discuss |
|
