Quantitative vs. qualitative UX research: An overview of UX research methods

UX research is a multi-dimensional process that includes different user research methods and techniques. In this chapter, we provide an overview of the quantitative and qualitative research methods and explain why the best solution uses a mix of both methods.

Quantitative research is used to collect and analyze numerical data, identify patterns, make predictions, and generalize findings about a target audience or topic. The data is collected indirectly, either through a UX research tool that automatically records it, such as Google Analytics or Maze, or manually by measuring and analyzing UX metrics.

Here are some of the most popular quantitative research methods you can use to collect valuable quantitative data:

Quantitative data provides a foundation for benchmarking and ROI calculations and can help you decide the best performing version of a design or product.

Quantitative data aims to answer research questions such as ‘what,’ ‘where,’ or ‘when.’ For example, when collecting usability metrics such as task success rates, time on task, completion rates, clicks, conversion rates, and heatmaps, you can measure how well a design performs and spot issues on a page or in the user flow.

One of the advantages of quantitative research is the ability to run studies with large sample sizes and collect statistically relevant data. As opposed to qualitative feedback, which is interpretable by the researcher and subjective, quantitative research is more objective and representative of a broader audience.

Qualitative user research includes research methods like user interviews and field studies and helps you collect qualitative data through the direct observation and study of participants. Qualitative data yields an understanding of the motivations, thoughts, and attitudes of people. This type of research is key to uncovering the ‘why’ behind actions and develop a deep understanding of a topic or problem.

Yuliya Martinavichene, User Experience Researcher at Zinio, highlights: “Since researchers are curious folks, we prefer not only to observe what people are doing by looking at analytics but also to understand the “why” behind the user behavior.”

She compares the process of running a qualitative study to casting a wide lens to identify user behavioral patterns:

There are different qualitative research methods you can employ for your studies, such as user interviews, diary studies, focus groups, card sorting, usability testing, and more. We explore the most common UX research methods in the next chapter.

Choosing the right user research techniques depends on the project and your research goals. Yuliya explains:

Yuliya collects qualitative feedback through different methods depending on the goals of the projects. For example, she might conduct walk-throughs with users and asks them to show her around the software she is researching to understand how they currently use the product. Or she may ask research participants to perform everyday tasks to observe their behavior in real-time, such as logging in or out of the platform.

To gather more qualitative insights, Yuliya also checks social media mentions, analyzes blog posts, and reads app store reviews to collect information about the experience users have with the product.

Qualitative research gives you rich insights about the people, product, and the problem you’re researching, and helps you inform decision-making throughout the design and product development process.

The key differences between quantitative and qualitative research are in the data they deal with and the questions they answer–where quantitative research focuses on numbers and statistics to answer ‘what’, ‘where’ and ‘when’, qualitative research broadly looks to words and meaning for the ‘why’.

Both methods have their merits, and likewise their drawbacks. As we go on to explore, for the most robust and meaningful research, it’s best to use a combination of quantitative and qualitative, but in certain situations, such as challenges due to time or resource constraints, you may decide to use one or the other.

While qualitative and quantitative research yields different data types, they are both essential for conducting effective research and getting actionable insights. Not one method can give you a complete picture, so using both in combination is often the best way to ensure you’re making the right product decisions that fit with your business goals.

Usually, the best solution is built using a combination of insight sources. For example, you can kick-off the discovery phase of a project with qualitative research, and run user interviews to understand people’s needs, preferences, and opinions.

After this initial batch of research studies, the product and design team can start building an incipient solution, usually in the form of a low-fidelity prototype or mockups. The initial solution is then tested through interviews and surveys, and the feedback gathered can help you iterate on the solution until final.

Lastly, when you’ve arrived at a final product, doing user testing quantitatively will help you ensure your solution is easy to use, usable, and intuitive for the end-users—and there are no significant issues with the design before going into the development phase. This mix and match of methods is the best way to research and test during the entire design process until arriving at a solution.

In the next chapter, we will dive deeper into common types of research you can use such as tree testing, card sorting, and usability studies, and help you choose the right one for you.