Chapter 4
User interview analysis: Steps to turn data into decisions
It’s the moment your UX team has been waiting for. You’ve conducted a series of user interviews that dove into the problems and priorities of your users—now it’s time to dissect the qualitative data and turn it into decision-driving insights.
Keep reading for our chapter on all-things user interviews analysis, where we’ll cover key steps to analyze your user interviews, best practices to center your process around, and what’s next after you extract these insights.
How to analyze user interviews: Step-by-step
When we talk about analyzing user interviews, more often than not we’re talking about some form of thematic analysis. This method of qualitative research analysis helps you identify themes and patterns in user interview data that you can then use to inform product decisions and build user-centered features, products, and experiences.
Thematic analysis can be as complex as you want it to be. You can closely follow all six of these steps, or loosely convert your data to themes and insights.
At its least intensive level, thematic analysis looks like skim-reading your data and taking note of recurring themes and thoughts. On a deeper scale, you focus in and meticulously assign codes to each relevant piece of feedback—this enables you to truly understand the themes across your data and their relevance to the overall research study.
Thematic analysis can be done manually, as we explain below, or can be done with the assistance of a user interview analysis tool. Both are productive in terms of gleaning valuable insights, but one’s a lot quicker than the other (no prizes for guessing which).
Speed up user interview analysis
Simplify your interview workflow. Transcribe interviews in a flash, get speedy summaries, and playback suggested clips with Interview Studies.
1. Revisit your user research goals
Effective analysis requires you to never lose sight of your original user research plan and goals. By touching base with what you set out to achieve by conducting user interviews, you’re priming yourself to look for relevant patterns, themes, and insights.
These research objectives should act as your north star throughout the interview process, and analysis is no different. Once you’re clear on what you’re aiming for, you’re ready to dive into your dataset.
2. Transcribe your interviews and organize the scripts
To analyze your data, you need to convert it to written word. After your user interviews, you’ll likely have hours of audio and/or video recordings.
You can transcribe this manually, by listening to the recording and typing out the responses, or automatically, by using a transcription tool like Maze Interview Studies or a transcription-only tool.
💡 Pro tip
You’ll be using this transcription to look for common themes and patterns between respondents, so don’t leave anything out—even if you think it’s not useful in the moment!
You’ll want to organize your scripts for easy access, helping you cross-reference participants and their answers. There are two ways to do this:
- Create a script or document for each interviewee: This method makes it easy to cross-reference your answers between individuals
- Make a separate document for each question: This method makes it easier to identify patterns and themes
Once you have your user interview scripts, it’s time to perform the actual interview analysis.
3. Read through your data and assign relevant codes
Begin thematic analysis of user interviews by familiarizing yourself with the data and reading through participant responses multiple times.
Thematic grouping is the best, but it takes time. You have to read everything closely, seeing through the responses and parsing them for deep meaning.
Scott Hurff
CPO and Co-Founder at Churnkey
Share
Note any responses with terms or phrases relevant to your UX research goals. You’ll want to return to these notes later, so mark them down by assigning a code.
A code should summarize your point of interest in a few words. Let’s say you run into the following response:
“I have trouble navigating my profile. There are too many options. The worst part is going through them all, I can’t find a search bar anywhere.”
A good code for the first bolded phrase would be: ‘navigation issues’, while the second code could be ‘overwhelming profile features’. The third code could read: ‘search function findability’.
Your assigned codes will be the basis for further organizing your data into themes, and usable insights.
When looking through your user interview scripts, also consider any notes you or a colleague took during the interview, as this can help get deeper insights. Scott Hurff, CPO and Co-Founder at Churnkey, suggests asking yourself:
- “How did users speak?
- “What words did they use?
- “Did certain phrases keep appearing?
- “Were they frustrated, happy, content, timid?”
User interview notes can support your analysis, so keep them close to hand throughout the process.
4. Sort codes into overarching themes
While reading through your data and assigning codes, you’ll notice relevant patterns, sentiments, and themes starting to emerge. Once you’ve sifted through all your responses, note down your codes on a different document and group them into overarching themes.
Scott explains his approach to this step:
“Once common themes begin to emerge, I like to group them in a spreadsheet and chart them to get a sense of volume. What themes emerge the most? Which type of customer is experiencing this (for example, small businesses vs. indie hackers vs. mid-market businesses)?”
Your chosen theme names should label each code’s subject matter, making it easy to find relevant insights and points of interest. Theme examples could include:
- Profile features
- Navigation issues
- Billing and payment
- Search function findability
If you’re conducting thematic analysis manually, try sorting codes into temporarily flexible themes using a whiteboard or sticky notes. This makes it easy to move themes and codes around until you find a place that fits each best. Expect to move things around as you assign codes and more themes emerge.
Once your data is distilled into broad, overarching themes, your insights are ready for the taking.
5. Identify recurring ideas and highlight crucial information
At this stage in the thematic analysis process, you’ll start to uncover customer insights directly connected to your user research goals. Look over the reocurring codes that appear across a single theme to find out what’s most pressing for users.
If many users are stating they “can’t find the search bar” under the ‘search function findability’ theme, and your UX research goal is to improve navigation—you’ve just found an actionable insight.
Highlight responses from recurring codes, and keep on combing the rest of your themes for similar ideas or codes to uncover relevant pain points, usability issues, or particular product impressions and sentiments.
This is also when you might find it beneficial to restructure the themes that have emerged. Don’t be afraid to regroup and divide your themes into a new order—it’s easy to miss connections when first identifying themes, or to identify better structuring and theming opportunities for codes as your analysis evolves. Take another look over your themes to find the best way to organize them.
Once you’ve defined your high-level themes, you can use them to inform the next stage of the UX design and development process. The specifics depend on your goal, but use the themes you’ve identified alongside other forms of UX research to outline a path toward your desired outcome.
💡 Looking for a tool to simplify the process of identifying themes in user interview data? We’re covering the best user interview tools in the next chapter, including Maze Interview Studies—purpose-built for getting insights from interview data.
6. Create a report and prioritize insights based on UX research goals
The final step in analyzing user interview data is to share your findings. You’ll want to create a UX research report for key stakeholders—such as your team, other departments, and higher-ups—to aid alignment for actioning your insight-informed plan.
A report will do two things:
- Clearly communicate what you’ve accomplished to stakeholders, grab their attention, and get them on board with proposed solutions.
- Ensure everyone in your organization is on the same page. When it’s time to start making design changes, your team will know exactly what to do.
Some of the key components to include in your UX report are:
- The summary: Your summary should briefly explain your research goals, methodology, and key themes. Doing so makes it easy for stakeholders to understand the purpose of your projects and how your findings are relevant. Your summary should be an overview to set the scene before diving into specifics.
- The methodology: This is where you go into the details of how you approached your UX research. This section of the report should also serve as reference if other members of your team need to conduct user interviews again.
- The next steps: With your newly-found insights, you’re in a position to describe effective solutions. Note down recommendations connected to your goals ranging from new product updates, features, and information architecture reworks.
How to present user interview analysis to stakeholders
A key part of the UX research process is sharing insights with your team. It’s critical that stakeholders know the outcome of your research if you want to evangelize research and improve stakeholder buy-in.
Begin by laying out your research goals and demonstrating the connections to wider business objectives. Just like in your report, you should be speaking straight to stakeholders' pain points, hinting at how your user experience research will solve business problems. Tell them what you did and why you did it.
The next step of your presentation is to follow-up with key findings and atomic research nuggets. Created by Tomer Sharon and Daniel Pidcock, these digestible conclusions succinctly communicate exactly what you’ve done and the results you’ve reached while aligning them with product development. Sprinkling in atomic research nuggets also ensures that important results stay at the forefront of stakeholder’s minds.
Make sure to walk stakeholders through each step of your research process in a way that highlights how you got from start to finish. For example:
- Experiments: “We did this…”
- Facts: “…and we found out this…”
- Insights: “…which makes us think this…”
- Conclusions: “…so we’ll do this.”
Consider creating a UX research case study with strong storytelling tactics and a memorable narrative. This provides ample context for stakeholders, making it easy to thoroughly digest what challenge you faced, how you dug deeper with UX research, and the insights you uncovered.
Hillary Omitogun, UX Research Consultant and Founder of HerSynergy Tribe, emphasizes how she personalizes reports based on the stakeholders she’s presenting to:
“I’ve noticed no one really reads long reports, so when sharing insights with the technical team (e.g. engineers) I focus on facts and hard data. While presenting to the marketing team, I include qualitative data.
For C-level executives and when I want a decision to be made, I go straight to the point in my report, adding direct & easily skimmable recommendations with hard data as support. For leaders or execs, I atie in recommendations to the business KPIs or goals.
Regardless of the stakeholder I’m sharing the insights with, I add an Appendix section with detailed insights.”
Conducting effective user interviews only gets you so far—you need buy-in to action your findings. A strong report is how you get them on board with your plans.
UX interviews analysis best practices: Tips from UX research professionals
If you follow the steps above, you’ll be sure to transform a digital data pile into rich, descriptive insights, serving as the basis for actionable product development solutions.
To support you along on the way, we’ve spoken to UX leaders to collect their best practices for the analysis process. Here we go.
1. Avoid confirmation bias
Confirmation bias is a cognitive bias that occurs when we have preconceived notions of what users think about a topic. Instead of objectively reading data, researchers are prone to projecting expectations on the responses, leading to an opinionated interpretation of results.
What does confirmation bias look like in action? Let’s say you personally worked for weeks on implementing a new dashboard for the user’s homepage, and you conducted interviews to check if users are finding the dashboard easy to navigate.
You might then be subconsciously inclined to read into ambiguous comments—playing up positive comments while disregarding negative experiences regarding the feature—due to your close involvement in its design and development.
To avoid cognitive biases in UX, the first step is being aware of them. If at all possible, ask someone from your UX research team to help as well—a second pair of eyes from a neutral party is invaluable.
Hillary shares her approach to mitigating bias when analyzing user interviews:
“With any type of bias, being aware of it is the first step. When we know such bias exists, we note it down and ensure that we remain open to being wrong.
“When I worked with team members on a project, I had everyone write down their hypotheses about the project, product, and/or users, as well as what informed said hypotheses or why they think so.
“This helps make sure we’re relying on the data and not what the Head of Product thinks should be done based on their own biases.”
2. Consider a tool to streamline your interview analysis
Like anything, interview analysis is more efficient when you’re using the proper tool for the job. We’re not just talking about saving time and effort, either; while this is definitely one benefit, it’s only the tip of the iceberg.
Not only is manual analysis tough on time—it’s prone to human error. It’s easy to miss whole sentences while transcribing interviews, accidentally use one word over its synonym, or gloss over points of interests when assigning codes.
A strong user interview tool can help you avoid these issues. There are ample options to choose from, all boasting different features and functionalities. Some even support other UX research methods, such as running UX research surveys, conducting card sorting, and carrying out usability tests. The best tools do it all.
For example, Maze is a comprehensive user research platform that offers an Interview Studies solution. This user interviews research tool supports your user interview analysis with a stack of AI-powered features, including automated transcription, thematic analysis, interview summarization, and reporting.
Haley Stracher, Design Director and CEO of Iris Design Collaborative, shares her tool stack for running user research, including user interviews:
“I use a lot of systems like Hotjar and others that track user interactions post-launch. For user interviews during development, you can use products like Maze to not only conduct the interview, but also track the data afterward.”
3. Consider demographic information
Not all user segments will think the same thing. What may seem like an efficient and time-saving interface change to one user segment may appear confusing to another. It’s important to collect and consider demographically-diverse feedback from the get-go.
When analyzing certain codes, themes, and insights, always check the demographics and psychographic details of the users they came from. User personas are beneficial here, if you already have them. For example, you may find that it’s support and entry-level users that find a certain feature unnecessary while executives tasked with decision-making think it’s invaluable.
Make sure to look at your demographic information in correlation with answers—if one demographic picked a certain answer, that could tell you something important about the way they approach and interact with your platform!
Haley Stracher
Design Director and CEO at Iris Design Collaborative
Share
4. Follow-up for additional feedback and insights
While user interviews can deliver a wealth of insights, they’re not always a one-fell-swoop solution to your UX research, design, and development needs. If you find your insights are lacking, schedule a follow-up session with willing participants. You can ask them follow-up questions to expand on certain answers for more context.
Hillary notes the importance of asking your users at the end of sessions if they’re open to help with follow-ups or future studies:
“Depending on the project or product, I often ask users if they’d like to be contacted for future studies. In a few cases, I’ve had to reach out to users to confirm that they said a certain thing if the recording wasn’t clear or I didn’t hear them properly.”
What comes after user interview analysis?
By this point, you’ve taken the insights from your research and presented user interview findings to stakeholders. They’ve listened to or read through your report and are fully on board.
Put simply, you’ve got the green light; it’s time to move forward with your next steps.
So, what is next?
- Develop a plan for making design changes: For each insight and proposed solution, you’ll need to make a plan of action for carrying out product development and design changes
- Use affinity maps to organize ideas and priorities: If you’re dealing with large amounts of research data, your team can use affinity diagramming to prioritize ideas and solutions
- Run follow-up research: Your plan should include further user research throughout the development process, whether that’s more user interviews or another UX research method
- Store your findings in a research repository: Any user research initiative should be documented in a research repository—this helps improve your research operations and workflow by building an archive of all your research and findings
User interviews are a starting point, not a finish line. The insights you uncover should inform further research, and act as a driving force behind your UX design and development initiatives.
You want to keep checking in with users throughout all stages of the product development process—from problem discovery, all the way through to post-launch. A UX researcher’s job is never really done—great UX research is a continuous process of speaking to users, listening, and helping iterate the product.
Frequently asked questions about user interview analysis
How do you analyze qualitative data?
How do you analyze qualitative data?
You analyze qualitative data by assigning codes to points of interest, and then organizing those codes into overarching themes. You then interpret themes, codes, and responses that are most relevant to your UX research goals, and build an action plan to fit.
What is the best way to analyze user interviews?
What is the best way to analyze user interviews?
The best way to analyze user interviews is with thematic analysis. By identifying recurring themes and patterns, you can quickly and efficiently pinpoint insights. You’ll then be able to use these insights to work out potential solutions.
How do you collect data from a user interview?
How do you collect data from a user interview?
Collecting data from an interview includes using a transcription tool or recording the interview and then typing out responses word from word. You can either collect and keep your data in a document or in a repository that comes with most transcription and interview tools.