Chapter 7

What is heuristic evaluation? How to find and prevent UI usability mistakes

Heuristic evaluation is a process to detect any usability issues users may come across when using your product. This method helps to assess the usability of a product, by following predetermined evaluation principles. Heuristic evaluation is typically conducted by a UI/UX designer, or someone with similar experience.

What is heuristic evaluation?

Heuristic evaluation is a systematic assessment to determine if your user interface is fit for use. This usability inspection method is usually performed by someone with extensive UX/UI knowledge, the evaluation highlights any usability issues relating to the user interface (UI) that someone may face when navigating the product. It enables designers to decrease user time to value, creates more intuitive products for end users, and should be at the top of every UI-build checklist.

Heuristics themselves are the predetermined, recognized usability principles that usability experts use to guide this assessment and these heuristics (UI principles) will change depending on your product and its mission.

If in doubt, you can turn to Jacob Nielsen’s ten heuristics for user interface design as a starting point—more on those later.

Heuristic evaluation can be carried out at any time in the design process, and most-likely will need to be conducted a few times as your product interface evolves. You can also conduct heuristic evaluation when building a new feature.

What is the difference between heuristic analysis and usability testing?

While both usability testing and heuristic evaluation provide usability data points for product teams to act on, the two are very different.

Usability testing is completed by the end-user—often the ideal user persona for your product. User testing typically asks real people to complete a list of in-product tasks, and their ability to do this easily is then assessed. Remote usability testing is common in today’s world as it enables product teams to reach a broader spectrum of users and get their user testing done faster.

One reason product teams may opt for heuristic evaluation over user testing is that—when running usability tests or guerrilla tests, with existing users—you may end up with skewed data, as current users have too much context around how the product works, what you’re looking for, and may aim to please or fall under social desirability bias. This often gives an inaccurate idea of an objective or first-time user’s perspective.

Do more with Maze

Combat assumptions and bias with a tool like Maze to make the right product decisions—every time.

In comparison, heuristic evaluation (also called heuristic analysis) is completed directly on the product (human computer interaction) by UI designers and product specialists (known as ‘evaluators’ in this process). These people have a solid understanding of product development, user psychology, and heuristic evaluation—they are not, however, end users. These evaluators examine a product’s interface and assess its compliance with pre-determined heuristics.

We spoke to Senior UX Lead Designer @ Foyer Group, Geoffrey Crofte, to get his definition on the difference.

Heuristic analysis is a method of evaluating usability by an expert, while usability testing is a method of evaluating usability by observing real users interacting with a product. Both are complementary tools to make better interface, and products.

Heads up 💡

Looking for more ways to test the usability of your product? Try these usability testing templates.

What are the pros and cons of heuristic evaluation?

We asked Geoffrey Crofte, who created a checklist to improve the usability of web forms, to share some of the pros and cons he’s run into when conducting heuristic evaluations in the past.

Pros of heuristic evaluation

  • Collaborative: heuristic evaluation can be used in collaboration with other usability testing tools and methodologies to give your teams a well-rounded insight on potential problems users may face within your product.
  • Fast & affordable: to conduct a heuristic evaluation teams often use in-house resources, which means, as long as it's given priority, this project can move fast and you won’t be paying extra for it.
  • Flexible: this type of analysis can be performed at any stage in the design process, from lo-fi prototypes to production-ready interfaces, giving you a chance to check your interface early and often.
  • Helps prioritize: measuring usability against heuristics helps you efficiently prioritize UI updates you’ll need for a smooth release, as your evaluators mark urgency of issues according to a severity scale.

There are certainly a lot of pros to running heuristic analysis—however, it’s always good to be prepared before you dive in. Here’s some of the challenges to be aware of that can crop up when conducting heuristic evaluation.

Cons of heuristic evaluation

  • Potentially subjective results: different evaluators may have different opinions on what constitutes a usability problem or the severity of an issue—this is why it’s critical to ensure you have a robust usability testing plan and clear aims, objectives, and metrics in mind.
  • Evaluation is only as good as the heuristics being used: it’s important to use a set of heuristics that are comprehensive, and relevant to the user interface being evaluated. Not all heuristics may apply to your specific product or user base, so it’s a good idea to go beyond the basics or typical heuristics if you can.
  • It doesn’t involve real users: on the one hand, this can be a positive, as it removes the risk of bias from current users. However, it can also mean you risk UX cognitive biases like false-consensus bias cropping up, if your evaluators have worked closely on the product, or are predisposed to think in a positive light about the design. To a certain extent, certain problems may only ever become apparent when the product is in the hands of real users.

As with any type of research, there are pros and cons—all of which are important to weigh up if you’re considering running this type of user interface design analysis.

11 Examples of usability heuristics

Next, let’s take a look at some popular usability heuristic examples in action, to inspire your own product investigations.

Accessibility and inclusion

If you’re not running accessibility tests during prototyping stages, you’re missing a valuable opportunity to maximize the inclusivity of your product. Accessibility is a relatively new heuristic on the table—considering Jakob Nielsen and Rolf Molich’s original ten heuristics date back to 1995, we’ve come a long way.

Geoffrey Crofte, Senior UX Lead Designer @ Foyer Group, shares more:

“When you do usability testing or heuristic analysis, most of the experts forget about accessibility and usability of user interfaces because expert analysis has the imperfection of bringing the flaw and biases of the expert with it. Unfortunately, unless the experts are themselves impaired people, accessibility won’t be analyzed.

Introducing accessibility in your heuristic analysis is a way to put your own biases to the side and work on an aspect of your design that’s usually forgotten.”

Example of accessibility and inclusion

There are multiple areas of accessibility and inclusive design to consider when testing the user interface design of your prototypes, including:

  • Legibility: content on the page can be easily read in plain language, comes in optional sizes, and can be accessed by a screen reader. Airtable does a fantastic job of this by offering users various interfaces to select from that match their needs; plus, if the template isn’t there, the user can design their own interface avoiding overworking a user’s memory load.
  • Timing: users are given enough time to process information—like error messages—or complete a task without losing information, and have the option to adjust time-needed.
  • Movement & flash: elements of the page that move or flash are not overwhelming and can easily be turned off. Additionally, for this part of heuristic evaluation, you can include warnings for areas which include these elements.
  • Auditory options: the product does not solely rely on sound at any point to deliver information, and you present users with options to turn off or adjust audio.
  • Compatibility: products are optimized for compatibility with assistive technology, from providing alternative text for images and non-text elements, to ensuring keyboard accessibility, and keeping users informed of their options along the way.

Aesthetic and minimalist design

White space, or negative space as it’s often referred to in design, helps your users digest information. When designing, it should be viewed as an object on page and hold as much weight as your in-app content that delivers information or provides a function. Space can come between text, images, interactive buttons, and more.

For example, user testing research suggests the ideal spacing between lines of text is between 130-150% of your font size.

Example of aesthetic and minimalist design

Headspace does aesthetic and minimalist design exceptionally well, and rightly so given their focus as a mental wellbeing app. They can’t afford to overwhelm users with clutter or busy interfaces. Take a look at their Headspace for work app—the negative space coupled with plain language allows for digestion of the content, and provides clear focus for the relevant page aspects.

Consistency and specific standards

Successful products rely on what people already know. It takes a lot to get someone to delve into a new product and be open-minded in learning how to navigate it. Consistency and certain standards ensure you’re building on existing knowledge to provide your user with a minimal learning curve.

We spoke to Gene Kamenez, Co-Founder & CEO @ Uxcel, for his insights on heuristics.

“When the system follows established conventions and standards, users can more easily transfer their knowledge and skills from one part of the system to another. This can make it easier for them to navigate the system and find the information or tools they need to achieve their goals.”

Example of consistency and standards

Grammarly for Business relies on familiar CTA phrasing to tell their users exactly where the button leads. The “learn more” CTA in their suggestions is typical across multiple technologies and is something users are familiar with, and comfortable clicking. If the language used was uncommon, their click-through rate may be impacted, ultimately leading to confused users.

Error prevention and forgiveness

In usability, ‘slips’ are unconscious mistakes due to a lack of attention or an accidental click of a button, while ‘mistakes’ are conscious errors due to someone incorrectly interpreting what will happen.

This heuristic ensures you’re avoiding slips and mistakes, by delivering a UI that clearly conveys information and action repercussions, so users don’t make mistakes. Additionally, it encourages products to provide a margin of forgiveness so your user can easily undo their error.

Error prevention techniques, such as input validation and error checking, can help reduce the likelihood of errors occurring in the first place. This makes it easier for users to complete tasks and achieve their goals without being interrupted by errors or having to spend time correcting mistakes.

Gene Kamenez, Co-Founder & CEO @ Uxcel

Example of prevention and forgiveness

TravelPerk does this well with their desktop application: users receive a warning message when they click ‘delete trip’, giving them the opportunity to amend their slip—or confirm this is the action they want to take.

Flexibility and efficiency of use

Not all users are going to have the same product knowledge—some users will be happy with the basic functionalities that get their job done, while others may excel in understanding your product, use it frequently and consistently, and demand more features. We call these people ‘power users’.

Flexibility and efficiency as a heuristic encourages you to think about optimizing the experience for these users. Analysis from this angle allows you to deliver a rapid and expansive product experience to those who are looking for it. While flexibility may often lead to efficiency of use, it can be tricky to balance, as too much flexibility can make some users lose their way.

Example of flexibility and efficiency of use

A common example of flexibility in practice is offering ways to navigate your product quicker for those who want it, i.e. keyboard shortcuts.

Adobe does this exceptionally well with their entire tech stack. Their knowledge base offers users a way to download keyboard shortcut cheat sheets, so they’re able to navigate the tool quicker and in a way that works for them. Take a look at the example cheat sheet for Adobe Illustrator.

Help and documentation

Help and documentation gives users the supporting information and instructions they need as soon as they need it—it avoids product friction, frustrated users, and promotes customer success. This comes in many formats—here, we’re talking about low-touch customer success models (which offer help via a digital format) as opposed to high-touch (where a human team steps in to help).

Help and documentation can be proactive:

  • Product tours
  • Onboarding tutorials
  • In-app product launchers
  • Help bars

Or, it can be reactive:

  • Tooltips
  • Knowledge bases
  • FAQ sections
  • Action-based product modals

What’s important is this heuristic ensures you’re delivering users the support they need, exactly when they need it.

Example of help and documentation

Take a look at how ChartMogul handles their help and documentation—by providing a link and tip to ‘Learn how to add custom attributes’, the platform goes beyond informing the user that they need to add custom attributes, and offers the opportunity to learn how to do this.

This takes what could be a frustrating product moment, to a proactive learning moment, directing the user to a knowledge base and walkthrough

Help users recognize, diagnose, and recover from errors

Different from error prevention and forgiveness, this heuristic refers to how you present error messages, and the solutions you offer to solve them. Much like consistency and standards, your error messages should follow patterns users are familiar with seeing in other applications. And, above all, it should offer solutions to how the user can avoid seeing the same error again in the future.

Geoffrey’s rule of thumb on recognizing, diagnosing and recovering from errors comes in two parts, padded with a ‘reality check’ either side:

  • Prevention: give clear instructions
  • Reality check: errors will likely still happen
  • Diagnose and recover: explain how to fix the error with an error message
  • Reality check: if the message doesn’t help the user address the issue, it’s not a helpful message and you should rework it

Example of helping users recognize, diagnose, and recover from errors

Senior UX Lead Designer, Geoffrey Crofte, walks us through an example of a form completion task—and how to help users recognize, diagnose, and recover from an error.

“Let’s say you complete and submit a form, and something goes wrong: two fields are flagged red, but you don’t have the information required to address these issues. You recognize, but cannot diagnose or recover from errors. You are stuck.”

Following this heuristic, you’d need to add a message explaining why these fields were flagged, and how to solve the issue.

Match between system and the real world

Otherwise known as natural mapping, your product and UI navigation should match your users’ logical flow. You can do this by pulling on what you know they know from their real-world setting. This is also the time to scan for internal company jargon or abbreviations that you may use regularly, but would confuse an end-user.

To follow this heuristic successfully, you’ll need to step into your user’s shoes—delivering language, content type, and product navigation in a way that makes sense to them. A great way to ensure you’re doing all of this is by running card sorting and tree testing during the wireframing stage.

A match between the system and the real world can help users feel more connected to the system and their actions within it. When the system feels like a natural extension of the real world, rather than a disconnected or abstract tool, users can feel more motivated and engaged in using it to achieve their goals.

Gene Kamenez, Co-Founder & CEO @ Uxcel

Match between system and the real world

Icons are powerful examples of real-world matches and helping users relate to and understand UI, and Fiverr uses them brilliantly. Icons on Fiverr perfectly match a project status with an appropriate icon to provide users with a more joyful and visual experience. This gives the user a kind of visual shorthand for knowing where their order is at in the project status flow.

Recognition rather than recall

Users learn at different rates, and you can’t expect all users to have the same muscle memory. Recognition rather than recall ensures you’re delivering product learning curves that cater to all types of users. Among all usability inspection methods, this heuristic is commonly overlooked by experts—due to them already being familiar with the user interface in question.

It often includes an assortment of in-app product modals, tooltips, launchers, and micro tours to allow your user to recognize what they need to do on each product page rather than requiring them to recall the information from a lengthy onboarding video they saw once when first signing up.

By providing users with clear and visible cues and prompts, the system can help them recognize the information or actions they need, rather than requiring them to recall it from memory.

Gene Kamenez, Co-Founder & CEO @ Uxcel

Recognition rather than recall can be achieved through various design techniques:

  • Providing clear and descriptive labels for buttons, links, and other interface elements
  • Using consistent layout and navigation patterns across the interface
  • Displaying important information prominently and using visual hierarchy to guide the user's attention

Example of recognition rather than recall

Uxcel manages this heuristic by encouraging new users to ‘Click to learn more’ on app pages they’re visiting for the first time. Rather than overwhelming users with a lengthy onboarding tutorial, they empower users to learn as they go, when they want to, with prompts in all the right places.

User control and freedom

A sense of control and freedom to roam your product will do wonders for your retention rates and user experience. Somewhat ironically, the best way to do this is by giving users the chance to bow out whenever they want or need to.

Autosave features, clearly marked ‘escape exits’, and keyboard shortcuts are all ways you can put the power in the hands of the user. Gene Kamenez, Co-Founder & CEO @ Uxcel, suggests that:

“User control and freedom can be crucial for helping users achieve their goals by giving them the flexibility and autonomy they need to work effectively within the system.

“It’s particularly important in complex systems, where users may have a wide range of goals and needs. For example, if a user is given the ability to customize their work environment or set their own preferences, they may be able to work more efficiently and effectively.”

Example of user control and freedom

Remotebase is a prime example in giving their users control during the signup process. In the top left corner, users have the option to go back to the previous question. This page also uses our next heuristic example, visibility of system status, with the completion bar at the bottom of the screen and the percentage completion rate in the top right.

Visibility of system status

Trust comes from communication, and communication is a two-way street. This heuristic ensures feedback to your user as soon as they input something into your product. That could be a button click, a data upload, or another action. Whatever your user is doing, let them know the status of that task and what your product is working on to achieve their job-to-be-done.

This will also help manage user expectations and give them a better understanding of what will happen after they’ve submitted a task—including the timeframe it takes your product to complete the action.

Gene Kamenez explains that: “Giving immediate feedback on users’ actions is vital. It can help the user understand what’s happening within the system and whether their actions have the desired effect. For example, if a user is trying to download a file and they can see a progress bar, they know the system is working on their request and the file will be downloaded eventually.”

Example of visibility of system status

Geoffrey Crofte, Senior UX Lead Designer @ Foyer Group, shares an example he’s currently facing with his team:

“In the insurance industry, we handle sensitive information including medical data, so it's common for our interfaces to use limited-time sessions for security purposes.

“However, this feature has often been hidden in the background of the app, leading to frustration when users would finish 30 minutes of work only to be unable to save it because their session had ended.

“This goes against the principles of visibility of system status and user control and freedom. To address the issue, we should notify users when their session is about to end and give them the option to extend it if needed. This will restore control to the user, improve transparency, and make the interface more inclusive.”

How to conduct a heuristic evaluation for a holistic usability assessment

Now you know which heuristics to bear in mind, let’s take a look at the eight steps you’ll need to run a complete UX audit or usability assessment using heuristic evaluation. Here’s what Geoffrey Crofte had to share:

1. Choose a set of heuristics to use as a guide

There are several sets of heuristics available, such as Jakob Nielsen's 10 Usability Heuristics, Bastien & Scapin’s Heuristics or even the ISO 9241-110 standard. Choose a set of heuristics that are relevant to the user interface design being evaluated, or select your own.

2. Gather a team of evaluators

If you have the chance to use more than one evaluator, seize it. It’s often helpful to have a team of evaluators with different backgrounds and perspectives to ensure a thorough and diverse evaluation. Three to five evaluators should give your team a comprehensive assessment of your UI.

3. Familiarize your evaluators

Make sure your evaluators are up-to-speed with the chosen heuristics and the interface being evaluated. Try to standardize this briefing to ensure all your evaluators receive the same information and avoid any personal bias or presumptions they may bring with them.

4. Prepare common paths

Prepare common user paths people are likely to take, so your evaluators can explore the same flow. This brings more direction to your assessment and heightens the chance of running into real-world UI problems.

Common paths like profile builds, sign-ups, or checking out, are useful to get a complete heuristic evaluation. You’ll want to include hidden features in these pathways too, so a complete picture of your product can be evaluated.

5. Conduct the evaluation

Each evaluator should independently inspect the user interface, following common user paths, and looking for problems or areas for improvement.

When an error occurs that violates the selected heuristic criteria, evaluators should document this accordingly:

  • Issue found
  • Heuristic violated
  • Description of the issue
  • Severity level
  • Impact on user

6. Review and prioritize the findings

Your evaluators should review all the issues found and prioritize them based on their severity and impact on your user. This is a collaborative process—although the evaluators conduct assessments individually, it’s worth everyone coming together so they can compare, contrast, and prioritize their findings.

7. Action your changes

Present the findings and recommendations to your product team and stakeholders in a clear, actionable way. Now’s the time that everyone gets stuck in to focus on the usability issues that were discovered, and solve them.

8. Run a follow-up

Finally, it’s important to schedule a follow-up session—either using evaluators, or assessing other usability data, to recap the issues that were identified during the evaluation, and review how they’ve progressed and if they’ve been addressed.

The benefits of heuristic analysis for usability evaluation

It’s clear there are plenty of benefits to conducting a heuristic analysis when assessing your product’s usability. A thorough evaluation can:

  • Help build a more diverse and inclusive product
  • Reduce your product’s time-to-value for new users
  • Help fight churn rates by delivering a more intuitive learning curve
  • Increase NPS by giving users more control over the product
  • Minimize tickets for your customer support team
  • Reduce number of product changes by getting things close-to-perfect quicker

Overall, the pros of conducting heuristic analysis far outweigh the cons, and heuristics should be on any product team’s list when building a new product or launching a new feature.

Combining heuristics with other usability testing methods is the ideal way to gather a holistic view of your product, and ultimately ensure minimal user issues when you launch.

Run a usability test with Maze

Build more user-centric products with a usability test to help find friction and eliminate key pain points.

Maze Enterprise - Increase ROI