Design & UXAll articles

Usability Testing: Methods, Process & How to Run It

Usability testing is the cheapest way to find out your product confuses people before launch does it for you. Here's how to run one — the methods, the process, how many users you actually need, and what to do with what you learn.

Occasional field notes on building software — no spam

Idealogic — the usability testing process

Usability testing is the practice of watching real people attempt real tasks in your product so you can see exactly where they stumble. Not what they say they'd do, not what they think of the colors — what they actually do when you hand them a goal and get out of the way. It's the cheapest, bluntest way to find out your interface confuses people, and it's a lot less painful to learn that in a test session than from a churn chart three months after launch.

This guide covers the parts that matter when you run one for real: the main usability testing methods and when each fits, how to run a test step by step, how many users you genuinely need (the honest version), and how to turn a pile of observations into fixes your team will actually build. It pairs well with a broader UX audit, where testing is one method among several.

What usability testing is

Usability testing is observation, not opinion-gathering. You give someone a task — "find a plan that fits a team of ten and start a trial" — then you watch, mostly in silence, and note every place they pause, backtrack, or pick the wrong thing. The friction you see is the data. What people tell you they think afterward is interesting, but it's secondary, because users are famously bad at predicting their own behavior.

That's the trait that makes it powerful. A stakeholder can argue all day that a button is obvious; one person missing it twice in a row ends the argument. Testing replaces taste with evidence, which is why it sits at the center of any serious user-centered design practice rather than off to the side as a nice-to-have.

One caveat worth saying early: usability testing tells you whether something works and where it breaks. It doesn't tell you what people want built, and it won't replace the discovery research you do before there's anything to test. Different job, different tool.

The main methods

There's no single right method — there's the one that fits your question, your timeline, and your budget. Most teams end up blending a couple. Here's how the common usability testing methods compare.

MethodWhat it's forEffort
ModeratedUnderstanding why — probing reasoning on rough or early designsHigh — a facilitator per session
UnmoderatedConfirming a pattern at scale once you know what to checkLow — a tool does the running
GuerrillaA fast gut-check, cheap and rough, no recruitingVery low — whoever's nearby
RemoteReaching users wherever they are, over video or a testing toolMedium — setup, then it scales
In-personWatching body language and subtle hesitation up closeHigh — scheduling and a room

A few opinions on that table. Moderated and unmoderated aren't rivals; they're a sequence. You run a handful of moderated sessions early to understand the reasons behind the friction, then switch to unmoderated tests to check whether the fix holds across more people. Guerrilla testing gets unfairly dismissed as sloppy, but for an early-stage product it's often the highest return on an afternoon you'll find. And "remote vs in-person" matters less than it used to — remote moderated testing gets you most of what a room would, minus the travel.

The split that confuses people most is moderated versus unmoderated, so it's worth being precise: moderated means a human runs the session live and can ask "what made you click there?"; unmoderated means the user is alone with a tool and you watch the recording later. One trades speed for depth, the other trades depth for scale.

How to run a usability test, step by step

The backbone of a good test is the same whether you're checking one screen or a whole onboarding flow. The order is what keeps it honest — skip the goal and you'll collect observations you can't rank.

The usability testing process in five steps, left to right: Plan — set a goal and write realistic tasks; Recruit — find about five people who match your real users; Test — run the sessions and stay quiet while you observe; Analyze — review recordings and group recurring friction; Fix — turn findings into prioritized design changes. An arrow runs across all five, and a dotted return arrow loops from Fix back to Plan, showing that testing repeats in rounds.
Five steps, run in rounds — each pass should leave you with fixes, not just notes
  1. Set a goal. Decide the one thing this round is meant to answer — "can a new user reach the first value moment without help?" A vague goal produces a vague report. This is also where you decide what not to test, which keeps the session short enough that people stay sharp.
  2. Write tasks. Turn the goal into realistic tasks phrased as outcomes, not instructions. "Buy a gift card for a friend" is a task; "click the Gift Cards menu item" is just narrating your own UI back at the user. Neutral wording is the whole game — the moment you hint at the path, you've stopped measuring anything.
  3. Recruit. Find people who resemble your actual users, not your colleagues. Five or so per group is plenty (more on that below). Screen for the behavior that matters — if you're testing a fintech flow, "has opened a bank account online" beats "is between 25 and 40."
  4. Run the sessions. Hand over the task and go quiet. The hardest discipline in this whole process is not rescuing someone the second they struggle — their struggle is the finding. Ask them to think aloud, and when they ask "is this right?", gently bounce it back: "what would you do if I weren't here?"
  5. Analyze. Watch the recordings and group what repeats. One person fumbling a button is noise; four people fumbling the same button is a fix. Tag each issue by how badly it hurt and how often it showed up, so the ranking writes itself.
  6. Fix. Translate the findings into specific design changes, in priority order. A test that ends in a tidy report nobody builds from was theater. The output you want is a short list an engineer or designer can pick up on Monday.

Most of the calendar lands on planning and analysis, not the sessions themselves, which usually surprises first-timers. The testing is the quick part; writing good tasks and reading the results honestly is where the work is.

How many users do you actually need

For most qualitative tests, around five users per round is the working answer — and that's not a shortcut, it's well-supported. The Nielsen Norman Group's long-standing guideline is that roughly five users uncover about 85% of the usability problems in a given flow, with each extra user past that finding less and less you didn't already know. Run a sixth, a seventh, and you mostly watch the same issues repeat.

The honest nuance people skip: that 85% holds for one type of user on one set of tasks. If your product serves two genuinely different audiences — say, patients and clinicians in a healthtech tool — you need five of each, because they'll trip over different things. And if you've crossed from "what's broken?" into "what percentage convert?", you've left usability testing for quantitative research, where the numbers get much bigger.

Five users won't tell you everything. They'll tell you the things that are wrong enough to matter — and that's almost always the list worth acting on first.

The bigger lever isn't sample size, it's frequency. Five users this month, fix what you find, then five more next month beats twenty users once a year. Small, repeated rounds catch regressions early and keep the product honest as it grows.

Turning findings into fixes

A test is only worth running if it ends in changes. The trap is the beautiful findings deck — fifty observations, color-coded, that nobody can act on because nothing's ranked. Skip it. What a team can actually use is a short, prioritized list where each item carries the problem, the evidence, and a rough sense of effort.

Rank by impact times frequency. A confusing label on a settings page four users glanced at isn't the same as a checkout button two of five couldn't find. Lead with the things that block people from the core job, tag each with rough effort, and the "major, low-effort" items get fixed this sprint instead of debated next quarter. The same severity thinking we use in a full UX audit applies here — testing just feeds it sharper evidence.

Then close the loop. The fix is a hypothesis until the next round of testing confirms it, which is exactly why the process bends back on itself. Usability testing isn't a gate you pass once before launch; it's a habit that runs through the whole UX design process, most usefully right after you can tell UI from UX and start treating them as separate problems to test.

Want to know where your product loses people? Test it with real users
Talk to our design team

Frequently asked questions

  • Usability testing is watching real people try to complete real tasks in your product, so you can see where they hesitate, get stuck, or give up. It's not asking people what they think of a design — it's observing what they actually do with it. The output is a ranked list of friction points and the evidence behind each one, which is far more reliable than opinions in a meeting.

  • The main usability testing methods are moderated (a facilitator runs the session live), unmoderated (users complete tasks on their own through a tool), guerrilla (quick informal tests with whoever's nearby), remote (run over video or a testing tool), and in-person (everyone in the same room). Most teams mix them — a few moderated sessions to understand the why, then unmoderated tests to confirm the pattern at scale.

  • Around five users per round is the working number for most qualitative tests. The Nielsen Norman Group's well-known finding is that roughly five users surface about 85% of the usability problems in a given flow, and you get more value from running several small rounds than one large one. If you're testing very different user groups or chasing statistical numbers rather than problems, you'll want more — but for finding what's broken, five is enough to start fixing.

  • In moderated testing a facilitator runs the session live, asks follow-up questions, and probes the reasons behind what they see. In unmoderated testing users work through tasks alone using a tool, and you review the recordings afterward. Moderated tells you why something happened and is better for early, rough designs; unmoderated is faster, cheaper, and easier to run at scale once you know which tasks to check.

  • Run a usability test in six steps: set a clear goal, write realistic tasks tied to that goal, recruit five or so people who match your real users, run the sessions while staying quiet and observing, analyze the recordings to spot recurring friction, then turn the findings into prioritized design fixes. The discipline that matters most is writing neutral tasks and resisting the urge to help people while they struggle.