//pragmatic leaders

User Research Methods

Reading time
7 min
Section
User Development - PLPM
7 min left0%
user research methods0%
7 min left
Often what people say is very different from what they do. Great product managers observe behavior, not just listen to words.
Talvinder Singh, from a Pragmatic Leaders session on user research methods

User research methods span a vast range of tools and techniques. The actual job is to pick the right combination for your problem — not to blindly apply every method or rely on a single one. Most insights require multiple perspectives to validate and enrich.

The trap is treating research as a checkbox exercise — one survey, one interview, done. That rarely works. You must balance attitudinal and behavioral data, qualitative and quantitative evidence, and consider how your users actually engage with your product.

Attitudinal versus behavioral methods reveal different truths

The most fundamental divide in user research methods is between attitudinal and behavioral approaches.

Attitudinal methods capture what people say — their beliefs, intentions, and self-reports. This includes surveys, interviews, focus groups, and card sorting exercises. People report their reasons for actions through the lens of their belief system, which is often aspirational or socially desirable rather than factual.

"Human psyche wants the self to be perceived in a greater form. Even if price drives a decision, a user may report quality as the reason to avoid being seen as cheap." — Talvinder Singh

These methods are valuable for understanding mental models, motivations, and perceptions. For example, card sorting helps uncover how users organize information mentally, guiding your product’s information architecture.

But attitudinal methods have limits. Users often do not or cannot accurately report their behavior. This is why marketing teams rely heavily on attitudinal data — they want to understand desires and beliefs.

Behavioral methods focus on what users actually do — their actions, patterns, and workflows. These methods minimize reliance on self-reporting and instead observe real user behavior. Examples include A/B testing, eyetracking, usability studies, and field observations.

Consider Henry Ford’s famous quote: "If I’d asked customers what they wanted, they would have said a faster horse." The behavioral insight is that users want speed and convenience, not necessarily the form factor they can articulate.

Great product managers spot these subtleties: the key is to observe behavior, not just listen to stated preferences.

Usability and field studies blend these approaches. They combine self-reports with direct observation to understand how users interact with products and why.

Qualitative and quantitative methods answer different questions

The next important dimension is qualitative versus quantitative research.

Qualitative methods involve direct study of attitudes and behaviors through interviews, observations, and open-ended feedback. These methods are exploratory and suited to answering why questions and uncovering unexpected insights.

"Qualitative data are the voice and the spirit — rich in sentiment and opinion that numbers alone can’t convey." — Talvinder Singh

Quantitative methods analyze numerically coded data, often collected at scale from surveys, analytics, or experiments. They answer how many or how much questions, helping prioritize issues by impact.

For example, a field study where a researcher observes users completing tasks is qualitative if the data is descriptive and interpretive. But analyzing server logs to measure feature usage frequency is quantitative.

Qualitative research excels at understanding root causes and designing fixes. Quantitative research excels at measuring the extent of problems and validating hypotheses.

Both are necessary. Quantitative data is easier to digest for engineering and product teams, but ignoring qualitative insights is like watching a movie without popcorn — you miss the full experience.

Visualizing qualitative data with sentiment score charts

One challenge with qualitative data is making it actionable and understandable, especially without a researcher to explain the findings.

Common but ineffective tools like word clouds have earned the nickname “the mullet of the internet” — flashy but low on real value.

A better approach is the Sentiment Score Chart, which quantifies and visualizes qualitative feedback by categorizing statements into positive and negative sentiments across product areas.

Creating a Sentiment Score Chart involves four steps:

  1. Transcription: Transcribe user feedback sessions verbatim. Avoid abridged notes to preserve nuance and enable detailed analysis.

  2. Categorization: Segment feedback into themes or product areas (e.g., navigation, visuals, layout). Assign polarity to each statement as positive or negative.

  3. Synthesis: Aggregate counts of positive and negative comments per category into tables.

  4. Visualization: Generate a polarized histogram (like a butterfly chart) showing the balance and volume of sentiments per category.

For example, a Sentiment Score Chart might reveal unanimous positive feedback on aesthetics but mixed or negative feedback on navigation and layout. This helps prioritize design improvements with precision.

Context of use shapes method choice

The third dimension is the context of use — how and whether users actually engage with the product during research.

Studies fall on a spectrum:

  • Natural or near-natural use: Observe behavior in real-world settings with minimal interference. Offers high validity but less control over topics. Ethnographic field studies and intercept surveys are examples.

  • Scripted use: Focus studies on specific tasks or flows, often in controlled environments. Benchmarking usability tests are tightly scripted to produce reliable metrics.

  • Not using the product: Some studies explore broader attitudes or cultural behaviors unrelated to direct product use, such as brand perception studies.

  • Hybrid methods: Combine elements, like participatory design where users rearrange design elements to express preferences.

Methods can shift along these axes even within the same study to satisfy multiple goals.

Matching research methods to product development phases

Choosing research methods also depends on your product development phase and objectives:

PhaseObjectiveTypical Methods
StrategizeExplore new ideas and opportunitiesEthnographic interviews, market research
ExecuteReduce execution risk, refine designUsability testing, prototype feedback
AssessMeasure performance and compare to benchmarksAnalytics, A/B testing, surveys

Your choice should align with what you need to learn at each stage.

Setting up and running user research

The research process typically follows these steps:

  1. Set a clear goal: Define the questions you want answered. Determine if you need large data volumes or just a few critical insights. Check if an existing hypothesis guides you.

  2. Review existing knowledge: Leverage what you already know about your users and product.

  3. Choose methods: Pick qualitative or quantitative approaches that best fit your goals and context.

  4. Conduct research: Select test subjects carefully and execute the research rigorously.

  5. Synthesize data: Analyze and make the data actionable. Ask: Did the research validate or invalidate your hypothesis? Did you learn unexpected things? What should be the next step?

This disciplined approach ensures your research drives real product decisions.

Indian context considerations

India’s diversity and market characteristics add complexity to user research:

  • Attitudinal responses can be especially aspirational or socially influenced. Users may hesitate to admit price sensitivity or usability frustrations.

  • Behavioral observation is critical to uncover real usage patterns across urban and rural segments, multiple languages, and varying literacy levels.

  • Low barrier to entry for surveys means quantitative data can be plentiful but noisy. Quality over quantity is key.

  • Field studies often reveal gaps in infrastructure or device capabilities that impact product adoption and UX.

Indian startups like Meesho and Swiggy have thrived by combining deep behavioral research with attitudinal insights to tailor their products effectively.

Practical user research methods overview

Here is a high-level map of common methods arranged by their attitudinal-behavioral and qualitative-quantitative dimensions:

MethodAttitudinal / BehavioralQualitative / QuantitativeTypical Use Case
SurveysAttitudinalQuantitativeMeasure attitudes or self-reported behaviors
InterviewsAttitudinalQualitativeExplore motivations, beliefs, mental models
Focus GroupsAttitudinalQualitativeGroup perceptions, brand feedback
Card SortingAttitudinalQualitativeUnderstand user mental models, info architecture
Usability TestingMixedQualitativeObserve task completion, identify pain points
Field StudiesMixedQualitativeUnderstand natural product use in context
A/B TestingBehavioralQuantitativeMeasure behavior changes due to design variants
EyetrackingBehavioralQuantitativeAnalyze visual attention and interaction
Clickstream AnalysisBehavioralQuantitativeAnalyze navigation patterns and usage metrics

No single method is sufficient on its own. Use combinations that cover multiple dimensions.

Field exercise: Map your user research methods

Time: 15 minutes

  1. List the key questions your product team currently has about your users.

  2. For each question, identify whether it is best answered by attitudinal or behavioral data.

  3. Choose one qualitative and one quantitative method that could provide insights.

  4. Sketch a research plan that combines these methods appropriately.

This exercise helps you intentionally design research that balances perspectives and data types.

Test yourself: Choosing the right method

// learn the judgment

You are a PM at a Series A fintech startup in Bangalore building a new savings app. User feedback shows confusion about the onboarding flow, but your analytics show high drop-off before completing KYC. You want to understand why users abandon and how to improve conversion.

The call: Which research method or combination would best help you uncover the root causes and design solutions?

Your reasoning:

Where to go next