//pragmatic leaders

User Research Methods

Reading time
8 min
Section
PM Foundations (Legacy)
8 min left0%
user research methods0%
8 min left
Great product managers observe what users do, not just what they say. User research is critical — but it must be done with the right methods, at the right time.
Talvinder Singh, from a Pragmatic Leaders session on user research

User research is the foundation of effective product management decision-making. The actual job is to understand your users’ needs, pain points, and behaviors so you can build products that deliver real value. But user research is not a monolith — it is a landscape of methods, each suited to different questions, contexts, and stages of product development.

The trap is treating user research as a checkbox or a single method. You don’t do “user research” — you do the right user research. This lesson teaches you how to navigate that landscape with practical frameworks grounded in Indian product realities.

The stakes: why user research matters more than ever

Henry Ford supposedly said, “If I’d asked customers what they wanted, they would have said a faster horse.” Steve Jobs famously said, “It’s really hard to design products by focus groups. A lot of times, people don’t know what they want until you show it to them.” These quotes have sown confusion among new PMs — is user research important or just a distraction?

Let me be direct about this: experienced product teams value user research deeply, as they should. The problem is misunderstanding what user research is and how to do it well. In India’s diverse markets, user needs vary widely even within the same demographic. Use cases evolve quickly. Without good research, you build what you think users want — not what they actually need.

User development is the first phase in a new product or feature lifecycle. It informs product definition, implementation, launch, and evaluation. The range of user research methods is broad — you must pick the right ones depending on your goals and constraints.

The three key dimensions of user research methods

User research methods fall along three dimensions:

  • Attitudinal vs Behavioral: Do you ask users what they say or observe what they actually do?
  • Qualitative vs Quantitative: Do you collect rich, direct feedback or large-scale numerical data?
  • Context of use: Are users studied in natural settings, scripted labs, or without using the product at all?

Attitudinal vs Behavioral: What users say vs what users do

Often “what people say” is very different from “what people do.” Attitudinal methods capture user beliefs, desires, and self-reported reasons for their actions. Behavioral methods observe actual user actions and underlying motivations.

Attitudinal research is often used by marketing teams because it reflects how users want to be perceived. For example, a user might say price is the main factor for choosing a product, but their behavior might show they prioritize convenience. This bias is one of the biggest challenges of attitudinal methods.

In attitudinal methods, users self-report their inclinations — for example, through surveys or interviews. The human psyche wants to appear rational and admirable, so users may mask true motivations.

Behavioral methods focus on what users actually do and why. They ignore what users say and instead reveal real pain points and habits. The famous Ford “faster horse” quote illustrates this: users said “horse,” but the real behavioral need was “fast transportation.” Great PMs see beyond stated preferences to underlying needs.

Steve Jobs was right in that users often do not know what they want until shown. The key is to observe behavior, not just listen to words. Product managers benefit heavily from behavioral methods but should not dismiss attitudinal methods entirely. For example, card sorting reveals users’ mental models for information, and surveys help categorize attitudes.

Qualitative vs Quantitative: Rich insights vs scale

Qualitative research involves direct study of user attitudes and behaviors through interviews, usability studies, and field observations. It provides depth and context but is hard to scale or quantify.

Quantitative research collects indirect data through surveys, analytics, A/B testing, and telemetry. It provides numbers and statistical power but often lacks nuance.

Qualitative methods answer “why” and “how to fix” problems. Quantitative methods answer “how many” and “how much.” Both are necessary. Quantitative data is easier to communicate to product teams and engineers, who gravitate toward numbers. But qualitative data provides the voice and spirit behind those numbers.

Context of use: Natural, scripted, or de-contextualized

User research can happen in:

  • Natural use: Users interact with the product in their real environment with minimal interference. This has high validity but less control.
  • Scripted use: Users perform predefined tasks in controlled settings, like labs or remote moderated sessions. This provides precise data but less ecological validity.
  • Not using product: Studies focus on brand perception, attitudes, or hypothetical concepts without product interaction.

Hybrid methods combine these approaches as needed. For example, participatory design lets users rearrange design elements to express preferences.

A landscape of user research methods

Here is a broad overview of common user research methods categorized by behavioral vs attitudinal and qualitative vs quantitative:

MethodBehavioral / AttitudinalQualitative / QuantitativeContext of UseTypical Phase / Goal
EyetrackingBehavioralQualitativeScripted / NaturalExecute / Assess usability
Clickstream AnalysisBehavioralQuantitativeNaturalAssess / Optimize
A/B TestingBehavioralQuantitativeNatural / ScriptedAssess / Optimize
Usability Lab StudiesBehavioralQualitativeScriptedExecute / Assess usability
Moderated Remote UsabilityBehavioralQualitativeScriptedExecute / Assess usability
Unmoderated UX StudiesBehavioralQualitative / QuantitativeScriptedExecute / Assess usability
Ethnographic Field StudiesBehavioralQualitativeNaturalStrategize / Execute
True Intent StudiesBehavioralQuantitativeNaturalAssess
SurveysAttitudinalQuantitativeNatural / De-contextualizedStrategize / Assess
InterviewsAttitudinalQualitativeNatural / De-contextualizedStrategize / Execute
Focus GroupsAttitudinalQualitativeDe-contextualizedStrategize
Card SortingAttitudinalQualitative / QuantitativeNatural / ScriptedStrategize / Design
Participatory DesignAttitudinalQualitativeNatural / HybridStrategize / Design
Diary / Camera StudiesAttitudinalQualitativeNaturalStrategize / Execute
Customer FeedbackAttitudinalQualitative / QuantitativeNaturalAssess
Desirability StudiesAttitudinalQualitativeNatural / HybridDesign
Intercept SurveysAttitudinalQuantitativeNaturalAssess
Email SurveysAttitudinalQuantitativeDe-contextualizedAssess
Use CasesAttitudinalQualitativeDe-contextualizedDesign
Task AnalysisBehavioralQualitativeNatural / ScriptedStrategize
System Usability ScaleBehavioralQuantitativeScriptedAssess

This is not an exhaustive list but covers the major methods you will encounter. Each has trade-offs in cost, speed, depth, and validity.

How to choose the right method for your phase and goal

Product development phases and their research goals:

PhaseGoalTypical Methods
StrategizeExplore new ideas, understand users deeplyEthnographic field studies, interviews, surveys, diary studies, concept testing
ExecuteValidate designs, reduce risk, improve usabilityUsability lab studies, moderated remote testing, participatory design, card sorting
AssessMeasure product performance, compare to competitorsA/B testing, clickstream analysis, SUS, intercept surveys

Qualitative methods dominate Strategize and Execute phases — they provide rich feedback to inform decisions.

Quantitative methods dominate Assess phase — they provide measurable data to track progress and prioritize.

Indian startups especially must choose methods that balance depth and speed. For example, deep interviews and lean surveys can yield actionable insights quickly without large budgets.

The user research process: five stages

User research is a process, not one-off activity:

  1. Objectives: Set clear goals for what you want to learn. What questions need answers? How much data do you need? What decisions will this research inform?

  2. Hypothesis: Review what you already know. What assumptions must be true for your product to succeed? Formulate hypotheses to test.

  3. Methods: Choose research methods that best achieve your objectives within constraints. Consider attitudinal vs behavioral, qualitative vs quantitative, and context.

  4. Conduct: Recruit appropriate users and run the research. Take detailed notes or record sessions. Be unbiased in questioning.

  5. Synthesis: Analyze and interpret data. Did you validate or invalidate hypotheses? What unexpected insights emerged? Make findings actionable.

The main point is to gain data that defines your next step.

From the field: user research in Indian startups

Meeting scene: deciding research methods under pressure

// scene:

Sprint planning meeting at a Series A SaaS startup in Bangalore

CEO: “We need to launch the new onboarding flow in two weeks. Can we do user research?”

You (PM): “We can do rapid, lean user interviews with 8-10 users this week to validate the flow and catch major issues.”

Engineering Lead: “Is that enough? Should we run surveys or usability tests?”

You (PM): “Surveys are broad but shallow. Usability tests take time. Given timeline, interviews give us depth and speed.”

CEO: “Okay. Let’s prioritize interviews, but also instrument analytics to track drop-off.”

The team balanced speed and rigor — a pragmatic approach common in Indian startups.

// tension:

Balancing research depth with rapid delivery

Slack chat: debating attitudinal vs behavioral methods

// thread: #product-team — Choosing user research methods
Priya (UX)I think surveys will tell us what users want.
Rahul (PM)Surveys show what users say. We need to see what they actually do, so I want to run some usability tests.
Meera (Data)Clickstream analytics can show us behavior at scale, but no context.
Priya (UX)True, but behavioral methods are expensive and slow.
Rahul (PM)We need a mix. Qualitative interviews for insights, quantitative data for validation.
Meera (Data)Agreed. Data without stories is meaningless.

Field exercise: plan your user research

// exercise: · 20 min
Design a user research plan for your product idea
  1. Define your research objectives. What are the top 3 questions you need answered?
  2. Identify your user personas and recruitment criteria.
  3. Choose 2-3 research methods suited to your objectives and constraints.
  4. Outline your plan: method, sample size, timeline, and deliverables.
  5. Consider how you will synthesize and share findings with your team.

Judgment exercise

// learn the judgment

You are PM at a Bangalore-based fintech startup preparing to launch a new payments feature. The CEO wants fast validation and suggests running an online survey with 500 users immediately. Your UX lead suggests moderated usability tests but they require 3 weeks. Engineering wants to instrument analytics instead for behavioral data.

The call: Which user research methods do you prioritize to validate the feature before launch, and why?

Your reasoning:

Practice exercise

// practice

You are PM at a Bangalore-based fintech startup preparing to launch a new payments feature. The CEO wants fast validation and suggests running an online survey with 500 users immediately. Your UX lead suggests moderated usability tests but they require 3 weeks. Engineering wants to instrument analytics instead for behavioral data.

Your task: Which user research methods do you prioritize to validate the feature before launch, and why?

your reasoning:

0 chars (min 80)

Where to go next