//pragmatic leaders

Frameworks

Reading time
6 min
Section
How to measure the success of your Product?
6 min left0%
frameworks0%
6 min left
You need a structure to measure what matters — not just data, but the right data that connects user happiness to business outcomes.
Talvinder Singh, from a Pragmatic Leaders session on product metrics and frameworks

Measuring product success is not about collecting every metric you can find. It is about choosing the right framework that connects user experience to business objectives. Without a clear framework, you end up with a confusing dashboard that tells you nothing actionable.

Two frameworks dominate the startup and product management world for good reason: HEART and Pirate Metrics (AARRR). Both come from world-class sources — Google Ventures and 500 Startups — and complement each other perfectly. Understanding how to apply them will transform how you think about product success.

The HEART framework: measuring user experience quality

Google Ventures introduced the HEART framework to measure the quality of user experience (UX). It focuses on the customer’s feelings and behaviors rather than just raw numbers. HEART stands for:

  • Happiness: How satisfied are users with your product? Do they find it easy to use? Are they likely to recommend it? This is a quantitative measure often captured by Net Promoter Score (NPS) or simple surveys.
  • Engagement: How frequently and intensely do users interact with your product? Tools like Google Analytics reveal metrics such as visits per session or searches per session.
  • Adoption: What percentage of users start using your product or a new feature after signing up? Adoption metrics show initial success in onboarding or feature uptake.
  • Retention: How many users come back after their first session? Retention is a key indicator of ongoing value and stickiness.
  • Task Success: How effectively can users complete the key tasks your product enables? You measure this via surveys asking about ease, error rates, and time taken.

Each of these dimensions answers a critical question about user experience. Together, they provide a balanced view of how your product performs from the user's perspective.

// thread: #product-metrics — Using HEART to diagnose product health
Neha (PM)Our NPS dropped from 45 to 38 last quarter. Should we be worried?
Rahul (Data Analyst)Let’s also check engagement metrics. Maybe users are happy but not using the core feature enough.
Neha (PM)Good call. Adoption of the new onboarding flow is up 20%, but retention after 7 days is flat.
Rahul (Data Analyst)Task success surveys show 15% error rate on checkout. That could explain churn.
Neha (PM)Looks like we need to fix usability issues to improve retention. HEART helps us pinpoint this.

How to apply HEART with GSM (Goals, Signals, Metrics)

HEART alone is not enough. You need to connect it to your product goals. Google Ventures pairs HEART with the GSM framework:

  • Goals: What are you trying to achieve? (e.g., increase user satisfaction)
  • Signals: What user behaviors indicate progress toward the goal? (e.g., positive survey responses)
  • Metrics: What specific measurements track these signals? (e.g., NPS score)

This combination lets you brainstorm relevant metrics quickly and ensures they align with your objectives.

// exercise: · 15 min
Apply HEART + GSM to your product

Choose a product or feature you own. For each HEART category:

  1. Define a clear goal (e.g., improve happiness).
  2. Identify the signals that show progress (e.g., survey ratings).
  3. Pick or propose specific metrics to track (e.g., NPS, session frequency).

Discuss your choices with a peer or mentor. Adjust based on feedback.

Pirate Metrics (AARRR): tracking the customer lifecycle

Dave McClure of 500 Startups proposed the Pirate Metrics framework, known by the acronym AARRR:

  • Acquisition: How do users find your product? (e.g., website visits, app installs)
  • Activation: When do users experience initial value? (e.g., signups, first successful transaction)
  • Retention: How many users return and keep using the product? (e.g., day-7 retention)
  • Revenue: How do users generate income for your business? (e.g., paid subscriptions)
  • Referral: How often do users bring others to your product? (e.g., invites, shares)

This framework focuses on the business side — the funnel that drives growth and revenue.

Pirate MetricObjectiveKey ResultKPIMetrics
AcquisitionIncrease user acquisition by 50%Grow organic traffic by 30%Traffic growth rate (%)Organic visits, new signups
ActivationValidate product-market fitLaunch MVP to 100 beta usersSignup-to-feedback ratio (%)Feedback count, beta signups
RetentionImprove user retentionAchieve 60% day-7 retentionDay-7 retention rate (%)Day-1 actives, Day-7 actives
RevenueIncrease revenueReduce cost per acquisitionCPAAcquisition costs, paying users
ReferralBoost referralsAdd 10,000 new users via referralReferral conversion rate (%)Referral signups, invites sent
// scene:

Growth team weekly review

Priya (Growth PM): “Our acquisition is up 25% this month, but retention is stuck at 20%.”

Karthik (Data Scientist): “Activation metrics show that 40% of new users never complete onboarding.”

Priya (Growth PM): “Let’s prioritize fixing onboarding flow to improve activation and retention.”

They used Pirate Metrics to identify the weakest funnel stage and focus their efforts accordingly.

// tension:

Growth stalled because activation was the bottleneck.

How HEART and Pirate Metrics complement each other

AspectPirate Metrics (AARRR)HEART Framework
FocusBusiness growth via customer funnelUser experience and product quality
PerspectiveLifecycle stages of customer journeyUser feelings and behaviors
ApplicationRevenue-driven startupsUX-focused product teams
Example metricsReferral rate, CPA, retention rateNPS, task success, engagement

Both frameworks are necessary. Pirate Metrics ensure your business grows sustainably. HEART ensures the product delivers value and satisfaction.

Common pitfalls when using frameworks

  • Collecting too much data without a framework: You get lost in vanity metrics that don’t move the needle.
  • Ignoring user experience metrics: Focusing only on revenue can hide usability issues that kill retention.
  • Applying frameworks rigidly: Adapt metrics to your product stage and context.
  • Not linking metrics to decisions: Metrics should inform prioritization and trade-offs.
// thread: #pm-discussion — Advice on focusing product metrics
Anjali (Junior PM)We track 50+ metrics, but I’m not sure which ones matter.
Meera (Senior PM)Start with frameworks like HEART and AARRR. Pick 3-5 key metrics that align with your current goals.
Anjali (Junior PM)Makes sense. Quality over quantity.

Integrating frameworks with OKRs for strategic growth

Metrics frameworks work best when tied to Objectives and Key Results (OKRs). For example, linking Pirate Metrics and HEART metrics to OKRs creates clarity:

ObjectiveKey ResultMetric
Increase user base by 50% in Q3Grow organic traffic by 30%Acquisition (visits, signups)
Validate product-market fit in Q2Achieve 60% day-7 retentionRetention rate
Improve user satisfaction in Q2Increase NPS from 40 to 50HEART - Happiness
Launch new feature with 80% adoptionFeature adoption rate above 80%HEART - Adoption

This alignment ensures that metrics are actionable and tied to business success.

Test yourself: Choosing the right framework for your product

// learn the judgment

You are the PM at a Series A edtech startup in Bangalore. The product is an app for live interactive classes. The CEO wants to measure success for a new feature that allows students to ask real-time questions during class.

The call: Which framework(s) would you apply to measure the success of this feature, and what specific metrics would you track?

Your reasoning:

// practice

You are the PM at a Series A edtech startup in Bangalore. The product is an app for live interactive classes. The CEO wants to measure success for a new feature that allows students to ask real-time questions during class.

Your task: Which framework(s) would you apply to measure the success of this feature, and what specific metrics would you track?

your reasoning:

0 chars (min 80)

Frameworks in practice: Indian startup examples

  • Swiggy tracks user engagement and retention closely to optimize order frequency and lifetime value, applying HEART principles.
  • Razorpay uses Pirate Metrics to monitor acquisition through developer signups, activation via API usage, and revenue from transaction fees.
  • Meesho combines both to balance rapid user growth with user satisfaction in their social commerce platform.

These companies continuously refine their metrics frameworks as they scale, ensuring they measure what truly matters.

Where to go next

PL alumni now work at Flipkart, Google, Razorpay, PhonePe, Swiggy, Amazon, Microsoft, and 30+ other companies.