“We used uh Stat Sig at Grammarly and I saw that they recently got acquired.”
Statsig
By Vijaye Raji
2 recommend/use · 3 sourced episodes
Every sourced reference
Short attributed excerpts only. Timestamps are approximate.
“Do you have thoughts on what stats sig going to do at OpenAI?”
“We use this tool. I'm going to give a shout out to to Stat Sig because they're awesome.”
Related frameworks
Cohort-and-Control Data Reading
Never trust pre/post dashboards — read behavior by cohort and judge changes by variant-vs-control so the macro can't fool you.
Connect-Users-to-Value Journey Staffing
Growth's job is to connect users to your product's value — so staff teams around each stage of the user journey.
Error Analysis: Open Coding to Axial Coding to Count
Turn messy LLM logs into a prioritized list of failures before you write a single test.
Eval Triage: Decide What Actually Deserves an Eval
After counting failures, route each one to a prompt fix, a code check, or an LLM judge — not all three.
Existing-User Retention & Resurrection Priority
As a consumer subscription matures, the biggest lever isn't new users — it's current-user retention and resurrecting the dormant.
Explore & Exploit at the Insight Level
Oscillate between finding the right mountain and climbing it — but do it insight by insight, not just at strategy level.
Full-Value Free Sampling (Reverse Free Trial)
Make your free product a live, rationed taste of everything paid can do — not a walled-off basic tier.
Gamification's Three Pillars: Core Loop, Metagame, Profile
Durable habit-forming products stand on three legs: a tight core loop, a long-horizon metagame, and an accumulating profile.
Hypothesis-to-Data Over Strategy
For most PMs, strategy is overrated — your real job is to shrink the time from hypothesis to data.
Lean-Into-Organic-Sharing Virality
Don't manufacture virality — instrument where users already share, then make those exact moments 5-10x more delightful.
Naturally Hedged Product Portfolio
Build products that make money in opposite macro conditions so troughs in one are peaks in another.
Running Products via the Daily Meeting
Assign one owner to an urgent problem, give them unlimited resources except time, and force a daily report until it's solved.
Slow vs Fast Decisions
For any reversible decision there's no right or wrong — only slow and fast — so decide fast and correct fast.
The 1,000-Experiments 'What Would Need To Be True' Goal
Set an audacious experiment-volume goal — not to hit it, but to force the conversations that unlock a whole experimentation culture.
The 10x Leverage Desk
Spend your finite time only on problems with 10x positive or negative impact — and physically move yourself into the details until they're solved.
The Aligned Binary LLM-as-Judge
Build a one-failure, pass/fail judge and align it to a human with a confusion matrix before you trust it.
The Benevolent Dictator Labeling Model
Appoint one trusted domain expert to own eval judgments instead of running it by committee.
The Cold-Pattern Positivity Flip
Find the moments where users feel bad, and flip the product to reinforce progress instead of failure.
The Four Filters for Career Acceleration
Growth rate, strength-fit, deferred comp, and the C-suite question — pick jobs on these, not on salary.
The Superpower Overlap Test
Find your true strengths via a two-layer self-plus-peer assessment, then only take roles where your superpower meets the company's.
People in these episodes
Related resources
- Adolescence
- AI Evals for Engineers and Product Managers
- Airbnb
- AlphaGo
- Anthropic
- Apple in China
- Bangalore
- Bangkok
- Barcelona
- Bible Chat
- Booking.com
- Braintrust
- Breville Barista Express
- ChatGPT
- Chime
- Chrome
- Claude
- Claude Code
- Codex
- Cursor
- Discord
- Dropbox
- dscout
- Dubai
- Duolingo
- ElevenLabs
- Figma
- Figma Make
- Fin
- Frozen
- Gemini
- GitHub Copilot
- Gmail
- Google Hangouts
- Google Meet
- Google Sheets
- Grammarly
- Granola
- House
- Intercom
- Intercom Fin
- Julius AI
- Jupyter Notebook
- Lenny's Newsletter
- Lenny's Podcast
- Lennybot
- Let My People Go Surfing
- Linear
- London
- Lovable
- Machine Learning
- Maven
- Mercury
- Microsoft
- N26
- Notion
- Nurture Boss
- Ogilvy on Advertising
- OpenAI
- Palantir
- Paragon
- PayPal
- Perplexity
- Phoenix
- Reforge
- Revolut
- Singapore
- Slack
- Stripe
- Suno
- Superhuman
- The 5 Types of Wealth
- The Big Bang Theory
- The White Lotus
- The Wire
- Twitch
- v0
- Vanta
- West Coast of the United States
- Writer
- YouTube
Spot an error or want this page removed? Request a correction or removal.