LLenny's Podcast
← All episodes
Albert Cheng (Duolingo, Grammarly, Chess.com)05 October 2025

How to find hidden growth opportunities in your product

8Frameworks
15Insights

Episode overview

Albert Cheng explains growth as connecting users to a product’s value and presents an explore-and-exploit framework for finding, scaling, and eventually refreshing promising growth insights. Drawing on Duolingo, Grammarly, and Chess.com, he discusses retention, freemium monetization, experimentation systems, brand and community, habit formation, and AI-assisted analytics and prototyping. He also argues that high-agency teams learn faster and recounts how Chariot Direct failed because it began with a solution, neglected operational stakeholders, and attracted publicity before validation.

Key ideas

  • Growth should connect users to product value across their full journey, rather than optimize isolated metrics through friction or paywalls.
  • Teams should explore broadly for meaningful insights, exploit validated patterns across adjacent surfaces, and return to exploration as results saturate.
  • Chess.com increased game reviews and subscriptions by reframing post-loss feedback around brilliant moves, encouragement, and continued learning.
  • Grammarly nearly doubled upgrades by letting free users sample a limited mix of premium suggestions within their normal writing experience.
  • Retention is the foundation of consumer subscriptions; mature products should improve existing-user stickiness and design deliberately for resurrected users.
  • AI can shorten growth cycles through text-to-SQL analysis, experiment summarization, ideation, and rapid prototypes, but tools still need smoother production workflows.
  • Experiment velocity requires leadership support, trustworthy instrumentation, shared learnings, configurable surfaces, and participation beyond product and engineering.
  • High agency, clock speed, energy, and a beginner’s mind can matter more than narrowly matched prior experience, especially as AI changes established workflows.

Transcript available · source text is retained privately and is not published

Frameworks in this episode

People & resources mentioned

Attributed to the moment in the episode. Timestamps are approximate.

People · 11

  • Albert ChengMentionsHe led growth and monetization at three of the most successful and beloved consumer products in the world.

    Today, my guest is Albert Chen. Albert is known as one of the top consumer growth minds in the world.

  • Lenny RachitskyMentionstoday we've got another very special compilation episode something I've been pulling on more and more with the podcast and the newsletter

    Thanks for having me, Lenny. Excited to be here.

  • Nick TurleyMentionshead of ChachiPT, Nick Turley was like almost going to become professional jazz pianist.

    For example, head of ChachiPT, Nick Turley was like almost going to become professional jazz pianist.

  • Brian BalfourMentionsI actually was recently listening to another podcast by Adam Fishman and he had Brian Balfour on

    the original inventor of it might be Brian Balffor who I know has been on your pod.

  • Noam LovinskyMentionsNoam is currently chief product officer at Grammarly. Previously, he was an early PM at YouTube, where he spent 5 years

    Nome Leavinski who is chief product officer at Grammarly, you worked with him for a while while you were at Grammarly.

  • Shishir MehrotraMentionsshashir marocha is the co-founder and ceo of koda before starting koda shashir led the youtube product engineering and design teams

    if you hear like Shashir, their new CEO talk about like the AI superighway and all that type of stuff

  • Garry KasparovMentionsbeat the the world champion back then which was Gary Kasparov.

    beat the the world champion back then which was Gary Kasparov.

  • Magnus CarlsenMentionswatching him I think he was like number one in speed chess in addition to just regular chess

    A top grandmaster like Magnus Carlson is like a 2,800 and then Stockfish and similar engines are like 3600.

  • Eric AllebestMentionsthe CEO and co-founders like Eric and Danny.

    definitely a lot of credit to the the CEO and co-founders like Eric and Danny. They're amazing.

  • Jackson ShuttleworthMentionstoday my guest is Jackson shettleworth Jackson is a group product manager at dualingo leading the retention team

    you had Jackson on the podcast, right? Who you talking about this streak?

  • David OgilvyCoinedmentioned

    a book that I recommended recently at work is uh Oulvie on advertising.

Resources · 34

  • YouTubeMentionswebsite · Google

    Earlier in his career at YouTube, he worked on streaming and gaming features used by over 20 million people.

  • DuolingoMentionssoftware · Luis von Ahn and Severin Hacker

    He led growth and monetization at three of the most successful and beloved consumer products in the world. Dualingo, Grammarly, and now chess.com.

  • Lenny's NewsletterCoinednewsletter · Lenny Rachitsky

    if you become an annual subscriber of my newsletter, you get 15 incredible products for free for an entire year

  • Lenny's PodcastCoinedpodcast · Lenny Rachitsky

    My podcast guests and I love talking about craft and taste and agency and product market fit.

  • ReforgeUsescompany · Brian Balfour

    I think he actually had taken some Reforge classes.

  • Game ReviewMentionsproduct · Chess.com

    The most used learning feature in our product is called game review.

  • Chess.comMentionscompany

    So I work at chess.com and um one of our priorities is to encourage chess players to improve to learn and improve.

  • SlackUsessoftware · Slack Technologies

    we have this data request Slack channel where for the longest time

  • LovableUsessoftware · Lovable

    building like essentially AI prototypes of those using tools like a vzero or like a lovable

  • Claude CodeUsessoftware · Anthropic

    the engineers are using a a combination of tools right now. Um so cursor, cloud code, GitHub, copilot.

  • v0Usessoftware · Vercel

    The PMs are mostly using Vzero.

  • Figma MakeUsessoftware · Figma

    The designers love Figma, so they're using Figma make.

  • CursorUsessoftware · Anysphere

    the engineers are using a a combination of tools right now. Um so cursor, cloud code, GitHub, copilot.

  • GitHub CopilotUsessoftware · GitHub

    the engineers are using a a combination of tools right now. Um so cursor, cloud code, GitHub, copilot.

  • Intercom FinUsessoftware · Intercom

    Customer support uses intercom fin.

  • GrammarlyMentionscompany · Grammarly

    Grammarly is an AI powered writing assistant.

  • The Green MachineMentionswebsite · Duolingo

    They tend to they actually wrote a playbook about this. It's called the green machine.

  • TwitchMentionscompany

    you had a lot of like YouTube and Twitch streamers, you had a bunch of kids playing it in school

  • The Queen's GambitMentionstv show

    You had the pandemic, you had Queen's Gambit, you had a lot of like YouTube and Twitch streamers

  • IBM Deep BlueMentionssoftware · IBM

    you had IBM, they had their deep blue application who actually um beat the the world champion back then

  • StockfishMentionssoftware

    there's engines like Stockfish these days that are just dramatically better than the top grand masters in the world.

  • AlphaGoRecommendssoftware · DeepMind

    the documentary is incredible. By the way, I don't know if you've watched Alpha Go.

  • AlphaZeroMentionssoftware · DeepMind

    Alpha Zero famous for beating the top Go player. I imagine that all is that was that trained specifically for Go?

  • ChatGPTUsessoftware · OpenAI

    even tools like chatbt are super helpful, right? You can just plug in like a an analysis that another person wrote

  • Atlassian State of Product ReportMentionspaper · Atlassian

    I just read this Alassian uh state of product report and it was like 40% of product teams like basically don't run experimentation at all.

  • StatsigUsessoftware · Vijaye Raji

    We used uh Stat Sig at Grammarly and I saw that they recently got acquired.

  • ChariotMentionscompany

    I worked for this startup called Chariot.

  • Chariot DirectMentionsproduct · Chariot

    we tried this we called the chariot directly interesting attempt but I learned a lot of lessons there because ultimately it didn't work out.

  • AirbnbMentionscompany · Brian Chesky, Joe Gebbia, and Nathan Blecharczyk

    When I left Airbnb, I was just like and and that was the first time I ever took a break in my career

  • What I Learned at AirbnbCoinedother · Lenny Rachitsky

    And that led me to writing this Medium post that did really well what I learned at Airbnb.

  • Ogilvy on AdvertisingRecommendsbook · David Ogilvy

    a book that I recommended recently at work is uh Oulvie on advertising.

  • Dark SquaresCoinedbook · Danny Rensch

    he's releasing a memoir called Dark Squares and it is super fascinating.

  • Breville Barista ExpressUsesproduct · Breville

    my favorite product is uh is the Breville Bowl uh barista and it just starts my day off right.

  • Let My People Go SurfingMentionsbook · Yvon Chouinard

    at Patagonia, uh there's a famous book the founder wrote called Let My People Go Surfing.

Spot an error or want something removed? Request a correction or removal.

Insights & moments

The myth-busts, hot takes, explainers, and tools worth keeping.

Hot Take· 2

Hot Take41:30

Brand vs Growth Is Wrong. It's Rocket Fuel.

Albert admits he used to see viral brand marketing (Duo the Owl, TikTok, mascots) as opposed to data-driven growth experimentation. Watching Duolingo, he changed his mind: the personality built through product and push notifications feeds the marketing team's memes, and on some days those channels drove 20-30% of new users. Chess.com reinforced it, with pandemic and Queen's Gambit waves quadrupling registrations overnight.

  • Brand marketing and growth experimentation combine rather than compete
  • Duo the Owl's personality, built in-product, fueled TikTok/YouTube marketing
  • Attribution showed those channels driving 20-30% of new users on some days
  • Steady experimentation plus occasional big cultural waves compound
  • Chess.com saw registrations quadruple overnight during big waves

I used to think it was versus, but now I realize that they combine really well. It could be rocket fuel for for your growth.

Albert Chen · 42:00
#brand#marketing#growth#virality
Hot Take1:08:00

Hire for Agency, Not Experience (Experience Can Be a Crutch)

The default hiring path fills a JD by poaching from similar companies. But Albert's highest performers were high-agency people with clock speed and energy who didn't necessarily have deep domain experience. In a world shifting fast with AI, learned habits often need to be intentionally discarded, so speed of learning beats experience, and much of that signal shows up outside the formal interview.

  • Top performers had high agency, clock speed, and energy over deep experience
  • Experience can be a crutch, especially as AI shifts the ground fast
  • Learned habits often need to be intentionally discarded; keep a beginner's mind
  • Bet on the fastest speed of learning
  • Agency signals appear outside the interview: questions asked, references, energy, whether they went deep on your product

sometimes that experience could be a crutch in certain ways.

Albert Chen · 1:08:30

a lot of your like learn habits actually need to be intentionally discarded.

Albert Chen · 1:08:30
#hiring#teams#agency#leadership

Explainer· 4

Explainer28:30

Why Retention Is Gold (And the D1 Benchmark to Aim For)

For consumer subscription products, retention is what makes the model work; without it, all the pressure falls on getting users to pay on day one, which is brutal. Albert gives a rough benchmark: a D1 retention around 30-40% is solid for a consumer app. Below that, he questions whether you can mathematically acquire enough users to build a large daily active base.

  • Weak retention forces you into aggressive day-one monetization
  • D1 retention around 30-40% is a solid mark for a consumer app
  • Much lower D1 raises doubts about user intent and DAU-base math
  • Retention is the margin that lets scrappy consumer products survive

user retention is gold for consumer subscription companies.

Albert Chen · 28:30

I think when you have your D1 retention somewhere around like the 30 or 40% mark, like that's quite solid, I think, for for a…

Albert Chen · 29:30
#retention#consumer-subscription#metrics#benchmarks
Explainer34:30

How Duolingo, Grammarly, and Chess.com Actually Differ

Albert contrasts the three products he grew. Duolingo runs on a rigid, template-driven 'green machine' where the experience changes multiple times a day per user. Grammarly evolved into a product-led-sales/B2B motion where the core product team (not growth) most drives repeat usage. Chess.com is defined by fanatical, chess-obsessed staff who dogfood the product constantly.

  • Duolingo: highly structured process, product changes multiple times/day per user
  • Grammarly: product-led sales, core product team drives current-user retention
  • Chess.com: staff are fanatical chess players who constantly dogfood
  • There's no single right way; all three succeed very differently
  • At Grammarly, Albert realized growth was 'getting in the way' of the core product team and handed the metric over

The product experience of Dualingo actually like changes multiple times per day for each user which is pretty shocking.

Albert Chen · 35:30
#growth#company-culture#duolingo#grammarly
Explainer47:00

Why Chess Engines Crush LLMs (and Grandmasters)

Albert explains that chess engines like Stockfish are dramatically stronger than any human, calculating tens of millions of positions per second. On the ELO scale, a top grandmaster like Magnus Carlsen is ~2,800 while engines sit around 3,600, so strong an engine could give up a rook and still compete. LLMs, by contrast, are bad at chess because they hallucinate moves and can't go deep on a specific line.

  • Chess engines are dramatically better than the top grandmasters in the world
  • Magnus Carlsen ~2,800 ELO vs Stockfish-class engines ~3,600
  • An engine could play down a rook and still be competitive with the best
  • LLMs are bad at chess: they hallucinate moves and can't reason deeply on lines
  • Chess and AI have been intertwined since Deep Blue beat Kasparov in 1997

A top grandmaster like Magnus Carlson is like a 2,800 and then Stockfish and similar engines are like 3600.

Albert Chen · 47:30

interestingly, LM themselves are quite bad at playing chess. Like, they hallucinate moves.

Albert Chen · 49:30
#ai#chess#llms#engines
Explainer1:05:30

Why New Chess Players Are So Hard to Retain

Over 75% of chess.com's new users self-identify as complete beginners, and beginners have a rough first experience: fewer than a third win their first live game. Since losing a game retains 10% worse than winning, and you can't simplify chess's rules, the team crafts gentler onboarding, like a delightful learn-to-play flow and hiding your rating for the first five games.

  • Over 75% of new users classify themselves as new or beginner
  • Fewer than a third of those users win their first game
  • Losing a game retains 10% worse than winning
  • You can't simplify chess's rules like a casual mobile game
  • Fixes: a gentler learn-to-play flow and hiding rating for the first five games

over 75% of our new users, they classify themselves as like, I'm completely new to chess or I'm a beginner.

Albert Chen · 1:06:00

when you lose a game, user retention is 10% worse than when you win a game.

Albert Chen · 1:06:00
#onboarding#retention#chess#product

Story· 6

Story11:00

The Chess.com Positivity Flip That Grew Reviews 25%

Chess.com found that 80% of players review a game after a win, not a loss, which contradicted the feature's original design assumption. So they flipped the post-loss experience to surface brilliant moves and encouraging coach messages instead of blunders. That single change grew game reviews 25%, subscriptions 20%, and lifted retention significantly.

  • 80% of people who review their games do so after a win, not a loss
  • The team originally assumed players wanted to study their mistakes
  • After a loss, they now show best moves and encouraging coach copy
  • Result: +25% game reviews, +20% subscriptions, large retention lift
  • The insight was then spread to adjacent teams (puzzles, etc.) to compound

what he observes is that 80% of people that review their games actually do so after a win

Albert Chen · 11:30

That change alone was pretty dramatic for us. It grew game reviews by 25%, subscriptions by 20%, user retention by a lot as well.

Albert Chen · 12:00
#growth#retention#product#chess
Story23:00

The Grammarly Move That Nearly Doubled Upgrades

Most free Grammarly users experienced it as a spelling-and-grammar fixer because those were the only free suggestions shown. The team interspersed a limited taste of paid suggestions (tone, clarity, rewrites) directly into free users' writing. Despite fears of giving too much away, upgrade rates nearly doubled because users suddenly saw Grammarly as far more powerful.

  • Free users only saw correctness suggestions, so they undervalued the product
  • They sampled paid suggestions intermingled into free users' writing in real time
  • Concern that giving features away would kill conversion proved false
  • Upgrade rates nearly doubled from the change
  • Lesson: make your free product a reflection of everything the product can do

all of a sudden people were seeing Gramly as a much more powerful tool than they were before and our upgrade rates like nearly doubled…

Albert Chen · 24:00

It's basically like a reverse free trial but in real time like while you're writing as opposed to a time based one.

Albert Chen · 24:30
#monetization#freemium#grammarly#conversion
Story57:00

The 1,000-Experiments Goal He Openly Made Up

Chess.com went from practically zero experiments before 2023 to ~50, then ~250, with a target of 1,000 next year. Albert cheerfully admits he invented the number. The point isn't hitting it; a stretch goal forces the conversation about what would have to be true to get there, which surfaces the need to enable experimentation across lifecycle marketing, app store assets, and no-code screens.

  • Chess.com barely experimented before 2023; ~50 last year, ~250 this year, 1,000 target
  • Albert openly admits he made the 1,000 number up
  • A goal's value is forcing the 'what would need to be true' conversation
  • Hitting the number matters less than the capabilities it unlocks
  • Enables experiments in lifecycle marketing, app store assets, and no-code screens

Did I make it up? Yes, absolutely. I made it up.

Albert Chen · 58:00

The whole point of setting a goal is that you can have conversations about what would need to be true to actually hit that goal.

Albert Chen · 58:00
#experimentation#goals#growth#chess
Story1:01:30

The Experiment Tool That Had Retention Backwards

Albert warns that the experimentation system matters as much as any single experiment, and instrumentation is where it breaks. At one company, an in-house tool had user retention configured backwards for three months, so every positive result was actually negative. It's a cautionary tale for why you must instrument your product thoroughly before trusting results.

  • The system and instrumentation matter as much as any single experiment
  • One in-house tool had retention configured backwards for ~3 months
  • All 'positive' results were actually negative during that window
  • Bad instrumentation produces wonky, misleading experiment results

we realized that user retention was actually configured backwards. So all positive results were negative results.

Albert Chen · 1:02:00
#experimentation#instrumentation#data-quality#growth
Story1:02:30

How Duolingo Found Its Viral Moments With Screenshot Tracking

Rather than forcing virality, Duolingo added temporary screenshot tracking to discover where users were already organically sharing. Hotspots included streak milestones and funny challenges (not, say, advancing in the leaderboard top three). They then staffed those exact moments with illustrators and animators to make them far more delightful, driving 5-10x more sharing.

  • Virality is hard to manufacture; find where users already share
  • Temporary screenshot tracking revealed organic sharing hotspots
  • Streak milestones and funny challenges were highly shared; leaderboard climbs were not
  • They staffed those moments with illustrators/animators to amplify them
  • Leaning into existing behavior drove roughly 5-10x more sharing

we invested actually in some time to um essentially add screenshot tracking for like a brief period of time in the app

Albert Chen · 1:03:00

grab the moments where users are already organically screenshotting and make those much much much better

Albert Chen · 1:04:00
#virality#duolingo#growth#sharing
Story1:13:30

The Chariot Failure: A Solution Searching for a Problem

At the commuter-shuttle startup Chariot, Albert's team built 'Chariot Direct' to add Uber/Lyft-style dynamic routes onto fixed shuttle lines. It failed, teaching three lessons: it was a solution searching for a problem rather than a real user need; in a marketplace they over-focused on the rider app and neglected drivers and operations; and they ran PR before validating demand, which created sunk-cost pressure to see a doomed idea through.

  • 'Chariot Direct' added dynamic Uber/Lyft-style routing to fixed shuttle lines and failed
  • Lesson 1: don't chase 'wouldn't it be nice' ideas; start from a real user and problem
  • Lesson 2: in marketplaces, there's more than one end user; they neglected drivers and ops
  • Lesson 3: heavy PR before validation created costly sunk-cost momentum
  • The opposite failure mode of validating everything before telling anyone

this was kind of a solution searching for a problem.

Albert Chen · 1:15:00

doing it before you have validation that customers definitely want the thing is quite risky.

Albert Chen · 1:16:00
#failure#product#marketplace#validation

Tool· 1

Tool16:30

The Text-to-SQL Slack Bot That Answers Data Questions

Chess.com is building a Slack bot that takes ad-hoc data questions (e.g. subscribers in South Africa) and actually runs the analysis, not just generating a query. It replaces the slow loop of a data analyst prioritizing and running one-off requests. A side effect: because people are less embarrassed asking a bot, question volume explodes and the company becomes more data-informed.

  • A Slack bot performs the actual analysis via text-to-SQL, not just query generation
  • Removes the bottleneck of analysts triaging one-off ad-hoc questions
  • Lowers social friction so people ask questions they'd otherwise avoid
  • Result is a large increase in questions asked and a more data-informed company

if you have a question that you feel like, you know, you might be a bit embarrassed to ask or you don't want to bother…

Albert Chen · 17:30
#ai#analytics#data#tools

Takeaway· 2

Takeaway30:30

Mature Companies Grow by Resurrecting Dormant Users

As a company matures, the biggest retention lever shifts from new users to existing habitual users, whose retention compounds into a daily habit. Mature products also stack up hundreds of millions of dormant and sporadic users, so reactivated and resurrected users become as large a component as brand-new ones. It's worth designing a deliberate experience for resurrected users, as Duolingo does with social notifications and placement re-tests.

  • Existing-user retention compounds and builds the daily habit that matters most
  • For mature products, reactivated/resurrected users rival new users in volume
  • Dormant and sporadic users accumulate into hundreds of millions
  • Design a deliberate 'resurrected user' experience for strong ROI
  • Duolingo uses social push notifications and placement re-tests to bring users back

it's that retention rate that really compounds and build that builds that daily habit.

Albert Chen · 31:00

it's actually like pretty interesting that the components of your active user base are actually not heavily weighed in the new user set after you…

Albert Chen · 32:30
#retention#reactivation#growth#duolingo
Takeaway1:10:30

Everyone Has a Company Stage Where They Shine

Albert believes everyone has a company stage that fits them best. Having done big tech, tiny startups, and the middle, he landed in a medium-sized 'goldilocks zone': companies of ~500-1,000 people, typically 10-20 years old, durable and ideally profitable but still at key inflection points. It gives him both scale and the ability to execute on a daily/weekly rather than monthly/quarterly cadence.

  • Everyone has a company stage where they perform best
  • Big tech offers scale but moves slowly; tiny startups move fast but are grueling and unknown
  • His goldilocks zone: ~500-1,000 people, 10-20 years old, durable, ideally profitable
  • These companies are at inflection points, not stagnant
  • The sweet spot balances scale with a daily/weekly execution pace

I I definitely believe that everyone has a company stage that they shine best at.

Albert Chen · 1:11:00

these companies that we've talked about in the podcast are about 500 to a,000 people.

Albert Chen · 1:12:30
#career#company-stage#startups#growth