LLenny's Podcast
← All episodes
Noah Weiss (Slack, Foursquare, Google)23 July 2023

The 10 traits of great PMs, how AI will impact your product, and Slack’s product development process

7Frameworks
14Insights

Episode overview

Slack CPO Noah Weiss explains the principles and operating rituals behind Slack's product development, including complaint storms, customer-love sprints, rapid prototyping, and pilot programs. He describes how Slack restored self-service growth by studying a new customer cohort, prioritizing learning, improving comprehension and desirability, and adopting “successful teams” as an activation metric. Weiss also discusses trustworthy AI product design, incubating zero-to-one bets, working with product-minded founders, and the traits that distinguish strong product managers at different career stages.

Key ideas

  • Great product managers combine impeccable execution, customer and business impact, data fluency, product taste, strong writing, and the ability to accelerate team decisions.
  • Product-minded founders work best with teams when vision and product principles are aligned early, teams receive room to explore, and founders re-engage during final refinement.
  • AI interfaces should match the reliability of their underlying data, disclose uncertainty and provenance, and create natural feedback loops that improve models through use.
  • Slack uses complaint storms to inspect customer journeys with fresh eyes and customer-love sprints to ship small, high-impact improvements quickly.
  • Zero-to-one teams need space to prototype rapidly, learn from users, run pilots, and pursue bigger bets before conventional planning and metrics dominate.
  • Slack revived self-service growth by sacrificing short-term impact for learning, redesigning the early customer journey, and identifying five regularly active teammates as a predictive activation threshold.
  • Roadmaps should be diversified portfolios balancing new capabilities with refinement, risky learning bets with known bets, and immediate impact with exploration.
  • As products expand beyond early adopters, diverse pilot customers provide stronger evidence of product-market fit than internal dogfooding alone.

Transcript available · source text is retained privately and is not published

Frameworks in this episode

People & resources mentioned

Attributed to the moment in the episode. Timestamps are approximate.

People · 16

  • Noah WeissMentionsNoah is Chief product officer at slack where he spent the last seven years

    today my guest is Noah Weiss Noah is Chief product officer at slack

  • Lenny RachitskyCoinedtoday we've got another very special compilation episode something I've been pulling on more and more with the podcast and the newsletter

    I actually built the startup on foursquares API it's a company called local mind

  • Dennis CrowleyMentionsDennis Crowley was the CEO and founder a very strong product minded founder

    Dennis Crowley was the CEO and founder a very strong product minded founder

  • Stewart ButterfieldMentionsStewart founded Flickr and then Slack, which he sold to Salesforce in one of the biggest acquisitions in tech history at the time.

    including Stuart Butterfield Dennis obviously we just talked about

  • Brian CheskyMentionsBrian chesky at Airbnb there was a whole article where we unpacked this moment in their product development cycle

    I'm sure at Airbnb I imagine Brian was very much like that as well

  • Gustav SöderströmMentionsGustav is a product legend and he's now the co-president, chief product, and chief technology officer at Spotify

    Gustav the CPO and CTO and co-president of Spotify

  • Seth GodinMentionsSeth is an absolute Legend he's published 21 books including 18 International bestsellers

    I was just listening to an interview with Seth Godin who's this you know marketing Legend

  • Paul GrahamMentionsPaul Graham talks about this too right just like live in the future and build it

    Paul Graham talks about this too right just like live in the future and build it

  • Sergey BrinMentionswhen I was at Google the thing I took away most from any review and Lariat survey

    when I was at Google the thing I took away most from any review and Lariat survey

  • Larry PageMentionswhen I was at Google the thing I took away most from any review and Lariat survey

    when I was at Google the thing I took away most from any review and Lariat survey

  • Ben HorowitzMentionsBen is the Z in A16Z, the world's largest venture capital firm with over $46 billion in committed capital.

    Ben Horowitz was a board member back at Foursquare

  • Stephen KingCoinedthere's a book called on writing by Stephen King

    there's a book called on writing by Stephen King which I recommend to literally everybody

  • Paige CostelloMentionsPaige is a product lead at Asana overseeing teams responsible for the core product experience of Asana

    I was just interviewing a product leader at Asana Paige Costello

  • Steve JobsMentionsSteve Jobs is just uh the bar he held for the company and for technical talent and for excellence was not uh wavering.

    some of the early like iPhone development games at Apple and working with two jobs there

  • Kim ScottCoinedI think radical Candor by Kim Scott is just incredible

    I think radical Candor by Kim Scott is just incredible and worth everyone reading

  • Doris Kearns GoodwinCoinedleadership in turbulent Times by Doris Goodwin who's a kind of presidential historian

    leadership in turbulent Times by Doris Goodwin who's a kind of presidential historian

Resources · 46

  • FoursquareMentionssoftware · Foursquare

    prior to that he was head of product at Foursquare

  • SlackMentionssoftware · Slack Technologies

    Noah is Chief product officer at slack where he spent the last seven years

  • Lenny's PodcastCoinedpodcast · Lenny Rachitsky

    welcome to Lenny's podcast where I interview world-class product leaders and growth experts

  • Fog Creek SoftwareMentionscompany · Joel Spolsky and Michael Pryor

    he was a PM at Google and at Fox Creek software

  • GoogleMentionscompany · Google

    prior to that he was a PM at Google

  • SidebarMentionscompany · Sidebar

    this episode is brought to you by sidebar

  • SuperhumanMentionssoftware · Superhuman

    this episode is brought to you by superhuman

  • LocalmindCoinedsoftware · Lenny Rachitsky and co-founders

    I actually built the startup on foursquares API it's a company called local mind

  • FoursquareUsessoftware · Foursquare

    I actually built the startup on foursquares API

  • AirbnbMentionscompany · Brian Chesky, Joe Gebbia, and Nathan Blecharczyk

    we ended up selling the company's Airbnb

  • InstagramMentionssoftware · Meta

    we got caught in the Death Star of Instagrams Ascent

  • FacebookMentionscompany · Meta

    they used the FourSquare API before they're about by Facebook

  • Google MapsMentionssoftware · Google

    they had you know billion plus Google Maps users distributed on Android and iOS

  • Google Knowledge GraphMentionssoftware · Google

    I was working at Google in search on what later became called the knowledge graph

  • ChatGPTMentionssoftware · OpenAI

    in the last six 12 months with llms and chat GPT and everything else

  • NetflixMentionscompany · Netflix

    the classic example that would be Netflix back I mean they have their reading system

  • SpotifyMentionssoftware · Spotify

    Gustav the CPO and CTO and co-president of Spotify

  • SlackUsessoftware · Slack Technologies

    if you work on figma or you work on slack you also live in the slack and you live in figma all day

  • FigmaUsessoftware · Figma

    if you work on figma or you work on slack you also live in the slack and you live in figma all day

  • StripeMentionscompany · Patrick Collison and John Collison

    similar to a process that I learned stripe has called friction logging

  • OracleMentionscompany · Oracle Corporation

    it's not like most people have worked at Oracle or sap

  • SAPMentionscompany · SAP

    it's not like most people have worked at Oracle or sap

  • HipChatUsessoftware · Atlassian

    early on slack was competing against this product called hipchat and that was actually what I used at our startup

  • DiscordMentionssoftware · Discord Inc.

    Discord feels like that was the big threat and now Microsoft teams obviously

  • CampfireUsessoftware · 37signals

    at Foursquare reused I think it was called campfire back in the day for the 37 singles people

  • Microsoft TeamsMentionssoftware · Microsoft

    I think Microsoft obviously has become over time the biggest competitor

  • ZoomMentionssoftware · Zoom Video Communications

    it's become much more of a video conferencing product that competes with like zoom and Google meet

  • Google MeetMentionssoftware · Google

    it's become much more of a video conferencing product that competes with like zoom and Google meet

  • Slack ClipsCoinedsoftware · Slack Technologies

    we did that with a lot of these kind of native audio visual products like huddles and clips

  • Slack HuddlesCoinedsoftware · Slack Technologies

    we did that with a lot of these kind of native audio visual products like huddles and clips

  • VantaMentionssoftware · Christina Cacioppo

    this episode is brought to you by vanta helping you streamline your security compliance

  • On WritingRecommendsbook · Stephen King

    there's a book called on writing by Stephen King which I recommend to literally everybody

  • Lenny's NewsletterCoinednewsletter · Lenny Rachitsky

    I do have a lot of guest posts in my newsletter

  • On Writing WellRecommendsbook · William Zinsser

    one is actually called on writing well

  • The War of ArtMentionsbook · Steven Pressfield

    the guy that wrote The Art of the war

  • Several Short Sentences About WritingRecommendsbook · Verlyn Klinkenborg

    recently I read one called several short sentences or something like that it's all about just writing short sentences

  • Nobody Wants to Read Your Sh*tRecommendsbook · Steven Pressfield

    another book that is amazing for writing better is nobody wants to read your by the guy that wrote The Art of the war

  • iPhoneMentionsproduct · Apple

    some of the early like iPhone development games at Apple

  • Radical CandorRecommendsbook · Kim Scott

    I think radical Candor by Kim Scott is just incredible and worth everyone reading

  • The Innovator's SolutionRecommendsbook · Clayton Christensen and Michael Raynor

    I still do think that an inner very solution follow-on are the best books on product strategy to read

  • Leadership in Turbulent TimesRecommendsbook · Doris Kearns Goodwin

    there's a book called leadership in turbulent Times by Doris Goodwin

  • SuccessionRecommendstv show · Jesse Armstrong

    the obvious answer which I'm sure many people would say would be succession

  • NanitRecommendsproduct · Nanit

    it's just like AI enabled camera for basically you know watching your baby as they sleep

  • SNOORecommendsproduct · Happiest Baby

    this new which is basically like this amazing device that can help to your kid

  • NanitUsesproduct · Nanit

    I have all three also a huge shout out to the Nana team who sent me a nanet

  • UPPAbabyRecommendscompany

    there's just something called up a baby that has this whole like elaborate stroller system with interchangeable parts

Spot an error or want something removed? Request a correction or removal.

Insights & moments

The myth-busts, hot takes, explainers, and tools worth keeping.

Hot Take· 4

Hot Take11:00

Why So Many Consumer Companies End Up Pivoting to B2B

Noah argues B2B is an easier path to an incremental, sustainable business than pure consumer. The reason is the feedback loop: whether people will pay is a far faster signal than trying to build enough consumer reach to later slap ads on it. Pure consumer is a swing-for-a-home-run bet where you don't know if it's working along the way.

  • Willingness-to-pay is a much faster signal than large-scale consumer reach
  • The ad-supported consumer path is a home-run bet with no signal along the way
  • B2B makes incremental, provable business-building easier
  • Both Foursquare and Slack are examples of the consumer-to-B2B arc

the feedback something that you get from are people willing to pay for the product that you're building is so much faster than can I…

Noah Weiss · 11:00
#b2b#business-model#monetization
Hot Take21:30

The UI Must Match the Data: LLMs Look Confident Even When Hallucinating

From 15 years of AI work at Google and Slack, Noah's guiding principle is that the confidence of the UI must match the quality of the underlying data. A key failing of current LLMs is that they appear supremely confident even when completely hallucinating, which erodes user trust. He argues for transparency about data sources and models that acknowledge uncertainty.

  • The promise of the UI has to match the quality of the underlying data
  • Current LLMs appear supremely confident even when completely hallucinating
  • Systems should acknowledge uncertainty rather than sound faultless
  • Transparency about where data comes from builds credibility
  • Design virtuous cycles so usage generates training data (like Netflix's feedback loop)

the promise of the UI has to match the quality of that underlying data

Noah Weiss · 21:30

they all appear supremely confident even when they're completely hallucinating

Noah Weiss · 21:30
#ai#llms#product-design#trust
Hot Take51:00

Product-Market Fit Is Stacking S-Curves, Not a One-Time Win

Responding to founders at billion-dollar companies who still feel they lack product-market fit, Noah frames PMF as stacking S-curves. You win a small group, hit exponential growth, then plateau as you saturate that audience, and must build fresh PMF for the next curve (non-developers, enterprises, non-US teams). It demands a beginner's mindset and self-criticism at each new audience.

  • PMF is not permanent; it's a series of stacked S-curves
  • Each curve grows exponentially, then declines as you hit that audience's ceiling
  • The next curve is a new audience with needs the previous one didn't have
  • Requires humility and a beginner's mindset, not presuming you've cracked it forever
  • Successful B2B founders often feel they've lost PMF with the audience they want next

product Market fit is almost like you keep stacking these S curves where you get product Market fit in a small group

Noah Weiss · 51:00
#product-market-fit#growth#strategy
Hot Take1:05:30

'PM as Mini-CEO' Is the Most Dangerous Advice in Product Management

Noah calls the classic 'PMs should be mini-CEOs' framing the most dangerous piece of advice in product management history, because it produces PMs who act like dictators instead of facilitators. The real job is to amplify the team and facilitate the pace and quality of decision-making, not to make every decision or play arbitrary tiebreaker.

  • 'PM as mini-CEO' breeds dictator behavior and teams that reject having a PM
  • A great PM amplifies the team and helps them do the best work of their lives
  • The job is to facilitate the pace and quality of decisions, not make them all
  • New PMs often crave power then find the job is influence and facilitation
  • Good PMs help the team make high-quality decisions quickly without a tiebreaker

PM should be mini CEOs I think that's the most dangerous piece of advice ever in the history of product management

Noah Weiss · 1:05:30
#product-management#leadership#careers

Explainer· 3

Explainer13:30

The U-Curve of When to Involve a Product-Minded Founder

Working with strong founders like Stewart Butterfield and Dennis Crowley, Noah found founder involvement should follow a U-curve over a project's timeline. Get them deeply involved early to agree on principles, goals and anti-goals, let the team run in the middle, then bring them back at the very end to 'taste the soup.' Skipping that final co-creation step makes launches far more painful.

  • Involvement should be high early, low in the middle, high again at the end (a U-curve)
  • Early: align on principles, the vision, goals and anti-goals so the team can explore
  • End: the founder must taste the finished product and catch what's missing
  • Refine in code, not static mocks, because using software is different from viewing it
  • Slack ran collective 'bug bash' sessions with Stewart and the whole team to refine

almost like a u curve where the x-axis is time and the y-axis's level of involvement

Noah Weiss · 14:00

customers like literally taste the soup what's missing in it

Noah Weiss · 14:30
#founders#product-leadership#process
Explainer27:00

Complaint Storms: Critique a Rival's Product Before Your Own

Slack's 'complaint storms' ritual, started around 2019-2020, helps a team look at software with fresh eyes. The trick is to start by walking through an adjacent or competitor product on one shared screen, listing every confusing point and pain point, before turning that same critical lens on your own product. Starting with someone else's product removes the sting and generates a backlog of ideas.

  • Power users (like people who live in Slack all day) lose empathy for new users
  • The team projects one product on a screen and logs every confusion and pain point
  • Starting on an adjacent/competitor product first makes self-critique less painful
  • Used whenever a team feels stuck or hits a dead end
  • Similar in spirit to Stripe's 'friction logging'

or myself would also join and we'd actually start off with other products first like an adjacent spaces

Noah Weiss · 28:00
#product-process#ux#slack#rituals
Explainer49:00

Slack's 'Successful Teams' Metric: Get Five People Communicating for a Week

Through data science, Slack landed on a new North Star called 'successful teams': if five people used Slack for the majority of their work week just to communicate, that team was far more likely to upgrade within six months. It seems like a low bar, but hitting that critical mass meant the rest took care of itself, and it rallied product teams across the company.

  • The metric sat earlier in the funnel than paid customers but predicted upgrades
  • Threshold: five people using Slack most of the work week to communicate
  • Teams that hit it were far more likely to upgrade over the next six months
  • A low but predictive activation bar that reaches critical mass
  • It aligned teams beyond just self-serve around driving successful teams

five people using slack the majority of their work week to just communicate at all that would be a successful team

Noah Weiss · 49:30
#metrics#activation#growth#slack

Story· 3

Story05:00

Noah Weiss's Three Maxims for Surviving the First Two Months of Parenthood

Just back from paternity leave, Noah shares the three maxims he and his wife used to stay grounded as new parents. The through-line: give yourself grace, don't project the newborn phase onto the future, and fully immerse yourself including a digital detox. It's a warm aside that opens the episode.

  • Get a little bit better every day and give yourself permission when something doesn't go right
  • Don't over-extrapolate from the early days; the newborn 'fourth trimester' is not the next 18 years
  • Fully get into it as a parent, including a full digital detox to be present
  • Nothing replaces actually doing it no matter how many books you read

number two don't over extrapolate from the early days

Noah Weiss · 05:30

you gotta fully get into it as a parent like there's nothing that replaces actually you got to change the diapers you got to do…

Noah Weiss · 06:00
#parenting#advice#work-life
Story09:00

The Foursquare Mistake: Betting on the Wrong Atomic Unit vs Instagram

Noah's mini post-mortem on why Foursquare never became a massive consumer app. The core error was believing the atomic unit was a person talking about a place they're physically at, rather than a person sharing a moment or experience anywhere. Instagram, an early Foursquare API developer, won the social side; Google later caught up on utility.

  • You learn more from things that don't fully work out because of the negative feedback loop
  • The fatal frame was 'a person at a place' instead of 'a person sharing a moment or experience'
  • Instagram used the Foursquare API before Facebook acquired them
  • Google's billion+ Maps users on Android/iOS eventually replicated the utility
  • Foursquare ultimately pivoted to a valuable B2B data/API business

there's something actually where you learn more from the things that don't solely work out or don't quite achieve what you wanted to achieve

Noah Weiss · 08:00

mistaken to believe that the idea that the atomic unit would be a person talking about a place that they're at and you have to…

Noah Weiss · 09:30
#foursquare#product-market-fit#post-mortem#startups
Story46:30

When Slack's Self-Service Plateaued, They Threw the Roadmap Away

Around 2019 Slack's self-service business quietly plateaued as it moved from early adopters to a later-majority market with different needs. Instead of optimizing what had worked, the team threw out the roadmap, generated hypotheses about new levers, and deliberately accepted ~six months of zero impact in exchange for learning. It ultimately doubled the rate of new paid customer growth.

  • Cohort curves looked unhealthy as Slack saturated tech-savvy early adopters
  • They discarded the roadmap and formed hypotheses about new growth levers
  • They chose to sacrifice near-term impact for ~6 months to optimize for learning
  • The payoff: roughly doubling the rate of new paid customer growth
  • Requires humility and not presuming you deserve every company on Earth

let's kind of throw the whole roadmap away and instead let's come up with a bunch of hypotheses about what could be new levers

Noah Weiss · 46:30

for the next like six months we're probably not going to drive any impact at all it's only going to be about learning

Noah Weiss · 47:00
#growth#self-service#slack#learning

Tool· 1

Tool31:00

Customer Love Sprints: A Two-Week Hackathon Where You Ship Everything

Slack allocates 'customer love sprints,' a two-week hackathon-style burst focused on the lowest-effort, highest-impact changes to generate customer love in a feature area. Unlike a throwaway hackathon, the explicit goal is to ship all of it. User-facing teams run them at least quarterly; less user-facing teams roughly twice a year.

  • A burn-down list of lowest-effort, highest-impact love-generating changes
  • Design, product and engineering sprint together for two weeks
  • The goal is to ship all of them, not throw the work away
  • A fun change of pace from multi-month feature work
  • Run at least quarterly on user-facing teams

the goal is to ship all of them so this isn't like hacks that you throw away

Noah Weiss · 31:30
#product-process#sprints#slack#prioritization

Takeaway· 3

Takeaway35:00

Customer Obsessed but Competitor Aware

Noah's maxim for operating in a crowded market (HipChat, Discord, Microsoft Teams) is to be customer obsessed but competitor aware, contrasted with companies like Uber that were notoriously competitor-obsessed. Slack didn't set out to kill HipChat; it won by being 10x better on a few axes like cross-client search and bringing consumer messaging delight (emoji, reactions) to work.

  • Be customer obsessed but competitor aware, not competitor-obsessed
  • Slack beat HipChat/Campfire by being 10x better on a few axes
  • Great mobile, search that actually worked, and consumer-grade emoji/reactions
  • Discord serves communities, a fundamentally different audience than work teams
  • Teams was a defensive move to protect Office; many customers happily use both

we're customer obsessed but competitor aware

Noah Weiss · 35:00
#competition#strategy#slack
Takeaway56:00

Slack's Real Growth Engine: A Product People Stake Social Capital On

Asked what Slack did right that people under-appreciate, Noah says 'product-led growth' wasn't even a term yet. The core was building something customers loved enough to put their own social capital on the line to get co-workers on board, easy enough to adopt and pay for without ever talking to a salesperson. In today's saturated acquisition channels, word-of-mouth is increasingly the only way to scale.

  • 'Product-led growth' wasn't a named playbook when Slack started
  • The engine was customers risking their own social capital to onboard co-workers
  • Easy enough to self-serve and expense without talking to a salesperson
  • Small teams inside big companies (IBM, Disney, Apple) discovered Slack independently
  • Echoes Seth Godin: the products that win are the ones you want to tell friends about

building a product that customers loved enough that they would put their own social capital on the line to get their co-workers on board

Noah Weiss · 54:00
#growth#word-of-mouth#product-led-growth
Takeaway1:22:30

The Biggest Unlock: Prototype in Real Software, Not Static Mocks

Asked for a minor change with outsized impact, Noah points to a cultural shift: Slack stopped burning cycles on static design mocks and walkthroughs and started prototyping the real, messy software as fast as possible, even if it gets thrown away. For a product like Slack you have to live, touch and smell the software, and this avoided months of design debates.

  • Stopped spending cycles on static mocks and design walkthroughs
  • Prioritized getting into real, messy prototype software quickly
  • You can't just look at software; you have to live and touch it
  • Avoided months-long design debates by getting to how it actually feels
  • Throwaway prototypes are fine if they reveal the real experience faster

we stopped spending so many cycles on design explorations of like static mocks or walkthroughs and said how quickly can we get into prototyping the…

Noah Weiss · 1:22:30
#prototyping#product-process#design