LLenny's Podcast
← All episodes
26 July 2026

Anthropic’s first technical PM on token maxing, the jagged edge, and living in the future

4Frameworks
10Insights

Listen

Frameworks in this episode

Insights & moments

The myth-busts, hot takes, explainers, and tools worth keeping.

Myth Buster· 1

Myth Buster

Why a Less Compliant AI Can Be More Useful

Safety and alignment do not merely constrain a model; they can help it recognize when compliance would produce a worse result. Penn argues that useful proactivity includes knowing when to question a request, introduce a better idea, or challenge an underdeveloped conclusion.

  • An assistant that always agrees can reinforce bad judgment.
  • Appropriate pushback improves decision quality.
  • Proactivity means more than completing scheduled tasks.
  • Knowing whether an action is right is part of capable behavior.
  • A strong thinking partner should leave the user with better ideas.

having AI not just be an assistant, not just be a doer, not and being delegated task, but figuring out is it doing the right…

Dianne Penn

a thinking partner doesn't just agree with you, it should add to you and you should come away at the end of the day having…

Dianne Penn
#alignment#pushback#proactivity#ai-character

Explainer· 2

Explainer

Why Frontier Models Need Frontier Products

A highly capable model does not automatically create a breakthrough user moment. Penn argues that products such as Claude Code give users a vehicle for experiencing frontier intelligence, while stronger models make those products compelling enough to accelerate adoption.

  • Model intelligence needs an accessible product vehicle.
  • Claude Code exposed Opus 4.5's intelligence through end-to-end agentic work.
  • Opus 4.5 made Claude Code substantially more compelling.
  • The model and product created a mutually reinforcing adoption loop.

you need frontier products in order to have frontier models and for people to feel the magic of frontier models.

Dianne Penn

Opus 4.5 wouldn't have had that moment without a product like Cloud Code.

Dianne Penn
#frontier-models#claude-code#product-experience#agents
Explainer

The Jagged Edge: Model Skills Improve in Discontinuous Jumps

Scaling loss may improve smoothly as compute and data increase, but individual capabilities can appear suddenly. This creates a jagged frontier where a model may become reliably capable at one task while retaining rough edges elsewhere, making targeted evals, prototypes, safety testing, and product discovery essential.

  • Overall scaling curves can appear smooth.
  • Specific capabilities may emerge discontinuously.
  • Teams cannot always predict the exact model or moment when a skill appears.
  • Evals reveal capabilities and risks that would otherwise remain hidden.
  • Improving one capability makes previously tolerated weaknesses more visible.

you essentially see these actually discontinuous emergent capabilities jump.

Dianne Penn

unless you have the evals, unless you have the systems to test, um, these jumps might actually happen and you don't know.

Dianne Penn
#jagged-edge#emergence#scaling-laws#model-evals

Story· 3

Story

Golden Gate Claude Helped Anthropic Find Its Product Identity

Anthropic temporarily amplified a model feature associated with the Golden Gate Bridge, causing Claude to weave the bridge into virtually every response. A cross-functional team turned the interpretability research into a public Claude.ai experience within 24 hours, demonstrating that Anthropic could translate research into distinctive user experiences at startup speed.

  • The experiment emerged from interpretability research into model features.
  • Amplifying one feature made Claude obsessively mention the Golden Gate Bridge.
  • Engineering, product, design, and research shipped the experience within 24 hours.
  • Only about 2,000 people may have used it, but its cultural impact inside Anthropic was significant.
  • The project helped Anthropic recognize a distinctive research-to-product identity.

Claude would obsess about the Golden Gate Bridge.

Dianne Penn

we can actually bring new user experiences, showcase our research in a way that's different and authentic to us.

Dianne Penn
#anthropic#interpretability#product-culture#prototyping
Story

The Small Coding Bet That Differentiated Claude

In 2023, coding was not central to Anthropic's public identity, but Penn noticed users moving beyond autocomplete and asking models to produce long-form code. A relatively small training adjustment for Opus 3 improved that capability and attracted early Claude enthusiasts and developers.

  • Coding was initially one of many possible model use cases.
  • Users began asking models to write long-form code rather than complete snippets.
  • Anthropic incorporated the opportunity into Opus 3 training.
  • The training change was relatively small but commercially differentiating.
  • The improvement helped build an early developer following.

nobody said anthropic and claude and coding in the same sentence.

Dianne Penn

it ended up being a relatively smaller change from a training perspective, but it ended up helping us differentiate in the early days

Dianne Penn
#coding#opus-3#product-discovery#differentiation
Story

What a Male-Dominated Trading Desk Taught Penn About Conviction

As the only woman and only person with her background on a high-yield trading desk, Penn learned to develop an authentic professional identity and back strong ideas despite being junior or different from her peers. She now applies the lesson by helping people pursue good ideas regardless of tenure while expecting conviction and detailed follow-through.

  • Penn developed her authentic professional identity in a difficult environment.
  • Strong ideas mattered more than seniority or background.
  • Conviction must be paired with execution and detailed follow-through.
  • She encourages team members at every level to pursue valuable ideas.
  • Vulnerability and authenticity became part of her leadership style.

the best ideas and having conviction in the best ideas, uh regardless of all of those other factors, like is the most important thing.

Dianne Penn

to like put the idea out there to actually um have conviction in it, to do the follow through, to do the like nitty gritty…

Dianne Penn
#conviction#career#trading#leadership

Tool· 1

Tool

Using Claude as an EQ Coach Before Difficult Conversations

Penn uses a custom Claude skill to prepare for crucial managerial conversations. The model helps her consider reactions, calibrate detail, improve directness, and build trust, showing how AI can augment emotional intelligence and communication rather than only analytical output.

  • The skill draws on ideas from Crucial Conversations.
  • Claude acts as personalized coaching before important discussions.
  • The model helps anticipate reactions and calibrate the message.
  • Penn retains discretion and does not use every suggestion.
  • AI can augment EQ as well as IQ.

I actually have a skill that helps me figure out am I having, am I going in the right level of detail given the the…

Dianne Penn

I think there is something about how how we can actually augment us from like an EQ perspective in addition to IQ.

Dianne Penn
#management#coaching#communication#claude-skills

Takeaway· 3

Takeaway

AI Product Leaders Must Keep Shipping Themselves

Penn believes managerial seniority does not remove the need for direct model experience. Leaders need to read user feedback, understand token-level behavior, and own real workstreams so they can recognize quality, track changing capabilities, and make sound decisions for their teams.

  • Anthropic gives senior and early-career PMs similar hands-on onboarding.
  • Tinkering alone is insufficient; leaders should ship end to end.
  • Direct model use develops a current sense of what good looks like.
  • Penn personally owns one or two model workstreams to maintain her judgment.
  • Enjoyment and curiosity about working with AI predict success.

you have to be really hands-on yourself and have spent not just time tinkering, but actually shipping with this technology

Dianne Penn

if you're a manager, you have to be hands-on, you have to spend a portion of your time actually shipping

Dianne Penn
#leadership#product-management#hands-on#ai-skills
Takeaway

Judgment, Persistence, and Inner Voice Remain Human Advantages

Penn expects accumulated judgment to remain important because it reflects years of nuanced experience that AI systems have not lived through. She connects that advantage with persistence, curiosity, subject-matter expertise, and the development of an independent inner voice in both adults and children.

  • Judgment accumulates through nuanced lived experience.
  • Choosing which of many possible products to build still requires taste.
  • Persistence and proactive behavior matter beyond raw capability.
  • Children should develop curiosity and confidence in their own inner voice.
  • Domain expertise remains especially valuable outside the most AI-transformed fields.

I think judgment is one and is an area where it's an accumulation of so much nuance and so much experience.

Dianne Penn

curiosity for learning, persistence, believing in your own inner voice, developing and then believing in your own inner voice.

Dianne Penn
#judgment#future-of-work#parenting#human-skills
Takeaway

The Antidote to AI-Era Burnout Is a Team That Can Truly Cover

Anthropic's accelerated release cadence resembles a high-performance sport, but Penn says it cannot be sustained through individual heroics. Low-ego teammates build enough shared context to review one another's work, sharpen decisions, cover launches, and let colleagues take genuine time off without returning to an impossible backlog.

  • Anthropic's model release volume increased dramatically.
  • Rapid decisions require shared context and mutual trust.
  • Teammates support launches even when they are not the primary owner.
  • Real coverage lets people take PTO without work simply accumulating.
  • Low-ego, team-oriented hiring supports long-term sustainability.

nobody can do that sustainably by themselves.

Dianne Penn

It's actually that you can take PTO and know the team can figure out the right things to do, and that we individually can like…

Dianne Penn
#burnout#teamwork#culture#sustainability