“I remembered when GPT2 came out and that was in I think late 2020.”
← All resourcessoftware
GPT-2
By OpenAI
0 recommend/use · 2 sourced episodes
Every sourced reference
Short attributed excerpts only. Timestamps are approximate.
“in maybe like 2019 when GBT2 came out and I was like, "Oh, this is how we're going to get to AGI."”
Related frameworks
Productivity4 steps
Ambitious Retry (Pass@N) Tool Use
Get more from AI tools by asking for the ambitious change and fully restarting on failure instead of hammering the same attempt
Read →
Innovation4 steps
Build for the Exponential (Skate to Where the Puck Is Going)
Build products for the model that arrives in 6-12 months, betting that today's 20%-working features hit 100%
Read →
Innovation5 steps
Constitutional AI Self-Critique Loop
Align a model to written principles by having it critique and rewrite its own outputs, then train on the fix
Read →
Mindset4 steps
Marginal-Impact Reasoning Under Tail Risk
Prioritize catastrophic low-probability risks by expected value and by how few people are already working on them
Read →
Mindset4 steps
Mission-Over-Minutiae Opportunity Choice
Choose your next big move by passion, mission, and team — not by optimizing every minor variable.
Read →
Strategy4 steps
Northstar Problem Commitment
Pick one foundational building-block problem and commit years to it, not a scatter of trendy ones.
Read →
Innovation4 steps
Objective-Data Alignment Test
Before betting on an AI capability, check that your training data is the same shape as your desired output.
Read →
Innovation4 steps
Physical-System Reality Check
For anything embodied, budget for three things — a brain, a body, and real application scenarios.
Read →
Self-Mastery4 steps
Resting in Motion
Treat the busy, working state as your normal baseline so heavy long-term work stays sustainable
Read →
Strategy4 steps
The Economic Turing Test
Measure transformative AI by whether you'd hire an agent for a real job without knowing it's a machine
Read →
Strategy4 steps
The Golden Recipe of Modern AI
Every AI breakthrough sits on three legs: big data, the right neural architecture, and enough compute.
Read →
Strategy4 steps
Three Worlds Theory of Change
Decide what to actually do about a hard problem by naming the pessimistic, optimistic, and pivotal worlds you might be in
Read →
People in these episodes
Related resources
- 80,000 Hours
- AI 2027
- Alexa
- Anthropic
- Apple Podcasts
- Apple Terms of Service
- Area 120
- BigQuery
- ChatGPT
- Cinch
- Claude
- Claude Code
- Figma
- Figma Make
- Fin
- GitHub Actions
- Good Strategy/Bad Strategy
- Google Cloud
- Google DeepMind
- GPT-3
- Intercom
- Justworks
- Kurzgesagt – In a Nutshell
- Lenny's Newsletter
- Lenny's Podcast
- LucidLink
- Machine Intelligence Research Institute
- Marble
- Meta
- Microsoft Azure
- Model Context Protocol
- Montessori education
- New York Times
- Nvidia
- Our World in Data
- Pantheon
- Princeton University
- Replacing Guilt
- Sauce
- Scale AI
- Silicon Valley
- Sony
- Spotify
- Stanford University
- Superintelligence
- Ted Lasso
- The Alignment Problem
- The Last Question
- The Matrix
- United Nations Universal Declaration of Human Rights
- WordNet
- World Labs
Spot an error or want this page removed? Request a correction or removal.