“No, we just checked LM arena and artificial analysis.”
← All resourceswebsite
LM Arena
1 recommend/use · 2 sourced episodes
Every sourced reference
Short attributed excerpts only. Timestamps are approximate.
“the industry is played by these terrible leaderboards like LM Arena.”
Related frameworks
Entrepreneurship4 steps
Build the Company Only You Could Build
Reject the pivot-and-blitzscale playbook; commit to the one idea that dies without you.
Read →
Innovation4 steps
Continuous Calibration, Continuous Development (CCCD)
A CI/CD-style loop for non-deterministic AI: scope, evaluate, deploy, then calibrate against surprises.
Read →
Strategy4 steps
Deep Human Evaluation Over Leaderboards
Measure real progress with experts who work through the answer, not crowds who vibe for two seconds.
Read →
Strategy4 steps
Design the Dream Objective Function
You become what you measure — so measure the rich thing you actually want, not the easy proxy.
Read →
Strategy3 steps
Evals-Plus-Production-Monitoring Dual Feedback Loop
Reject the false dichotomy: evals catch what you know, production monitoring catches what you don't.
Read →
Innovation4 steps
Reinforcement Learning Environment Design
Build a fully-fleshed simulated world, inject real chaos, and reward the trajectory, not just the answer.
Read →
Innovation3 steps
The Agency-Control Autonomy Ladder
Ship AI in graduated versions, trading human control for machine agency only as trust is earned.
Read →
Leadership3 steps
The AI Success Triangle
Successful AI adoption is a people problem first: great leaders, good culture, and technical progress.
Read →
Peak Performance5 steps
The Complementary Learning Modes Ladder
Mastery needs many kinds of practice — imitate a master, get preference feedback, get graded, then live it.
Read →
Innovation4 steps
The Two-Sided Quality Signal
Great curation does two opposite jobs at once: kill the worst, surface the best.
Read →
People in these episodes
Related resources
- A Fire Upon the Deep
- Alexa
- Amazon
- Amazon Web Services
- Anthropic
- Artificial Analysis
- Bloomberg Terminal
- Booking.com
- caffeinate
- ChatGPT
- Clair Obscur: Expedition 33
- Claude
- Claude Artifacts
- Codex
- Contact
- Databricks
- DeepMind
- Gemini 3
- Gmail
- Gödel, Escher, Bach
- Google Search
- GPT-3
- GPT-4o
- GPT-5
- Grok
- Le Ton beau de Marot
- Lenny's Podcast
- Linear
- Maven
- Microsoft
- MIT
- OpenAI
- Raycast
- Remembrance of Earth's Past
- Salesforce
- Silicon Valley
- Slack
- Sora
- Story of Your Life
- Stripe
- Surge AI
- Surge AI Blog
- The Myth of Sisyphus
- Travelers
- Waymo
- When Breath Becomes Air
- Wispr Flow
Spot an error or want this page removed? Request a correction or removal.