“round is the private Network built by Tech leaders for Tech leaders”
Round
0 recommend/use · 2 sourced episodes
Every sourced reference
Short attributed excerpts only. Timestamps are approximate.
“round is the private Network built by Tech leaders for Tech leaders”
Related frameworks
Bring the Insight to Win Over Skeptics
Earn trust from more-experienced people by owning customer insight, not by faking expertise
False Positive Risk and the Replication Protocol
A p<0.05 win can be 26% likely false when idea success rates are low — replicate borderline results
How Might the Opposite Be True
Break a scarcity or false-tradeoff frame by forcing yourself to argue the reverse
Incremental OFAT Over Big-Bang Redesign
Decompose big redesigns into one-factor-at-a-time tested steps because ~80% of ideas fail
Institutional Memory of Experiments
Capture wins, losses, and surprises so the org keeps learning instead of relaunching old ideas
Learning Curve, Environment, Problem
Evaluate whether to stay in or leave a role using three questions, not job titles
Sample Ratio Mismatch (SRM) Validity Check
Verify your traffic split matches its design before trusting any experiment result
Single-Owner Review Limits
Cap reviews, approvals, and meeting size so one accountable owner drives the pace
Situation-Behavior-Impact Feedback
Deliver hard feedback as an undeniable subjective observation, not a verdict
The 200K-User Experimentation Readiness Rule
Below ~200K users detect only big effects; use the wait to build platform and culture
The Double Diamond Product Process
Alternate broad exploration and narrow selection across customer, problem, and solution
The Overall Evaluation Criterion (OEC)
Define one success metric with countervailing guardrails that predicts long-term lifetime value
The Three E's of Career Growth
Grow faster by deliberately balancing experience, exposure, and education
The Trust Equation
Trust = (credibility + reliability + authenticity) / perception of self-interest
Twyman's Law: Investigate the Too-Good-to-Be-True Result
Any surprising or extreme experiment result is probably wrong until you've hunted for the flaw
People in these episodes
Related resources
- Airbnb
- Amazon
- Apple Podcasts
- Asana
- Attio
- Bing
- Blink cameras
- Brave Search API
- Chernobyl
- Double Diamond
- Eppo
- First Round Review
- GoodUI
- Google Docs
- Hard Facts, Dangerous Half-Truths, and Total Nonsense
- Hotmail
- Inspired
- Intercom
- Intuit
- Lenny's Newsletter
- Lenny's Podcast
- Lenny's Podcast website
- Lennybot
- Maven
- Microsoft
- Mistakes Were Made (But Not by Me)
- Mixpanel
- MSN
- Netflix
- Optimizely
- Poe
- PowerPoint
- Quora
- Ronny Kohavi’s live cohort-based experimentation course
- Slack
- Spotify
- The Alchemist
- The Blind Assassin
- The Conscious Leadership Group
- The Diplomat
- Trustworthy Online Controlled Experiments
- Windows Indexer
Spot an error or want this page removed? Request a correction or removal.