❝Story09:00
How Lookout Went From 7% to 40% Must-Have in Two Weeks
Sean took a growth role at mobile security company Lookout only to find just 7% of users would be very disappointed to lose it. Digging into that 7% revealed they all valued the antivirus feature, so he repositioned the whole product around antivirus and streamlined onboarding to deliver protection fast. The next survey cohort hit 40%, and the company later reached a billion-dollar valuation.
- Initial Sean Ellis test came back at only 7% very disappointed
- The 7% were focused on the antivirus functionality specifically
- Fix step one: reposition the product on antivirus to filter for the right users
- Fix step two: streamline onboarding so users set up antivirus and got a 'You're Now protected' message fast
- Score reached 40% in two weeks, 60% six months later; Lookout hit a billion-dollar valuation years later
“but fortunately with the signal and the information we got from the initial survey we were able to get them at 40% in two weeks”
“it's really the combination of those two things it's set the right expectations and then speed to value”
#product-market-fit#positioning#onboarding#case-study
❝Story19:00
Why a 'Commoditized' Website Builder Scored 90%
Sean ran the survey on Webs.com expecting a low score because rivals like Wix and Weebly were easier to use, but it came back around 90% very disappointed, the highest he'd ever seen. Digging in, the reason was investment: users had poured time into building beautiful sites they knew how to edit. It taught him the score is a function of both switching costs and product utility.
- Webs.com scored ~90% despite being a seemingly commoditized, not-best-in-class product
- The driver was the 'investment' step from Nir Eyal's Hooked model
- Users had invested heavily building sites they knew how to change, raising switching costs
- The PMF score reflects both switching costs and utility, not utility alone
- Eventbrite scored the second highest he'd seen for the same switching-cost reason
“but it came back with one of the highest scores I'd ever seen and it was like like 90% of the people saying they'd be…”
“so it's it's a a function of both switching costs and utility of the product”
#product-market-fit#switching-costs#hooked-model#case-study
❝Story28:30
The Question Was Invented to Get Honest Answers From Senior Managers
Sean explains the origin of 'how would you feel if you could no longer use this product.' At Xobni, his customers were senior managers who were never satisfied and gave lukewarm answers to standard satisfaction surveys. Flipping the framing to loss aversion pulled more honest responses, and it worked so well at his next companies that it became his standard.
- Originally he used a normal satisfaction question
- Xobni's customers were senior management, who are never satisfied and answer lukewarmly
- Reframing to 'how would you feel if you could no longer use this product' got more honest answers
- It kept outperforming the typical satisfaction question at Dropbox and beyond
“well if I if I flip it and say how would you feel if you could no longer use this product I'll probably get a…”
“senior Management's Never Satisfied I'm GNA get always this like super lukewarm thing”
#surveys#product-market-fit#origin-story
❝Story54:30
LogMeIn Froze Its Roadmap and 10x'd Activation
At LogMeIn, Sean couldn't spend more than $10k/month profitably on growth, and found 95% of signups never once did a remote-control session. The CEO froze the entire product roadmap and pointed everyone at improving signup-to-usage. In three months activation went from 5% to 50%, the same channels scaled to $1M/month, and 80% of new users came via word of mouth.
- Growth was capped at $10k/month profitable spend
- 95% of signups never did a single remote-control session
- CEO froze the product roadmap; product, engineering, design and marketing all focused on signup-to-usage
- Signup-to-usage improved 1000% in three months (5% to 50%)
- The same channels then scaled to $1M/month with a three-month payback; 80% of new users came through word of mouth
“we are putting a complete freeze on the product development road map”
“80% of new users were coming in through word of mouth so there was this just like major inflection point by just focusing on activation”
#activation#case-study#channels#focus
❝Story57:30
The 'Too Good to Be True' Bug That Killed 90% of Downloads
A cheap demand-gen channel had a 90% drop-off at the download step, and ten-plus A/B tests couldn't fix it. Finally someone suggested just asking the 18,000 registered non-downloaders why, via a message that looked like it came from customer support. The answer: as one of the first free SaaS products, people didn't believe it was free. Adding a visible paid trial made the free version credible and produced a 300% improvement.
- A cheap channel had a 90% drop-off at the download step; 10+ A/B tests failed
- The breakthrough was simply asking registered non-downloaders why they didn't download
- Answer: 'this seemed too good to be true' — people didn't believe a free SaaS product was real
- Offering a choice between a paid trial and the free version (with a big check mark on free) made it credible
- The next test delivered a 300% improvement in download rate
“oh I just I just this seemed too good to be true I didn't believe this was free”
“our next test gave us a 300% Improvement in the download rate”
#conversion#activation#qualitative-research#case-study
❝Story1:11:00
The VC Question That Made Sean a Better Experimenter
Known as the data-and-experiments growth guy, Sean says most of his best advice is qualitative. A VC at LogMeIn kept pushing him with 'when was the last time you talked to a customer.' Sean initially gave the smartass reply that he cares what customers do, not what they say, but daily customer conversations made his experiments dramatically better and turned him into a qualitative-plus-quantitative operator.
- Sean's reputation is data-driven, but most of his advice is qualitative and survey-driven
- A lead VC repeatedly asked him when he'd last talked to a customer
- His first reaction: 'I don't care what they say I care what they do'
- Talking to customers daily made his experiments much better
- The blend of qualitative and quantitative research produces better tests
“when was the last time you talked to a customer”
“at first I was like yeah gave the smartass answer I don't care what they say I care what they do”
#customer-research#experimentation#qualitative
❝Story1:17:30
How Facebook's MAU-to-DAU Switch Made the Product Addictive
Sean uses Facebook to show that what gets measured gets managed. When Facebook moved its Northstar metric from monthly active users to daily active users, the team suddenly had a strong incentive to bring people back every day. That shift made the product far more engaging, arguably to the point of the addictiveness that later drew public pushback.
- What gets measured gets managed
- Facebook switched its Northstar from monthly active users to daily active users
- Under a DAU goal, the team was incentivized to bring people back every day
- MAU only credited one visit per month regardless of frequency
- The change made the product much more addictive and drew later pushback
“once once Facebook was on a daily active user goal the team suddenly had a lot more incentive to think about how how do I…”
“it it had a a really big impact on making that product way more addictive”
#northstar-metric#engagement#facebook
❝Story1:38:00
Why Sean Refunded Founders Who Weren't Thrilled
Sean's life motto is to focus on reputation and learning over earnings. When two founders seemed unimpressed with his interim work, he offered full refunds, reasoning his reputation was worth $5 million and not worth mortgaging for $20,000. The two VCs who'd made those introductions were the first to give him term sheets when he raised for his own company, at more than double the valuation he'd assigned his reputation.
- His motto: focus on reputation and learning over earnings
- He offered full refunds to two founders who weren't thrilled with his work
- His reasoning: reputation worth $5M isn't worth mortgaging for $20K
- The VCs behind those intros were first to give him term sheets
- His pre-money valuation ended up more than double his self-assigned reputation value
“my reputation is worth $5 million why would I possibly you know mortgage that reputation for $20,000”
#reputation#career#life-lessons