LLenny's Podcast
← All frameworks
LeadershipJudd Antin (Airbnb, Meta)

The Five Tools Researcher

A modern researcher carries five methods, not one — and you hire for the Swiss army knife.

Difficulty
Moderate
Time to result
~months to results
Steps
4
Confidence
93%

Antin's rejection of user research as a purely qualitative craft. The best researchers are multi-method and carry five tools: generative/formative research, evaluative research, rigorous survey design, applied statistics, and technical skills (SQL/dashboards, now increasingly prompt engineering). The framework doubles as a hiring rubric — an open-ended research question in an interview reveals whether the candidate reaches for one hammer or a toolkit — and as a team-composition rule where individual T-shapes must collectively cover all five.

Origin

Judd Antin's own operating model, developed while building the research practice at Facebook and running research and the design studio at Airbnb; published in 'The UX Research Reckoning is Here.' The Swiss-army-knife/hammer framing draws on Maslow's law of the instrument.

Core principles

  • 01If all you have is a hammer, everything looks like a nail.
  • 02Qualitative-only research is a model that has to evolve, not a virtue.
  • 03You cannot operate in an A/B-testing world without basic statistics.
  • 04Individuals go deep on one or two tools; the team must cover all five.
  • 05The fifth tool moves with the technology — SQL yesterday, prompt engineering now.

How to run it

  1. 1

    Audit the five tools against your current team

    Tool 1: formative/generative (open-ended, ethnographic, innovation-facing). Tool 2: evaluative (usability testing, micro-level product evaluation). Tool 3: rigorous survey design. Tool 4: applied statistics. Tool 5: technical skills — running your own queries, reading dashboards, and increasingly working with generative AI.

    Pro tip Map the tools per person, then per team, and hire against the collective gap rather than the individual gap.

  2. 2

    Interview with one juicy open-ended question

    Give a candidate a genuinely open research question and watch how they scope it. A strong answer is multi-method and time-boxed: 'here is what we could learn in a day, in a week, in a month, and by which methods.'

    Pro tip Antin's companion interview question for leaders: 'think of the most complex topic you've had to explain lately, and explain it to me like I'm five.' It separates good from great.

    Watch out A single-method answer is the tell. Most researchers are deeper in one tool than another — that's fine individually, fatal team-wide.

  3. 3

    Weight communication as heavily as rigour

    Especially for research leaders, evaluate the ability to deliver an insight in the language of the audience — the presentation to a PM is not the presentation to the CEO. Rigorous research that nobody hears is a tree falling in a forest.

    Watch out Communication skill is the most under-weighted hiring criterion in research; Antin evaluates it most heavily in leaders because they teach by example.

  4. 4

    Build the team as a portfolio of T-shapes

    Hire individuals who are broadly competent across the five tools and deeply expert in one or two, so the team collectively fills every gap. That was Antin's explicit goal at both Meta and Airbnb.

In the wild

Building the Airbnb and Meta research benches

Antin used the five-tool model as the organizing principle for team building at both companies: each researcher grew their individual tool coverage while the team was assembled so that deep expertise existed somewhere for every tool.

His direct reports went on to lead research at Figma, Notion, Slack, Robinhood, Duolingo, Fair, and Wealthfront.

The interview screen in practice

Across hundreds-to-thousands of researcher interviews, Antin posed an open-ended research question and scored the answer on method diversity and time-boxing rather than on a single favoured methodology.

A fast, low-cost signal that separates single-method practitioners from Swiss-army-knife researchers.

Common mistakes

Hiring the qualitative purist by default

The first generation of UX research was overwhelmingly qualitative. Hiring only for that profile leaves the team unable to design a survey, read a stat-sig result, or query its own data — which is precisely where the business questions live.

Confusing depth with breadth

A researcher who is world-class at ethnography and blank on statistics is not a five-tool researcher. Depth is expected; it does not substitute for coverage at the team level.

Is it for you?

Best for

Research/design leaders hiring or restructuring an insights team, and founders making their first research hire

Not ideal for

Organisations that genuinely only need usability testing and have a strong data science function already covering survey and stats work

From the transcript

the best researchers have five tools I think they have five tools

18:00

the fourth tool which is applied statistics the best research know a little bit of stats

18:30

you want a researcher who's a who's got a Swiss army knife because if all you have is a hammer then everything looks like a…

20:00

individually as researchers build up those tools and then as a team build deep expertise that would fill all the gaps

21:00

From the episode

The UX research reckoning is here

Judd Antin (Airbnb, Meta)