HHiring Reality
← Nuance Labs

Human Evaluation Researcher

Nuance Labs
Location
Seattle, Washington
Posted
20 days ago
Department
Research
Salary
$160,000 – $190,000
What they actually want (must-haves)
  • 5+ years designing and running human-subjects research in industry or academia
  • Strong grounding in qualitative and quantitative research methods
  • Experience with study designs that achieve consensus on ambiguous judgments
  • Fluency with agreement and reliability metrics
  • Ability to communicate findings clearly to ML researchers
Nice to have
  • Experience evaluating generative AI or digital humans
  • Background in perceptual science or psychophysics
  • Familiarity with human evaluation at scale
  • Statistics and scripting skills (Python or R)
What the job really is

As a Human Evaluation Researcher at Nuance Labs, you will design and conduct qualitative and quantitative studies to evaluate AI avatars, focusing on aspects like naturalness and emotional resonance. Your role involves developing measurement instruments, ensuring inter-rater agreement, and calibrating automated metrics against human judgment. You will work closely with the founders and the modeling team, owning the human evaluation process from start to finish.

Benefits
  • $160,000 – $190,000 base salary
  • Meaningful equity
  • Health plans with ~$2,000 in annual HSA contributions
  • $2,000/year wellness stipend
  • One-time $500 for work setup
  • 15 days of PTO and 10 public holidays
Things to weigh
  • In-person work required five days a week
  • The role is hands-on and may require quick turnaround studies
  • No specific mention of remote work options or flexibility
  • The position involves subjective evaluation, which may lead to ambiguous results
Job score4.6/5
Benefits5/5
Freshness4/5
Career value4/5
Role clarity5/5
Pay transparency5/5

Applying to Nuance Labs?

See how your résumé matches this role — and tailor it from what actually gets interviews.

Calculate resume scoreGenerate resume to apply
Job Link →