HHiring Reality
← ngrok Inc.

Full-stack Software Engineer III/Senior, AI Gateway

ngrok Inc.
Location
San Francisco, CA
Posted
1 month ago
Department
Engineering
Salary
$202,500 – $247,500
What they actually want (must-haves)
  • Experience with a statically typed, compiled language such as Go, Rust, C++, or Java
  • Frontend engineering experience including expertise in TypeScript, React, HTML, CSS
  • Experience working with AI/LLMs
  • Ability to define system behavior and manage complexity
  • Understanding of retries, limits, and costs in system design
Nice to have
  • Experience with AI platforms or inference infrastructure
  • Experience with API gateways
  • Experience with usage limits, quotas, or billing-adjacent systems
  • Experience with customer-facing observability tools
What the job really is

As a Full-stack Software Engineer III/Senior on the AI Gateway team at ngrok, you will build and evolve the AI Gateway components that manage AI traffic in real time. Your responsibilities include designing AI traffic policies, tracking usage, and ensuring that AI behavior is observable and explainable. You will collaborate with various teams to ensure that the systems you develop are reliable and trusted by customers.

Benefits
  • Full premiums covered on base healthcare, dental, and vision for you; half covered for dependents
  • 401(k) with 100% match up to 3% of salary and 50% match up to another 2%
  • Open, flexible vacation policy
  • Parental leave up to 16 weeks for birth, up to 8 weeks for new parents
  • Annual professional development budget
  • Co-working space stipend
Things to weigh
  • No mention of specific tools or technologies beyond the tech stack
  • Remote position available only for candidates outside the Bay Area; hybrid for those within commuting distance
  • Candidates must be US-based and authorized to work in the US without sponsorship
Job score4.6/5
Benefits5/5
Freshness4/5
Career value4/5
Role clarity5/5
Pay transparency5/5

Applying to ngrok Inc.?

See how your résumé matches this role — and tailor it from what actually gets interviews.

Calculate resume scoreGenerate resume to apply
Job Link →