HHiring Reality
← DigitalOcean

Director, Engineering - Serverless Inference

DigitalOcean
Location
Bengaluru
Posted
18 days ago
Department
Agentic AI
What they actually want (must-haves)
  • 4+ years of experience directly managing engineering teams
  • Experience managing teams that build and operate multi-tenant platforms or distributed backend systems
  • Deep understanding of SRE principles, including observability, incident management, reliability engineering, capacity planning, and operational automation
  • Strong understanding of cloud-native multi region architectures, microservices, and distributed systems fundamentals
  • Experience with Kubernetes and/or operating high-scale distributed services in production environments
Nice to have
  • Experience working with GPUs, GPU utilization tracking, or accelerated computing infrastructure
  • Familiarity with Large Language Models (LLMs) and modern LLM serving architectures, including engines like vLLM or Triton
  • Familiarity with LLM serving stacks such as TensorRT-LLM or similar technologies
  • Experience building Agents yourself for either personal or professional use
  • Experience with API gateways, traffic routing, or service mesh technologies
What the job really is

As the Director of Engineering for Serverless Inference at DigitalOcean, you will lead a team focused on designing and optimizing infrastructure and APIs for large-scale AI workloads. Your responsibilities will include raising engineering standards, fostering team culture, collaborating with cross-functional teams, and overseeing the technical roadmap for high-throughput API gateways. You will also manage incident response and operational readiness to ensure production-quality engineering practices.

Benefits
  • Reimbursement for relevant conferences, training, and education
  • Access to LinkedIn Learning's 10,000+ courses
  • Employee Assistance Program
  • Local Employee Meetups
  • Flexible time off policy
  • Competitive salary with potential bonuses and equity compensation
Things to weigh
  • No specific salary range provided, only that it is based on market data and experience
  • Role involves managing a team and may require balancing technical and leadership responsibilities
  • Fast-paced environment may not suit everyone
Job score3/5
Benefits3/5
Freshness4/5
Career value4/5
Role clarity4/5
Pay transparency0/5

Applying to DigitalOcean?

See how your résumé matches this role — and tailor it from what actually gets interviews.

Calculate resume scoreGenerate resume to apply
Job Link →