HHiring Reality
← Together AI

Senior Software Engineer — Infra Agent Systems Remote India

Together AI
Location
India
Posted
26 days ago
Department
Engineering
What they actually want (must-haves)
  • 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms
  • Strong systems design skills and experience owning significant systems from design through production
  • Depth in at least one of the following: AI agent systems, orchestration, tool use, evaluation, or grounding
  • Knowledge graphs or graph data modeling
  • Search, retrieval, ranking, RAG, or semantic search systems
  • Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems
Nice to have
  • Experience in GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers
  • Graph databases
  • Event-driven systems and messaging platforms such as NATS or Kafka
  • Observability platforms such as Prometheus and Grafana
  • Building evaluation frameworks or improving the quality and reliability of LLM-powered systems
What the job really is

The Senior Software Engineer for Infra Agent Systems will develop and maintain software systems that automate and manage one of the largest GPU fleets globally. Responsibilities include building production AI agents for diagnosing and remediating infrastructure issues, creating a robust core platform with knowledge graphs and orchestration frameworks, and ensuring the performance and reliability of these systems in a production environment.

Things to weigh
  • Role involves both development and operational responsibilities, which may require on-call support
  • Focus on cutting-edge AI technologies and infrastructure, which may involve a steep learning curve
  • Remote position based in India may have different collaboration dynamics compared to in-office roles
Job score3/5
Benefits1/5
Freshness4/5
Career value5/5
Role clarity5/5
Pay transparency0/5

Applying to Together AI?

See how your résumé matches this role — and tailor it from what actually gets interviews.

Calculate resume scoreGenerate resume to apply
Job Link →