HHiring Reality
← Together AI

Senior Software Engineer — Infra Agent Systems UK

Together AI
Location
London
Posted
19 days ago
Department
Engineering
What they actually want (must-haves)
  • 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms
  • Strong systems design skills and experience owning significant systems from design through production
  • Depth in at least one of the following: AI agent systems, orchestration, tool use, evaluation, or grounding
  • Knowledge graphs or graph data modeling
  • Search, retrieval, ranking, RAG, or semantic search systems
  • Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems
Nice to have
  • Experience in GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers
  • Graph databases
  • Event-driven systems and messaging platforms such as NATS or Kafka
  • Observability platforms such as Prometheus and Grafana
  • Building evaluation frameworks or improving the quality and reliability of LLM-powered systems
What the job really is

The Senior Software Engineer for Infra Agent Systems at Together AI will design and build production AI agent systems that diagnose and remediate infrastructure issues across a large GPU fleet. This role involves developing distributed services, orchestration frameworks, and knowledge graphs, while also owning the services end to end, from design to production operations. The engineer will work on improving agent performance and integrating with various internal systems through well-designed APIs.

Things to weigh
  • Remote position based in the UK
  • The role involves both software delivery and operational support in production
  • Opportunity to work on foundational systems from the ground up, which may involve significant challenges
  • No salary or specific benefits mentioned in the posting
Job score3/5
Benefits1/5
Freshness4/5
Career value5/5
Role clarity5/5
Pay transparency0/5

Applying to Together AI?

See how your résumé matches this role — and tailor it from what actually gets interviews.