HHiring Reality
← Together AI

Senior Software Engineer — Infra Agent Systems

Together AI
Location
Amsterdam
Posted
14 days ago
Department
Engineering
What they actually want (must-haves)
  • 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms
  • Strong systems design skills and experience owning significant systems from design through production
  • Depth in at least one of the following: AI agent systems, orchestration, tool use, evaluation, or grounding
  • Knowledge graphs or graph data modeling
  • Search, retrieval, ranking, RAG, or semantic search systems
  • Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems
Nice to have
  • Experience in GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers
  • Graph databases
  • Event-driven systems and messaging platforms such as NATS or Kafka
  • Observability platforms such as Prometheus and Grafana
  • Building evaluation frameworks or improving the quality and reliability of LLM-powered systems
What the job really is

As a Senior Software Engineer on the Infra Agent Systems team, you will design and build AI agents that diagnose and remediate issues within a large GPU infrastructure. Your work will involve developing the underlying platform, including knowledge graphs and orchestration frameworks, while integrating with various internal systems. This role requires you to own the services from architecture to production, ensuring they operate effectively and improve over time.

Things to weigh
  • Role involves both development and operational responsibilities in production
  • Opportunity to work on foundational systems and large-scale infrastructure
  • Hybrid work model in Amsterdam
Job score3/5
Benefits1/5
Freshness4/5
Career value5/5
Role clarity5/5
Pay transparency0/5

Applying to Together AI?

See how your résumé matches this role — and tailor it from what actually gets interviews.

Calculate resume scoreGenerate resume to apply
Job Link →