HHiring Reality
← Together AI

Staff Software Engineer, Inference / Compute Infrastructure Engineering

Together AI
Location
London & Amsterdam
Posted
1 month ago
Department
Engineering
What they actually want (must-haves)
  • Strong software engineering background in Go, Python, Rust, or similar
  • Experience with durable workflow orchestration tools such as Temporal, Cadence, or equivalent
  • Experience building software control planes or orchestration systems that model state and reconcile it over time
  • Experience with event-driven systems designing and building software around message queues, event streams, or pub/sub
  • A product mindset with experience building internal platforms or APIs consumed by other engineering teams
Nice to have
  • Exposure to bare-metal provisioning (PXE/iPXE, Redfish/IPMI, BMC) and/or networking fundamentals (VLANs, BGP, fabric design)
  • Experience with GPU cluster software stacks (NCCL, CUDA, InfiniBand/RoCE)
  • Prior work at a hyperscaler, GPU cloud, or datacenter-scale infrastructure organization
  • Systems programming in Rust or Go
What the job really is

The Staff Software Engineer will focus on building a Kubernetes-native control plane for managing a GPU inference fleet, enabling the inference team to efficiently provision and manage resources via a self-service API. Responsibilities include designing lifecycle management software, automating self-healing processes, and ensuring the reliability of the provisioning pipeline. The role emphasizes a product mindset, requiring ownership of both software delivery and operational support in production environments.

Things to weigh
  • No salary or benefits listed
  • Role involves significant operational responsibility alongside software development
  • Focus on GPU infrastructure may require specialized knowledge
  • Emphasis on self-service and automation implies a fast-paced, potentially high-pressure environment
Job score3/5
Benefits1/5
Freshness4/5
Career value5/5
Role clarity5/5
Pay transparency0/5

Applying to Together AI?

See how your résumé matches this role — and tailor it from what actually gets interviews.