HHiring Reality
← Together AI

Junior/Senior/Staff Software Engineer, Inference / Compute Infrastructure Engineering

Together AI
Location
Amsterdam
Posted
1 month ago
Department
Engineering
What they actually want (must-haves)
  • Strong software engineering background in Go, Python, Rust, or similar
  • Experience with durable workflow orchestration tools such as Temporal, Cadence, or equivalent
  • Experience building software control planes or orchestration systems that model state and reconcile it over time
  • Experience with event-driven systems designing and building software around message queues, event streams, or pub/sub
  • A product mindset with experience building internal platforms or APIs consumed by other engineering teams
Nice to have
  • Exposure to bare-metal provisioning (PXE/iPXE, Redfish/IPMI, BMC) and/or networking fundamentals (VLANs, BGP, fabric design), or GPU/accelerator infrastructure
  • Experience with GPU cluster software stacks (NCCL, CUDA, InfiniBand/RoCE)
  • Prior work at a hyperscaler, GPU cloud, or datacenter-scale infrastructure organization
  • Systems programming in Rust or Go
What the job really is

In this role, you will develop software systems that automate the lifecycle management of hardware infrastructure, transforming physical servers into operational AI clusters. You will create APIs for self-service provisioning, implement state machines for hardware management, and ensure reliability through automated self-healing processes. The position emphasizes a product mindset, requiring you to build, own, and support the software you develop.

Things to weigh
  • No salary listed
  • Role involves significant ownership and responsibility for production software
  • Focus on automation and reliability may require a strong understanding of infrastructure concepts
Job score3/5
Benefits1/5
Freshness4/5
Career value5/5
Role clarity5/5
Pay transparency0/5

Applying to Together AI?

See how your résumé matches this role — and tailor it from what actually gets interviews.