HHiring Reality
← OpenTeams

Distributed Systems ML Infrastructure Engineer

OpenTeams
Location
Washington, DC Metro; Denver, CO Metro; or Colorado Springs, CO - Hybrid/Remote
Posted
17 days ago
Department
Technology
Salary
$145,000–$250,000
What they actually want (must-haves)
  • U.S. citizenship and eligibility to obtain and maintain a U.S. security clearance
  • 6+ years of experience in distributed systems, platform engineering, infrastructure engineering, or a related software engineering role
  • Production experience operating Kubernetes and containerized workloads on a major cloud platform
  • Experience with managed Kubernetes services such as Amazon EKS or an equivalent platform
  • Experience supporting machine learning workloads in production, such as model serving, GPU scheduling, or large-scale data and evaluation pipelines
  • Experience designing, building, or operating distributed services that support reliability, scalability, and performance requirements
Nice to have
  • Active TS/SCI clearance with CI polygraph
  • Hands-on experience deploying or operating software in classified, air-gapped, or limited-connectivity environments
  • Experience with classified cloud environments, including AWS Secret or Top Secret regions
  • Experience building or operating model gateways, LLM routing layers, inference services, or inference-brokering platforms
  • Familiarity with software promotion into classified environments, cross-domain transfer processes, and release packaging
What the job really is

The Distributed Systems ML Infrastructure Engineer will design and implement core services for a containerized, API-first AI platform, focusing on workflow orchestration, data ingestion, and results management. The role involves working on unrestricted infrastructure, deploying releases into controlled environments, and ensuring platform reliability and performance across various deployment scenarios. This position also requires collaboration on integration and validation of the platform in production settings.

Benefits
  • Medical, Dental & Vision – 100% paid for employees, 75% for dependents
  • 401(k) Match – Up to 5% with full vesting after 2 years
  • Unlimited PTO – With a required minimum of 15 days off annually
  • Fully Remote Setup – Includes up to $3,000 equipment reimbursement
  • Continuous Education – Includes up to $500 reimbursement
  • Disability & Life Insurance – 100% employer-paid
Things to weigh
  • Position contingent upon contract award
  • Travel of up to 15% may be required, primarily to Government facilities and between company locations
  • Unclassified work may be performed remotely, while classified promotion and validation activities require onsite work in an accredited facility and the appropriate security clearance
Job score4.6/5
Benefits4/5
Freshness4/5
Career value5/5
Role clarity5/5
Pay transparency5/5

Applying to OpenTeams?

See how your résumé matches this role — and tailor it from what actually gets interviews.