HHiring Reality
← OPSWAT

Senior AI Engineer

OPSWAT
Location
Ho Chi Minh City, Ho Chi Minh City, Vietnam
Posted
11 days ago
Department
Enterprise Platform
What they actually want (must-haves)
  • Bachelor's degree in Computer Science, Software Engineering, or a related field
  • 5+ years of experience in software engineering, focusing on ML infrastructure, LLM inference, or model optimization
  • Hands-on experience deploying and serving LLMs on GPU hardware in production
  • Strong understanding of quantization and model compression techniques
  • Experience with high throughput inference engines
  • Solid understanding of GPU architecture, CUDA, and memory bandwidth in LLM inference
Nice to have
  • Experience writing or tuning custom CUDA / Triton kernels
  • Experience with multi GPU and distributed inference
  • Certifications in AWS or Azure architecture
  • Experience with CI/CD and cloud production deployment
What the job really is

As a Senior AI Engineer at OPSWAT, you will lead the deployment and optimization of Large Language Models (LLMs) for high-performance inference on GPU hardware. Your responsibilities include designing local LLM serving environments, optimizing model performance through quantization and compression techniques, and managing production serving infrastructure. You will collaborate with various teams to ensure efficient and cost-effective AI service delivery.

Things to weigh
  • No salary listed
  • Focus on GPU hardware and LLMs may limit exposure to other AI technologies
  • Fast-paced environment may require adaptability to changing priorities
Job score3.2/5
Benefits1/5
Freshness5/5
Career value5/5
Role clarity5/5
Pay transparency0/5

Applying to OPSWAT?

See how your résumé matches this role — and tailor it from what actually gets interviews.