Together AI is hiring a
Senior AI Infrastructure Engineer

Summary

The job is for a Senior Cloud Engineer at Together AI to build the next generation, multi-cloud PaaS platform with open-source technologies. The role requires deep technical skills, excellent communication, collaboration, and diplomacy. Experience in infrastructure-as-code, Kubernetes, containerization, and high performance or distributed cloud microservices architectures is essential.

Requirements

• 5+ years of professional software development experience and proficiency in at least one backend programming language (Golang desired)
• Demonstrated experience with high performance or distributed cloud microservices architectures
• Excellent understanding of low level operating systems concepts including multi-threading, memory management, networking and storage, performance, and scale
• 5+ years experience writing high-performance, well-tested, production quality code

Responsibilities

• Perform architecture and research work for decentralized AI workloads
• Work on the core, open-source Together AI platform
• Create services, tools, and developer documentation
• Create testing frameworks for robustness and fault-tolerance

Preferred Qualifications

• Experience with Kubernetes and containerization, VPNs, AI workloads, and blockchain based protocols a plus
• GPU programming, NCCL, CUDA knowledge a plus
• Experience with Pytorch or Tensorflow a plus

Benefits

• Competitive compensation, startup equity, health insurance, and other benefits
• Flexibility in terms of remote work