OctoML is hiring a
Senior MLSys Engineer

Summary

OctoAI is seeking a highly skilled Machine Learning Systems Engineer with experience in CUDA Kernel optimization to join their team. The engineer will be responsible for driving advancements in GPU performance optimizations and contributing to cutting-edge AI projects. A Bachelor's, Master’s or PhD's degree in Computer Science, Electrical Engineering, or a related field is required, along with strong programming skills in C/C++ and Python. Experience with kernel optimizations on CUDA or other accelerators is preferred. The role offers a competitive salary ranging from $175,000 to $240,000 per year, comprehensive healthcare benefits, flexible work options, work-life balance policies, parental benefits, and more.

Requirements

• Bachelor's, Master’s or PhD’s degree in Computer Science, Electrical Engineering, or a related field
• Strong programming skills in C/C++ and Python
• Deep understanding and experience in GPU performance optimizations
• Proven experience with kernel optimizations on CUDA or other accelerators

Responsibilities

• Develop and optimize high-performance computing kernels with a focus on GPU acceleration
• Implement and enhance programming solutions in C/C++ and Python
• Deep dive into GPU performance optimizations to maximize efficiency and speed
• Work on kernel optimizations specifically for CUDA or other accelerators

Preferred Qualifications

• (Optional but preferred) Experience with innovative OSS projects like Cutlass, FlashAttention, mlc-llm, vllm
• (Optional but preferred) Experience with machine learning compilers or frameworks such as TVM, MLIR, Pytorch, Tensorflow, ONNX Runtime, TensorRT

Benefits

• Comprehensive Healthcare: Fully covered premiums for employees and their dependents, including Medical, Dental, Vision, Life Insurance, and Disability Insurance
• Competitive Compensation: A mix of salary, bonuses, and meaningful stock options
• Financial Benefits: Flexible Spending Accounts for healthcare and dependent care, as well as a Health Savings Account for those opting for a high deductible plan
• Future Planning: 401(k) options
• Flexible Work Options: Remote and teleworking capabilities
• Work-Life Balance: Flexible work hours, generous time off policies, company-sanctioned downtime twice a year, and company-paid holidays
• Parental Benefits: Comprehensive parental leave plans for all new parents
• Volunteer Time Off (VTO): Four days a year to give back and make a difference in communities
• Additional Leaves: Including disability, paid family medical leave, and paid military leave