CentML is hiring a
Software Engineering Intern

Summary

The job is for a member of CentML's LLM inference team. The role involves writing code for core backend software, benchmarking, profiling, providing code reviews, and conducting unit tests. The ideal candidate has strong coding skills in Python and C/C++, knowledge of machine learning and performance engineering, and experience with training, deploying, or optimizing the inference of LLMs in production is a plus.

Requirements

• Strong coding skills in Python and C/C++
• Knowledgeable and passionate about machine learning and performance engineering
• Fundamentals in machine learning and deep learning
• Fundamentals in operating systems, computer architecture, and parallel programming

Responsibilities

• Write safe, scalable, modular, and high-quality (C++/Python) code for our core backend software
• Perform benchmarking, profiling, and system-level programming for GPU applications
• Provide code reviews, design docs, and tutorials to facilitate collaboration among the team
• Conduct unit tests and performance tests for different stages of the inference pipeline

Preferred Qualifications

• Experience with training, deploying, or optimizing the inference of LLMs in production is a plus
• Experience with performance modeling, profiling, debugging, and code optimization or architectural knowledge of CPU and GPU is a plus

Benefits

• An open and inclusive work environment
• Employee stock options
• Best-in-class medical and dental benefits
• Parental Leave top-up for 6 months
• Professional development budget
• Flexible vacation time to promote a healthy work-life blend