Deepgram is hiring a
Senior Software Engineer, AI Inference, Remote - Worldwide
![Logo of Deepgram](https://cdn.jobscollider.com/logo/deepgram-f884.webp)
Senior Software Engineer, AI Inference
🏢 Deepgram
💵 ~$150k-$222k
📍Worldwide
Please let Deepgram know you found this job on JobsCollider. Thanks! 🙏
Summary
The job is for a Backend Engineer focused on AI Inference at Deepgram. The role involves implementing inference code, developing production services, debugging complex system issues, building tooling for internal analysis, experimenting with optimization techniques for ML workloads on NVIDIA GPUs, and collaborating with the research team.
Requirements
- The ability to work collaboratively in a fast-paced environment and adapt to changing priorities
- Proven industry experience building and shipping production services
- Strong confidence in a lower-level language like C, C++, or Rust
- Experience slicing large projects or initiatives into smaller experiments or incremental improvements
- Expertise in a ML framework like Torch or Tensorflow
- Experience with GPU programming using tools like CUDA or libraries like cuDNN, cuBLAS, etc
Responsibilities
- Implement inference for novel model architectures developed by Deepgram’s trailblazing research team
- Develop, test, and deploy application code for massive-scale production services
- Debug complex system issues that include networking, scheduling, and high-performance computing interactions
- Build tooling for internal analysis and benchmarking to identify opportunities for efficiency improvements
- Experiment with optimization techniques for ML workloads on NVIDIA GPUs and ship the key wins to prod
Preferred Qualifications
- Extensive professional experience with Rust and C++
- Experience optimizing ML workloads in production
- Familiarity with GPU hardware architecture and its impact on inference pipelines
Share this job:
Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.
Similar Jobs
- 💰~$48k-$59k📍Worldwide
- 💰~$164k-$241k📍United States
- 💰~$124k-$156k📍India
- 💰~$36k-$72k📍Romania
- 💰~$130k📍Moldova
- 💰~$130k📍Czech Republic
- 💰$170k-$227k📍Worldwide
- 💰$150k-$225k📍United States
- 💰$158k-$269k📍Canada, United States
Please let Deepgram know you found this job on JobsCollider. Thanks! 🙏