Gpu Engineer

Summary

Join Reka, a globally distributed foundation model startup, as an experienced GPU Engineer. You will design and implement improvements to our large-scale training infrastructure, directly impacting model training performance and efficiency. This role requires strong Python and PyTorch skills, experience with low-level GPU code (CUDA, Triton), and scaling GPU jobs on large compute clusters. Preferred qualifications include knowledge of advanced filesystems (Ceph) and robust monitoring systems. Reka offers an elite team, massive market opportunity, mission-driven environment, inclusive culture, and generous benefits including 5 weeks of paid leave and comprehensive healthcare.

Requirements

• Strong engineering skills with fluency in Python and PyTorch or other acceleration libraries
• Experience writing and debugging low-level GPU code (CUDA, Triton) and debugging hardware errors
• Experienced in scaling up GPU jobs via large-scale compute clusters using Slurm or Kubernetes

Responsibilities

• Design and implement improvements to our large scale training infrastructure
• Directly help make technical decisions to optimise our models' training performance and efficiency

Preferred Qualifications

• Knowledge of advanced filesystems, particularly Ceph, and their integration and optimization in large systems
• Proficient in implementing robust monitoring systems for performance tracking and anomaly detection

Benefits

• 5 weeks of paid leave to recharge
• Comprehensive healthcare benefits including vision and dental
• Additional perks that support your well-being
• Visa Support : We provide visa assistance, including H1B and OPT transfers, for US employees to ensure a smooth transition and support your career with us