Senior Machine Learning Research Engineer

Summary

Join our team as a highly skilled research engineer to drive the initiative of creating a comprehensive benchmark to assess the performance of large language models (LLMs) on software development tasks and generating new content and data specifically to improve state-of-the-art LLMs on software engineering tasks.

Requirements

• Advanced degree (Master's) in Computer Science, Machine Learning, Data Science, or a related field
• Proven experience in machine learning, with a strong emphasis on LLMs and natural language processing
• Demonstrated experience in preparing and conducting evaluations of machine learning models
• Experience developing large-scale data pipelines for research datasets
• Proficiency in programming languages such as Python and familiarity with machine learning frameworks (e.g., TensorFlow, PyTorch)

Responsibilities

• Design & develop evaluation metrics and benchmark methodologies
• Conduct experiments to evaluate the performance of various LLMs on software engineering tasks
• Develop & deploy data pipelines for LLM training and evaluation datasets
• Contribute to the development and deployment of state-of-the-art machine learning models
• Collaborate with cross-functional teams
• Stay abreast of the latest machine learning and LLMs advancements

Preferred Qualifications

• Experience in benchmarking and performance evaluation of LLMs & designing high-scale data pipelines
• Published research in relevant fields
• Familiarity with coding challenges and competitive programming

Benefits

• One-time home office set up stipend
• Monthly Remote Work Enablement Stipend
• Professional Development Reimbursement
• Wellbeing Benefits (Headspace, etc)
• Flexible paid time off
• Paid leave for new parents
• Flexible work hours
• Insurance for all employees (term life, personal accident, medical) along with medical insurance for their dependents
• Employee stock options