Staff Software Engineer, Machine Learning Platform

Summary

Join Discord's Machine Learning Platform (MLP) team as a highly experienced Software Engineer. You will design and build the platform used by ML engineers and data scientists to understand and delight Discord users while ensuring their safety. This role involves evaluating and integrating new ML frameworks and tools, collaborating with model builders, setting best practices, and creating foundational datasets and models. You will work with large datasets and distributed systems, focusing on real-time data processing and model serving at scale. The position is US-based and offers a competitive salary, equity, and benefits.

Requirements

• 8+ years of experience working as a software engineer in data or backend with exposure to large datasets or distributed systems
• 4+ years working on platforms or infrastructure
• 2+ years working on machine learning platforms
• Know-how with orchestration systems (such as Airflow, Dagster, or Argo)
• You've put machine learning models into production

Responsibilities

• Design and build the platform ML engineers and data scientists use to understand and delight Discord's users and keep them safe
• Evaluate and integrate new machine learning frameworks and tools to ensure that Discord keeps up with the fast moving world of ML, including LLMs and generative AI
• Collaborate with model builders to ensure we have a smooth path from idea to production
• Set best practices in machine learning at Discord
• Create foundational datasets and models

Preferred Qualifications

• Experience with real-time data processing (Spark, Flink, Dataflow, Kafka, Pulsar, etc.)
• Experience debugging and maintaining live production systems on Kubernetes
• Experience building ML models using modern frameworks

Benefits

• Equity
• Benefits