Staff Software Engineer, Data Platform

Summary

Join Discord's Data Platform team as a Staff Software Engineer and contribute to designing, developing, and maintaining our data infrastructure and services. You will collaborate with cross-functional teams to deliver cutting-edge solutions driving business insights. Responsibilities include designing scalable data infrastructure, working on real-time and batch data pipelines, identifying and resolving bottlenecks, partnering with various teams, driving data governance, mentoring engineers, and exploring emerging technologies. The role requires 7+ years of software engineering experience with a focus on distributed systems or data infrastructure, expertise in data pipelines, proficiency in programming languages, solid database experience, cloud platform familiarity, and strong problem-solving and communication skills. A competitive salary, equity, and benefits are offered.

Requirements

• 7+ years of experience in software engineering with a focus on distributed systems or data infrastructure
• Expertise in designing, building, and optimizing data pipelines (batch and real-time) using tools like Kafka, Spark, Flink, Airflow/Dagster, or similar
• Proficiency in programming languages such as Python, Java, Rust, or similar
• Solid experience with database systems (SQL and NoSQL) and strong knowledge of data modeling principles
• Familiarity with cloud platforms (AWS, GCP, or Azure) and containerization tools (Docker, Kubernetes), and microservices architecture
• Understanding of data governance, security, and monitoring best practices
• Strong problem-solving skills and the ability to independently tackle complex technical challenges
• Excellent communication and collaboration skills, with a track record of working across teams
• Proven ability to thrive in a fast-paced environment

Responsibilities

• Design, implement, and maintain scalable data infrastructure to process, store, and serve petabytes of data efficiently
• Work on real-time and batch data pipelines, ensuring they are reliable, performant, and ergonomic for stakeholders
• Identify and resolve bottlenecks in our data ecosystem, driving innovations that improve platform scalability and developer productivity
• Partner with data scientists, data engineers, product managers, and other engineering teams to understand customer needs and deliver effective data solutions
• Drive data governance, quality, and security to ensure the integrity and reliability of our data systems
• Guide and mentor engineers on the team while setting a high bar for technical excellence
• Explore emerging technologies and industry best practices to keep Discord’s data platform at the forefront of innovation

Preferred Qualifications

• A strong passion for Discord and gaming
• Full-stack development or product engineering experience

Benefits

• Equity
• Benefits