Senior Data Engineer

Summary

Join Underdog, the fastest-growing sports gaming company, as a Senior Data Engineer. You will build robust data pipelines for Marketing, Product, Analytics, and Data Science teams, collaborating closely with them to understand their data needs and deliver scalable solutions. This role involves hands-on pipeline development and shaping Underdog's data platform. You will develop data pipelines, maintain production datasets, design and optimize scalable data platform infrastructure, and implement monitoring and logging mechanisms. The position requires strong communication and collaboration skills, and a proactive problem-solving approach. Underdog offers a competitive salary, equity, and various benefits.

Requirements

• 5+ years of experience building scalable data pipelines in a cloud-native environment (AWS, GCP, or Azure)
• 3+ years of experience using dbt, Flink, or Spark for data transformations and BI tools such as Sigma or Looker
• Advanced proficiency with Python and SQL
• Hands-on experience with streaming data infrastructure such as Apache Kafka, Apache Flink, GCP Datastream or AWS Kinesis
• Experience with DevOps practices such as CI/CD pipelines, and infrastructure-as-code tools (e.g. Terraform, CDK)
• Strong ownership mindset; you’re focused on delivering results in a fast-paced, entrepreneurial environment
• A proactive problem solver who finds and implements opportunities to improve systems and processes
• Excellent communication skills, with the ability to influence and collaborate effectively across teams

Responsibilities

• Develop data pipelines and maintain production quality datasets that support Underdog’s analytics, data science, and marketing teams
• Design, build, and optimize scalable data platform infrastructure to support batch and real-time data processing and storage in the cloud
• Collaborate with analytics, data scientists, engineers, and other business stakeholders to understand data requirements and translate them into scalable technical solutions
• Implement and maintain monitoring, alerting, and logging mechanisms to ensure the health and performance of the pipelines and platforms
• Perform validation and build data quality checks on production datasets and ensure there are minimal data quality issues
• Communicate continuously about progress, blockers, and resolution steps to all relevant stakeholders

Preferred Qualifications

• Strong interest in sports
• Prior experience in the sports betting industry
• Experience working highly regulated industries and familiarity with data privacy and compliance frameworks (e.g. GDPR, CCPA)
• Knowledge of ML concepts, with some experience in building ML platforms

Benefits

• Unlimited PTO (we're extremely flexible with the exception of the first few weeks before & into the NFL season)
• 16 weeks of fully paid parental leave
• A $500 home office allowance
• A connected virtual first culture with a highly engaged distributed workforce
• 5% 401k match, FSA, company paid health, dental, vision plan options for employees and dependents