Senior Data Engineer

Summary

Join our dynamic team as a Senior Data Engineer and contribute to designing and implementing state-of-the-art data-driven solutions at SumerSports, a leading football intelligence technology company.

Requirements

• Proven experience as a data engineer, preferably with at least 3 or more years of relevant experience
• Some exposure designing cloud native solutions and implementations with Kubernetes
• Experience with Airflow or similar pipeline orchestration tools
• Strong background in Python programming
• Demonstrated experience in collaborating with Data Science and Engineering teams in a production environment
• Firm grasp on SQL and knowledge of relational data modeling schemas

Responsibilities

• Develop and maintain data pipelines using Databricks, Airflow, or similar orchestration systems
• Write robust, maintainable code in Python, following best practices and coding standards
• Design and implement solutions using Kubernetes, ensuring high availability and scalability
• Gather product data requirements and implement solutions to ingest, process, and serve that data to applications at scale
• Collaborate closely with Data Science and Engineering teams to build production-ready applications, optimizing for performance and scale
• Cultivate data from a wide range of sources for use by our data scientists and maintain documentation for data
• Design a modern data stack, with a keen focus on providing a platform for data scientists and ML engineers to develop production ready models and pipelines
• Work across Data Science and Engineering teams to ensure effective collaboration and communication
• Actively participate in code reviews, coaching, and mentoring within cross-functional teams
• Enhance the developer experience through improved tooling and reduced toil
• Stay informed of industry advancements and advocate for the adoption of new technologies and best practices

Preferred Qualifications

• Preference for experience with Databricks or Spark
• Familiarity with modern data stack design and strong opinions on data lifecycle management, testing, and governance

Benefits

• Comprehensive health insurance plan
• Retirement savings plan (401k) with company match
• Remote working environment