Data Engineer

Summary

Join Sporty, a leading sports betting website with millions of weekly active users, as a Data Engineer. You will play a crucial role in designing, building, and maintaining data pipelines and architectures for our machine learning and data science initiatives. This involves ensuring high-quality data, optimizing data delivery, and collaborating with various teams. The role requires a Bachelor's degree or equivalent experience in a related field, along with 3+ years of experience in data engineering. You'll need expertise in SQL, data modeling, and cloud data services (AWS). Sporty offers a dynamic work environment with flexible hours, quarterly bonuses, top-of-the-line equipment, and other benefits.

Requirements

• Bachelor’s degree, or equivalent experience, in Computer Science, Engineering, Mathematics, or a related technical field
• 3+ years of experience in data engineering, data platforms, BI or related domain
• Experience in successfully implementing data-centric applications, such as data warehouses, operational data stores, and data integration projects
• Experience with large-scale production relational and NoSQL databases
• Experience with data modelling
• General understanding of data architectures and event-driven architectures
• Proficient in SQL
• Familiarity with one scripting language, preferably Python
• Experience with Apache Airflow & Apache Spark
• Solid understanding of cloud data services: AWS services such as S3, Athena, EC2, RedShift, EMR (Elastic MapReduce), EKS, RDS (Relational Database Services) and Lambda

Responsibilities

• Design, develop and maintain scalable batch ETL and near-real-time data pipelines and architectures for various parts of our business, on fast and versatile data sources with millions of changes per day
• Ensure all data provided is of the highest quality, accuracy, and consistency
• Identify, design, and implement internal process improvements for optimising data delivery and re-designing infrastructure for greater scalability
• Builds out new API integrations to support continuing increases in data volume and complexity
• Communicate with data scientist, MLOps engineers, product owners and BI analysts in order to understand business processes and system architecture for specific product features

Preferred Qualifications

• Understanding of ML Models
• Understanding of containerisation and orchestration technologies like Docker/Kubernetes
• Relevant knowledge or experience in the gaming industry

Benefits

• Quarterly bonuses
• We have core hours of 10am-3pm in a local timezone, but flexible hours outside of this
• Top-of-the-line equipment
• Referral bonuses
• 28 days paid annual leave
• Annual company retreat
• Highly talented, dependable co-workers in a global, multicultural organisation
• Payment via DEEL, a world class online wallet system
• Our teams are small enough for you to be impactful
• Our business is globally established and successful, offering stability and security to our Team Members