Senior Data Engineer

Summary

Join Allwyn Lottery Solutions as a Data Engineer and play a pivotal role in architecting and developing serverless AWS solutions for real-time data processing. You will be responsible for designing data ingestion streams, developing ETL/ELT routines, and integrating with various systems. This role requires extensive experience with AWS data products, data warehousing, and various BI tools. You will lead data integration with marketing technologies and provide 3rd line support to clients. The position offers a dynamic team environment, attractive compensation, comprehensive benefits, and opportunities for professional development.

Requirements

• Extensive and broad experience across the full stack of AWS data products
• Worked with traditional data warehousing, ERP systems, high volume e-commerce sites, digital marketing data sets and a variety of BI and Analytic tools
• Advanced AWS Serverless design and development experience specifically
• Streaming technologies such as SQS, Kinesis, MSK
• NoSQL stores such as DynamoDB
• Serverless compute development with Lambda and Glue
• Orchestration of serverless compute with MWAA and Step functions
• SQL data stores such as AWS Athena and Aurora
• Storage solutions, mainly S3
• API development
• System monitoring with Cloudwatch
• Roles and Policies with IAM
• ML and AI with Sagemaker and Bedrock
• Advanced knowledge of Python and popular libraries such as Panda Data Frames
• Awareness of AWS prices and charges to enable development of cost effective solutions
• Experience of developing high volume and highly scalable data integrations using a variety of techniques and technologies including files, SQL, queues and APIs
• Experience with integrating to ERP, Ecommerce and CRM integrations over a range of interfaces and formats including SQL, JSON, XML and CSV
• Strong experience with performance tuning and monitoring techniques at an application and data platform level
• Highly developed data modelling and SQL skills

Responsibilities

• Architect robust data ingestion streams for real-time data processing, marketing technology and analytics
• Contribute to the platform logical and physical data models
• Develop ETL, ELT routines for structured analytics
• Develop a range of integrations to APIs, flat files and other external systems to support broader ecosphere
• Work with software developers to enhance gaming platform integration
• Support testing and deployment
• Develop automated monitoring, fault recovery and diagnosis
• Document output to a high level
• Mentor and train localised application support specialists
• Lead the development of AWS data solutions
• Lead adoption of new integration and data technologies
• Input into the AWS technology roadmap and strategy
• Champion best practice and standardisation of development
• Deliver best in class solutions in terms of robustness, recovery and resilience
• Deliver continuous improvement to development methodologies and automation

Benefits

• Attractive salary and a bonus plan
• Health and life insurance for you and your family
• Well-being allowance
• Monthly lunch allowance
• Developmental 360° feedback framework
• Unlimited Training options and tools
• Extensive leave plan
• Employee Assistance Program with specialized Counselors / Licensed Psychologists
• Flexible working arrangements (fully remote/hybrid)
• Apple equipment and top-notch office technology to support our hybrid working