Data Engineer

Summary

Join Two Circles, a leading global sports marketing agency, as a Cloud Data Engineer and contribute to our rapidly growing Fan Intelligence Platform team. You will leverage your expertise in AWS services (Spark, Kinesis, Airflow) to design and implement data pipelines, ensuring high data quality and reliability. This role requires collaboration with cross-functional teams and a commitment to development best practices. You will also mentor other engineers and contribute to our DevOps culture. We offer a collaborative environment, professional growth opportunities, and the chance to make a significant impact in the sports and entertainment industries.

Requirements

• 3+ years of data engineering & big data systems experience with platforms like MySQL, Postgres, SQL Server, and Redshift
• 2+ years working with AWS services (EC2, Lambda, S3, DynamoDB, Kinesis, EMR, Redshift)
• Experience with various orchestration and batch processing technologies like Apache Airflow
• Proficiency in Python, C#, and Scala
• Strong experience with containerization such as Docker
• Familiarity with monitoring tools for data pipeline performance such as New Relic
• Experience developing against APIs and building scalable high systems
• Experience with writing unit tests using frameworks such as PyTest for quality assurance
• Understanding architectural differences between streaming and batch-oriented integrations
• Strong analytical and problem-solving skills
• Strong written and verbal English skills, and an ability to articulate technical information efficiently
• Familiarity with Continuous Delivery systems and Lean-Agile methodologies (Scrum / Kanban)
• Comfort interacting with clients or vendors directly
• Self-starter with strong organizational skills and the ability to prioritize across initiatives
• Thrives in a fast-paced, collaborative environment

Responsibilities

• Work as part of a cross-functional product team to deliver a high-quality SaaS based data platform
• Design and implement data pipelines with a clear focus on data quality and reliability
• Partner with both Product Management and stakeholders, technical, and non-technical team members to deliver our vision, roadmap, and data strategy
• Act as an advocate for development best practices including technical design reviews, implementing test plans, monitoring/alerting, peer code reviews, and documentation
• Contribute to our DevOps culture and participate in ownership of our designs through production operations
• Support the ongoing maintenance and operations of the data platform
• Mentor and support other engineers in the team

Benefits

• Professional Growth: Work on a variety of projects, enhancing your testing skills across different applications and technologies
• Impactful Work: Play a key role in delivering high-quality solutions that shape the future of the sports and entertainment industries
• Collaborative Environment: Be part of a team that values ideas, fosters a supportive atmosphere, and encourages continuous learning and improvement
• Innovative Culture: Join a company committed to revolutionizing fan and stakeholder engagement through cutting-edge technology