Remote Lead Data Engineer

Summary

Join our team as a Lead Data Engineer and provide technical guidance to data teams, develop advanced analytics solutions, and ensure company standards are met.

Requirements

• 7-10 years of strong development experience performing ETL and/or data pipeline implementations
• Expert in programming languages, preferably Python
• Expert in delivering end-to-end analytic solutions using AWS services (EMR, Airflow, S3, Athena, Kinesis, Redshift)
• Experience in batch technologies like Hadoop, Hive, Athena, Presto
• Strong SQL skills, including query optimization, schema design, complex analytics
• Expert in data modeling and metadata management like Glue Catalog etc
• Experience in deployment tools like GitHub actions, Jenkins, AWS Code Pipeline etc
• Experience in data quality tools like Deque or Great Expectations is Nice To Have
• Strong Experience in SQL, EMR, AWS, Pyspark, Python, Triggers, Stored procedures

Responsibilities

• Collaborate and partner with Business Analyst teams located in US and EMEA regions
• Interface across our Business Analyst and Data Science teams
• Play a key role in integrating new data sources into our data & analytical ecosystem over AWS cloud
• Implement data lake solutions while addressing common data concerns, such as data quality, data governance
• Set the standard for technical excellence as we move / build our data ecosystem into the cloud
• Understanding their common data problems and deliver scalable solutions