Remote Data Engineer

Summary

Join our team at Encora as a Senior Data Engineer to collaborate with Business Analyst teams, integrate new data sources into our ecosystem, and implement data lake solutions.

Requirements

• 6-10 years of strong development experience performing ETL and/or data pipeline implementations
• Python, Pyspark, AWS, EMR, Airflow, Data engg. SQL, Batch and Realtime data applications, building observability / metrics endpoints, ES, DevOps, CI/CD, GitHub, basic SOX/IT compliance knowledge
• Expert in programming languages, preferably Python
• Expert in delivering end-to-end analytic solutions using AWS services (EMR, Airflow, S3, Athena, Kinesis, Redshift)
• Experience in batch technologies like Hadoop, Hive, Athena, Presto
• Strong SQL skills, including query optimization, schema design, complex analytics
• Expert in data modeling and metadata management like Glue Catalog etc
• Experience in deployment tools like GitHub actions, Jenkins, AWS Code Pipeline etc
• Experience in data quality tools like Deque or Great Expectations is Nice To Have

Responsibilities

• Collaborate and partner with Business Analyst teams located in US and EMEA regions
• Interface across our Business Analyst and Data Science teams
• Play a key role in integrating new data sources into our data & analytical ecosystem over AWS cloud
• Implement data lake solutions while addressing common data concerns, such as data quality, data governance
• Set the standard for technical excellence as we move / build our data ecosystem into the cloud
• Understanding their common data problems and deliver scalable solutions