Lead Data Engineer

Summary

Join Everstream Analytics, a technology-driven company revolutionizing Supply Chain Risk Analytics, as a Lead Data Engineer. You will manage a remote European data engineering team, architect data solutions, lead data initiatives, and develop real-time data processing pipelines. This role requires strong Python proficiency, extensive data engineering experience, and AWS cloud platform knowledge. You will collaborate with various teams, mentor junior engineers, and contribute to data-driven decision-making. Everstream offers impactful work, a collaborative culture, continuous learning opportunities, and competitive compensation, including a 100% remote position.

Requirements

• Deep understanding of Python, including data manipulation and analysis libraries like Pandas and NumPy or similar
• Extensive experience in data engineering, including ETL, data warehousing, and data pipelines
• Strong knowledge of AWS services, such as RDS, Lake Formation, Glue, Spark, etc
• Experience with real-time data processing frameworks like Apache Kafka/MSK
• Proficiency in SQL and NoSQL databases, including PostgreSQL, Opensearch, and Athena
• Ability to design efficient and scalable data models
• Strong analytical skills to identify and solve complex data problems
• Excellent communication and collaboration skills to work effectively with cross-functional teams

Responsibilities

• Manage and grow a remote team of data engineers based in Europe
• Collaborate with Platform and Data Architecture teams to deliver robust, scalable, and maintainable data pipelines
• Lead and own data engineering projects, including data ingestion, transformation, and storage
• Develop and optimize real-time data processing pipelines using technologies like Apache Kafka/MSK or similar
• Design and implement data lakehouses and ETL pipelines using AWS services like Glue or similar
• Create efficient data models and optimize database queries for optimal performance
• Work closely with data scientists, product managers, and engineers to understand data requirements and translate them into technical solutions
• Mentor junior data engineers and share your expertise. Establish and promote best practices

Benefits

• Impactful Work: Contribute to data-driven decision-making and product innovation
• Collaborative Culture: Work with a talented, passionate team from across the world
• Continuous Learning: Opportunities to learn new technologies and skills
• Competitive Compensation: A competitive salary and benefits package
• 100% Remote Position