Data Engineer

Summary

Join our team as a Data Engineer on a B2B contract basis, working remotely from Poland for our client, Coforge. This role focuses on designing, building, and maintaining scalable data pipelines and platforms on AWS. You will collaborate with cross-functional teams, ensuring data accuracy, accessibility, and structure for data-driven decision-making. The ideal candidate possesses strong data engineering, cloud technologies, and infrastructure automation skills. Occasional travel may be required. This position offers the opportunity to work with cutting-edge technologies and contribute to a dynamic team.

Requirements

• Strong experience as a Data Engineer working on cloud-based data solutions
• Proficiency in AWS services (e.g., S3, Glue, Lambda, Redshift, etc.)
• Advanced Python programming skills for data processing and automation
• Hands-on experience with CI/CD tools and practices (e.g., GitLab CI, Jenkins)
• Experience with AWS CDK (Cloud Development Kit) for infrastructure as code
• Solid understanding of software engineering best practices, including version control, testing, and documentation

Responsibilities

• Design, develop, and maintain scalable and reliable data pipelines on AWS
• Build and automate data workflows and ETL processes using Python and AWS services
• Collaborate with data scientists, analysts, and other engineers to understand data requirements and implement effective data solutions
• Use AWS CDK to provision and manage cloud infrastructure following best practices
• Implement CI/CD pipelines to streamline development and deployment workflows
• Ensure data quality, integrity, and governance across all systems
• Monitor data pipeline performance and troubleshoot issues proactively
• Participate in code reviews and contribute to continuous improvement efforts

Preferred Qualifications

• Familiarity with data modeling and data warehousing concepts
• Experience with containerization (Docker, ECS/EKS) is a plus
• Knowledge of data security and compliance requirements
• Prior experience working in an Agile environment