Summary
Join IT Labs as a Senior Data Engineer where you'll craft and execute technical vision for state-of-the-art AWS-based data pipelines, support new product developments, and ensure systems maintain optimal performance levels.
Requirements
- At least 5 years in a Data Engineering position
- Expert knowledge in .Python
- Proven experience with AWS technologies for building and managing data pipelines and performing ETL processes
- Proficient in using AWS warehousing and analysis tools like Redshift, Quicksight, and Athena
- Skilled in utilizing infrastructure-as-code practices, including CloudFormation, CDK, and Serverless frameworks
- Expertise in designing and reviewing complex Python programs, ensuring compliance with style and security standards
- Demonstrated ability to optimize SQL queries for maximum performance
- Hands-on experience with AWS RDS
- Ability to empathize with end-users to inform and guide decision-making processes
- Excellent analytical thinking and problem-solving capabilities
- Superior written and verbal communication skills
- Fluent English both spoken and written
Responsibilities
- Craft and execute a technical vision for state-of-the-art AWS-based data pipelines
- Support new product developments and data science initiatives while ensuring systems maintain optimal performance levels
- Spend around 50% of your time building and enhancing data lakes and data pipelines
- Spend about 20% on defining and implementing DataOps methodologies
- Spend roughly 20% of your time writing and optimizing queries and reports
- Spend around 10% of your time supporting and monitoring existing databases
Benefits
- Fully Remote
- Choose your contract: Individual or B2B contract
- Get your salary in USD