Data Engineer

Summary

Join our dynamic team at Creative Chaos as a highly skilled Data Engineer with extensive experience in Azure Data Lake. You will be responsible for architecting, developing, and optimizing data pipelines for efficient large dataset processing. This role requires designing and implementing robust data pipeline solutions within Azure Data Lake, integrating and transforming data from various sources, and ensuring data quality and integrity. Collaboration with cross-functional teams is crucial to understand data requirements and develop scalable solutions. You will also monitor and optimize data processing workflows, document processes, and stay updated on new Azure technologies. The position offers excellent benefits including paid time off, work from home options, health insurance, OPD, and training and development.

Requirements

• Bachelor's degree in Computer Science, Information Technology, or a related field
• A minimum of 5 years of experience working as a Data Engineer, with a strong emphasis on Azure Data Lake
• Proficiency in Azure Data Services, particularly Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics
• Demonstrated experience with data modeling, ETL processes, and data warehousing solutions
• Strong programming skills in Python, SQL, and familiar with Java or C#
• Excellent problem-solving skills and a detail-oriented approach to work
• Ability to communicate technical concepts clearly to non-technical stakeholders
• Strong organizational skills with the ability to manage multiple priorities and meet deadlines

Responsibilities

• Designing and implementing robust data pipeline solutions within Azure Data Lake
• Integrating and transforming data from various sources to enable comprehensive analytics and reporting
• Ensuring data quality and integrity, implementing data governance practices
• Collaborating with cross-functional teams to understand data requirements and develop scalable solutions
• Monitoring and optimizing data processing workflows for performance and reliability
• Documenting processes and architecture to ensure maintainability and scalability
• Staying abreast of new Azure technologies and best practices for data engineering

Benefits

• Paid Time Off
• Work From Home
• Health Insurance
• OPD
• Training and Development