Remote Staff Engineer, Big Data

Summary

Join our dynamic team as a skilled Data Engineer to build efficient data solutions that ensure high performance and data quality.

Requirements

• Minimum of 8+ years of experience in Data Engineering, focusing on batch data processing
• Hands-on experience with Azure data services (Azure Data Factory, Data Lake, etc.)
• Strong understanding of ETL processes, data integration, and data modeling
• Experience with data storage solutions such as Azure Data Lake and SQL databases

Responsibilities

• Design, develop, and maintain scalable batch ETL/ELT pipelines using Azure Data Factory and other Azure services
• Collaborate with data architects and cross-functional teams to translate business requirements into technical solutions
• Ensure data processing pipelines are optimized for performance, reliability, and cost-effectiveness
• Perform data integration, cleansing, and validation to ensure high data quality
• Monitor and troubleshoot batch processing jobs to ensure timely and accurate data delivery
• Ensure compliance with data governance and security standards