Remote Staff Engineer, Big Data

Summary

Join our dynamic Digital Product Engineering company as a Lead Consultant in Azure Data Platform Engineering & Ops! You will lead and mentor a team of data engineers, architect and implement robust data solutions on Microsoft Azure, and oversee data pipeline development. Responsibilities include managing platform operations, implementing automation strategies, and ensuring data security and compliance. A Bachelor's or Master's degree in a related field and extensive Azure experience are required. Azure certifications are highly desirable. We offer a non-hierarchical work culture and opportunities for skill development.

Requirements

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
• Extensive experience in data engineering, data architecture, and cloud platform operations, with a focus on the Microsoft Azure ecosystem
• In-depth knowledge of Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB
• Proficiency in designing and optimizing data pipelines, ETL/ELT processes, and data integrations
• Strong understanding of data governance, security best practices, and compliance standards in a cloud environment
• Hands-on experience with automation, infrastructure as code (IaC), and DevOps principles
• Excellent leadership and team management skills, with a proven ability to guide and inspire technical teams

Responsibilities

• Lead and mentor a team of data engineers and operations specialists, providing technical guidance, fostering skill development, and promoting a culture of excellence
• Collaborate with stakeholders to design scalable and efficient data architectures using Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB
• Oversee the development of data pipelines, ETL/ELT processes, and data integrations, ensuring data quality, optimal performance, and adherence to best practices
• Manage the day-to-day operation and maintenance of the Azure Data Platform, including monitoring, troubleshooting, and performance optimization
• Implement automation strategies and DevOps practices to streamline deployment, monitoring, and management of data solutions, ensuring efficient operations and rapid response to issues
• Data Security and Compliance
• Capacity Planning and Scalability
• Collaboration and Communication
• Performance Monitoring and Optimization

Preferred Qualifications

Azure certifications such as Microsoft Certified: Azure Solutions Architect Expert or equivalent