Azure Data Engineer

Summary

Join our team as a Data Engineer and leverage cutting-edge technologies like Power BI, Azure data engineering technologies, Teradata/Snowflake, and other Azure services to develop and support IT products and solutions. This full-time remote position requires 3-6 years of experience and immediate availability. You will be responsible for developing and deploying solutions for business users, working with various Azure services, and collaborating with a project team. The role demands proficiency in ETL, data pipelines, data flow techniques, Python, PySpark, and SQL. Experience with Azure DevOps CI/CD pipelines and data warehouse concepts is essential.

Requirements

• 3 to 6 Years of IT & Azure Data engineering technologies experience
• Prior experience in ETL, data pipelines, and data flow techniques using Azure Data Services
• Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse, and file formats like JSON & Parquet
• Experience in creating ADF Pipelines to source and process data sets
• Experience in creating Databricks notebooks to cleanse, transform, and enrich data sets
• Development experience in the orchestration of pipelines
• Good understanding of SQL, Databases, and data warehouse systems, preferably Teradata
• Experience in deployment and monitoring techniques
• Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources
• Experience in handling operations/Integration with source repository
• Must have good knowledge of Data Warehouse concepts and Data Warehouse modelling
• Working knowledge of SNO, M, S, including resolving incidents, handling Change requests /Service requests, and reporting on metrics to provide insights

Responsibilities

• Develop and support IT products and solutions using Azure data engineering technologies and deploy them for business users
• Leverage and enhance existing technologies in the area of Data and analytics Solutions like Power BI, Azure data engineering technologies, Teradata/Snowflake, and other Azure services
• Collaborate with the project team to understand tasks to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data
• Work with project leaders to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data
• Think and work agile, from estimation to development, including testing, continuous integration, and deployment
• Manage numerous project tasks concurrently and strategically, prioritizing when necessary
• Proven ability to work as part of a virtual team of technical consultants working from different locations (including onsite) around project delivery goals