Data Engineer II/III

Summary

The Data Engineer III is responsible for managing and operating various data platforms such as Azure Data Lake Storage, Databricks, Azure Data Factory, Synapse, Snowflake, etc. The role requires extensive problem-solving skills, good communication skills, and a Bachelor's degree in computer science or related field with 4+ years of experience in configuring and managing Azure data analytics solutions.

Requirements

Good hands on Azure Data Lake Storage, Databricks, Azure Data Factory, Synapse, Snowflake, Azure event hub, Tidal, Pyramid, Collibra, PowerBI, Tableau, MSTR, Alteryx. Ability to read and write sql and stored procedures

Responsibilities

Provides Level 3 operational support covering: Resolving pipeline issues, Proactive monitoring for sensitive batches, Creating/updating runbooks as needed, Configuration changes to batches and infrastructure (cloud platform), Manually controlling the pipeline runs due to scheduled maintenance, Handling user requests, DR testing twice a year, Dev and Prod data sync, Weekly change board representation

Preferred Qualifications

Excellent written and verbal communication skills. Ability to communicate technical info and ideas so others will understand. Ability to successfully work and promote inclusiveness in small groups

Benefits

Schedule flexibility to include working a weekend day regularly and holidays as required by the business for 24/7 operations. Occasional travel, less than 10%