Lead Data Engineer

Summary

Join Tiger Analytics' growing team of analytics experts as a Data Engineering Lead! With 9+ years of experience leading data engineering engagements, you will manage complex data engineering initiatives, including stakeholder and risk management, and offshore team coordination. You'll leverage your expertise in Azure, Databricks, SQL, and Python to build data pipelines, work with Apache Spark and Delta Lake, and harmonize raw data. This role requires strong communication skills at both executive and execution levels. The position offers significant career development opportunities in a fast-growing and challenging environment.

Requirements

• Proficient in Azure, Databricks, SQL, and Python
• Experience with on-premises to cloud migration
• Proficient in Python programming
• Proficient in SQL queries
• Experience building data pipelines using Azure stack
• 2+ years of experience using Apache Spark
• Experience with Delta Lake and ETL processing
• Experience working in a Unix environment
• Experience harmonizing raw data into a consumer-friendly format using Azure Databricks
• Experience extracting, querying, and joining large datasets at scale
• Experience building data ingestion pipelines using Azure Data Factory to ingest structured and unstructured data
• Strong communication and organizational skills
• 9+ years’ experience leading DE engagements

Responsibilities

• Lead data engineering engagements
• Manage complex data engineering initiatives
• Manage stakeholders
• Manage risks
• Coordinate offshore teams (6-10 members)
• Communicate effectively at executive and execution levels

Preferred Qualifications

• Experience in data wrangling
• Experience in advanced analytic modeling