Remote Data Engineer

Summary

Tiger Analytics is hiring a Senior Azure Data Engineer for its expanding Data Engineering practice. The candidate should have a Bachelor's degree in Computer Science or similar field, 8+ years of experience in Data Engineering and several years in the Analytics space, strong proficiency in Scala, Kafka, ADF, Python programming, SQL queries, Apache Spark, Unix environment, Azure Databricks, data wrangling, advanced analytic modeling, and good communication and organizational skills. The role offers significant career development opportunities.

Requirements

• Bachelor’s degree in Computer Science or similar field
• 8+ years experience in Data Engineering
• Several years of experience in the Analytics space
• Strong Proficiency in Scala - coding experience a must
• Strong Proficiency in Kafka and ADF for data pipelines /migration experience a must (Azure Synapses)
• Experience with real time streaming, Kafka, and API Integration
• Experience in PySpark
• Strong Proficiency in Python programming
• Strong Proficiency in SQL queries
• Experience building data pipelines using Azure stack
• Experience using Apache spark
• Good working experience on Delta Lake and ETL processing
• Prior experience of working in a Unix environment
• Experience in harmonizing raw data into a consumer-friendly format using Azure Databricks
• Experience extracting/querying/joining large data sets at scale
• Experience building data ingestion pipelines using Azure Data Factory to ingest structured and unstructured data

Responsibilities

Combine data from different sources and align data systems with business goals

Preferred Qualifications

Experience in data wrangling, advanced analytic modeling is preferred

Benefits

This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility