Senior Data Engineer

Summary

Join Gorilla Logic as a Senior Data Engineer to organize client system data into dashboards and on-demand reports. This highly technical role demands strong database and reporting expertise in delivering cutting-edge solutions. Success hinges on effectively collaborating with teammates, employing critical thinking, self-motivation, enthusiasm, and determination. You will act as a bridge between engineering and analytics, build ETL processes and an Enterprise Data Warehouse (EDW), and contribute to data platform governance. The position requires expertise in data pipelines, RDBMS, cloud platforms (AWS preferred), and big data infrastructure. Strong communication and customer focus are essential.

Requirements

• Experience in designing and building Data pipeline using at least one traditional ELT/ETL tools
• Knowledge of Modern techniques and tool for Data Engineering concepts, especially Data ingestion, Data Quality control, Curate & Enrich, distribute
• Experience in traditional RDBMS
• Experience in at least one cloud platform from AWS
• Experience with tools similar to AWS appflow that can automate data flows between SaaS and AWS services
• Experience in designing and building high performance data pipelines
• Advance experience in SQL
• Experience in event driven architectures (Pub/Sub, Kafka, RabbitMQ, AMQP, SNS, etc…)
• Experience with Big Data Infrastructure (e.g. Snowflake or Hadopp)
• Experience of overall data governance concepts
• Strong customer focus and ability to recognize impact of decisions on end users
• Strong verbal and written communications skills and ability to interact with team members and external customers
• 7+ years experience working with Application Development teams

Responsibilities

• Act as a bridge between engineering and analytics to provide high fidelity data to the business
• Work directly with the data team to build out a new ETL process
• Work directly with the engineering team to build a new Enterprise Data Warehouse (EDW)
• Help build out the governance strategy on the data platform
• Able to break down requirements and get clarity on the critical use cases
• Self-directed and comfortable supporting the data needs of multiple teams
• Own and optimize our analytics schemas - help design the structure of our data warehouse and implement optimization techniques to make data accessible and distributed
• Experience in ETL scheduling - automating tasks; data refresh; balancing processing/cost requirements with business needs
• Experience modeling complex data sets to enable analytics teams to query and distribute business intelligence assets

Preferred Qualifications

Experience with data pipeline development for AI/ML will be a big plus