Gorilla Logic is hiring a
Senior Data Engineer

Summary

Gorilla Logic seeks a Senior Data Engineer to design, implement, and maintain data architecture for clients using Java/GCP. The role involves creating scalable data solutions, developing robust data pipelines, implementing data quality management, and working closely with stakeholders. The ideal candidate has 5+ years of experience as a data engineer, proficient in SQL, and familiar with Google Cloud Platform.

Requirements

• Bachelor's degree in computer science, Engineering, or related field
• 5+ years of experience as a data engineer building out analytic systems and solutions
• 5+ years of Java/Spring programming experience
• 2+ years of experience with Google Cloud Platform and their data services
• Proficient in SQL and database systems (PostgreSQL)
• Experience with Elasticsearch
• Experience working with Google BigQuery data warehouse
• Experience implementing pub/sub systems (Apache Kafka and RabbitMQ)
• Experience with ETL tools and data integration processes
• Familiar with Apache Spark and Apache Airflow
• API integrations with social media platforms
• Prior experience working with large datasets

Responsibilities

• Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions
• Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to storage and analysis destinations
• Develop and implement data models that support the organization's analytical and reporting needs, ensuring data integrity and optimal performance
• Integrate data from different sources, such as databases, APIs, and external systems, to create a unified and consistent view for analysis
• Implement data quality management by implementing processes and tools to ensure the quality and reliability of data being collected and stored
• Optimize data infrastructure and processes for performance and scalability, ensuring timely and efficient data retrieval and processing, and handle growing amounts of data
• Implementation of security measures to protect sensitive data and ensure compliance with data privacy regulations
• Work closely with data scientist, analyst, and other stakeholder to understand data requirements to collect and prepare data for analysis, and provide the necessary infrastructure
• Document data engineering processes, data flows, and system architecture to ensure transparency and ease of maintenance

Preferred Qualifications

• Experience with JSON data formats
• Familiar with DSP reporting for ad campaigns
• API integrations with 3rd party services (Facebook and Google Ads)