Senior Data Engineer

Summary

Join TubeScience, a leading performance video agency, as our founding Senior Data Engineer! You will be instrumental in developing and maintaining our data infrastructure, building robust data ingestion pipelines, and integrating custom logic into cutting-edge tools. This role involves designing and implementing scalable data pipelines, managing API interactions, and optimizing pipeline architecture. You will collaborate with cross-functional teams and mentor junior engineers. This is a high-impact role offering significant growth opportunities within a dynamic and supportive environment. We are looking for a data enthusiast with proven experience in data engineering and a strong skillset in Python, SQL, and ETL processes.

Requirements

• Proven Experience in data engineering with a focus on building, scaling, and maintaining data pipelines and architecture
• Proficiency in Python: Building robust ingestion systems, handling API calls, and creating custom logic for data management
• Advanced SQL Knowledge: Experience with complex queries, optimization, and managing large datasets
• Strong understanding of data ingestion/integration tools such as Airbyte, Dagster, Temporal or similar
• Excellent Problem Solving & Architecture Skills: Ability to analyze and optimize ingestion pipelines for better performance, scalability, and observability
• ETL Expertise: Strong experience designing and implementing ETL (Extract, Transform, Load) processes to efficiently move, clean, and process data from source systems to data warehouses or data lakes
• Solid Communication Skills: Full English proficiency, comfortable collaborating with cross-functional, distributed teams and guiding junior engineers

Responsibilities

• Build & Maintain Ingestion Pipelines: Design and implement highly maintainable and scalable data pipelines, primarily focused on ingesting ad performance data from multiple sources
• API Interactions: Set up and manage API interactions with various data sources to facilitate smooth, efficient, and reliable data pulls
• Infrastructure Setup: Establish the infrastructure necessary for automated, scheduled data pulls, including observability tools and custom settings for complex ingestion tasks
• Custom Logic Integration: Integrate custom ingestion logic into robust systems such as Airbyte, Dagster, Temporal, etc., to ensure seamless data flows
• Pipeline Architecture Improvements: Regularly review our current data ingestion pipeline architecture, identifying areas for improvement and proposing optimization solutions that elevate our performance and scalability
• Collaborate & Lead: Work closely with cross-functional teams to understand data needs, and mentor junior engineers in building robust data pipelines

Preferred Qualifications

• Experience with Java or JavaScript for building custom data solutions
• Familiarity with cloud platforms like AWS, GCP, or Azure
• Knowledge of ETL frameworks, CI/CD pipelines, and data monitoring tools

Benefits

• Impact: This is our founding (first) Senior Data Engineer, who will get the chance to drive and lead product, process, and team growth. You’ll be at the forefront of improving our data infrastructure, directly influencing how we collect, manage, and utilize ad performance data
• Growth: Opportunity to work and implement cutting-edge tools and technologies in a rapidly growing and evolving team and data landscape
• Culture: Work in a dynamic, collaborative and supportive environment where your ideas and growth are valued, encouraged, and expected