Senior Data Engineer

Summary

Join Lighthouse, a rapidly growing data company revolutionizing the hospitality industry with its innovative commercial platform. Backed by significant funding, we've surpassed $100 million in ARR and are looking for a Senior Data Engineer to join our team. You will design and develop scalable data pipelines using the Google Cloud stack, ensuring data quality and accuracy. This role involves collaborating with various teams, mentoring junior engineers, and optimizing data pipelines for performance and cost. We offer a flexible work environment, comprehensive benefits, and opportunities for career development. If you're passionate about data and want to make a significant impact, apply today!

Requirements

• 5+ years of professional experience using Python, Java, or Scala for data processing (Python preferred)
• Experience with writing data processing pipelines and with cloud platforms like AWS, GCP, or Azure
• Experience with data pipeline orchestration tools like Apache Airflow (preferred), Dagster or Prefect
• A deep understanding of data warehousing strategies
• Experience with transformation tools like dbt to manage data transformation in your data pipelines
• Some experience in managing infrastructure with IaC tools like Terraform
• Stay updated with industry trends, emerging technologies, and best practices in data engineering
• Improve, manage, and teach standards for code maintainability and performance in code submitted and reviewed
• Ship large features independently, generate architecture recommendations with the ability to implement them
• A strong communicator that can describe complex topics in a simple way to a variety of technical and non-technical stakeholders

Responsibilities

• Design and develop scalable, reliable data pipelines using the Google Cloud stack
• Ingest, process, and store structured and unstructured data from various sources into our data-lakes and data warehouses
• Optimise data pipelines for cost, performance and scalability
• Implement and maintain data governance frameworks, ensuring data accuracy, consistency, and compliance
• Monitor and troubleshoot data pipeline issues, implementing proactive measures for reliability and performance
• Mentor and provide technical guidance to other engineers working with data
• Partner with Product, Engineering & Data Science teams to operationalise new solutions

Preferred Qualifications

• Familiarity with GCP, Kubernetes (GKE preferred), CI/CD tools (Gitlab CI preferred), familiarity with the concept of Lambda Architecture
• Experience with Apache Beam or Apache Spark for distributed data processing or event sourcing technologies like Kafka
• Familiarity with monitoring tools like Grafana & Prometheus

Benefits

• Flexible working environment: Work from home or at one of our global offices
• Flexible time off: Autonomy to manage your work-life balance
• Cobee benefits: 160€/month for food, transportation, or nursery
• Language learning: 40€/month on Preply
• Comprehensive health insurance: 100% Alan coverage for you, your spouse, and dependents
• Collaborative team: High-bar, friendly, creative, and passionate colleagues
• Career development: Workshops, frameworks, tools, training, and processes to realize your full potential
• Impactful work: Shape products relied on by 85,000+ users worldwide
• Competitive compensation: Proactively maintained to value your work
• Referral bonuses: Earn rewards for bringing in new talent