Senior Data Engineer

Summary

Join Lightspeed's Data Engineering practice as a Senior Data Engineer and contribute to building scalable data pipelines, robust data models, and efficient transformations. You will design and implement data models using Dataform and DBT, optimize SQL queries, develop data pipelines using Apache Airflow, and automate ETL/ELT processes. Collaborate with stakeholders to map business requirements into data models, implement data validation, and maintain documentation adhering to governance standards. Build cloud-native data solutions using GCP and leverage best practices in CI/CD and data security. Work with analysts and data scientists to ensure models meet business needs. This role offers opportunities for growth and development within a fast-paced, high-growth company.

Requirements

• Proficient with SQL for data modeling, transformation, and performance tuning
• Experience with SQL-based transformation tools for modular and version-controlled data modeling (we use Dataform and DBT)
• Expertise with orchestration tools for building and scheduling data workflows (we use Airflow)
• Hands-on experience with cloud data platforms (we use GCP)
• Solid understanding of ETL/ELT principles and batch vs. streaming architectures
• Proficiency in Python for automation and data pipeline development
• Familiarity with software engineering best practices, including version control, CI/CD, and testing for data workflows
• Strong understanding of data governance, security, and compliance (GDPR, SOX, etc.)
• Excellent problem-solving and communication skills to collaborate with engineers, analysts, and business teams

Responsibilities

• Design and implement clean, scalable, and performant data models using Dataform and DBT
• Own the curation and transformation layer, ensuring best practices for SQL-based transformations and maintaining data integrity
• Optimize SQL queries and models for efficient warehouse performance
• Develop, orchestrate, and monitor data pipelines using Apache Airflow
• Automate ETL/ELT processes for efficient, repeatable, and scalable data ingestion and transformation
• Collaborate with stakeholders to map business requirements into reliable data models
• Implement data validation, anomaly detection, and automated testing for data reliability
• Maintain documentation and ensure datasets adhere to governance, compliance, and security standards
• Work with analysts and data scientists to make sure models serve business needs
• Build and maintain high-performance, cloud-native data solutions using GCP
• Leverage best practices in CI/CD, infrastructure-as-code, and data security

Preferred Qualifications

• Experience with MongoDB is highly desirable
• Experience with BI tools for data visualization (we use Looker)
• Familiarity with Terraform or other infrastructure-as-code tools
• Exposure to real-time data processing frameworks (Kafka, Pub/Sub, etc.)

Benefits

• Amazing benefits & perks, including equity for all Lightspeeders
• Constant development of both your skill-set and business acumen with limitless growth opportunities
• Lots of autonomy, flexible work culture
• Innovation time to explore and learn at work
• Shaping the company by joining cultural & technical committees
• Tons of growth opportunities into technical or people management roles
• Opportunity to join a fast-paced, high-growth company
• Opportunity to learn, expand your skill set, forge wonderful relationships and make your mark within the diverse and inclusive Lightspeed family, a true Canadian tech success storyz
• Lightspeed equity scheme (we are all owners)
• Flexible paid time off and remote work policies
• Health insurance
• Contributions to your pension plan - RRSP
• Health and wellness benefit of $500 per year
• Paid leave and assistance for new parents
• Mental health online platform and counseling & coaching services
• Training opportunities to grow your skills and career
• Volunteer day
• Fully stacked kitchen (hot and cold beverages, meals served)
• Happy hours to build your relationships with colleagues after work