Senior Data Engineer

Summary

Join Lightspeed's Data Foundations team as a Senior Data Engineer and contribute to building a robust data infrastructure. You will be responsible for designing and implementing data models, optimizing SQL queries, developing data pipelines, and ensuring data integrity. This role involves collaborating with various teams to ensure data models meet business needs and adhere to governance standards. You will also leverage cloud data platforms and best practices in CI/CD and data security.

Requirements

• Proficient with SQL for data modeling, transformation, and performance tuning
• Experience with SQL-based transformation tools for modular and version-controlled data modeling (we use Dataform and DBT)
• Expertise with orchestration tools for building and scheduling data workflows (we use Airflow)
• Hands-on experience with cloud data platforms (we use GCP)
• Solid understanding of ETL/ELT principles and batch vs. streaming architectures
• Proficiency in Python for automation and data pipeline development
• Familiarity with software engineering best practices, including version control, CI/CD, and testing for data workflows
• Strong understanding of data governance, security, and compliance (GDPR, SOX, etc.)
• Excellent problem-solving and communication skills to collaborate with engineers, analysts, and business teams

Responsibilities

• Design and implement clean, scalable, and performant data models using Dataform and DBT
• Own the curation and transformation layer, ensuring best practices for SQL-based transformations and maintaining data integrity
• Optimize SQL queries and models for efficient warehouse performance
• Develop, orchestrate, and monitor data pipelines using Apache Airflow
• Automate ETL/ELT processes for efficient, repeatable, and scalable data ingestion and transformation
• Collaborate with stakeholders to map business requirements into reliable data models
• Implement data validation, anomaly detection, and automated testing for data reliability
• Maintain documentation and ensure datasets adhere to governance, compliance, and security standards
• Work with analysts and data scientists to make sure models serve business needs
• Build and maintain high-performance, cloud-native data solutions using GCP
• Leverage best practices in CI/CD, infrastructure-as-code, and data security

Preferred Qualifications

• Experience with MongoDB is highly desirable
• Experience with BI tools for data visualization (we use Looker)
• Familiarity with Terraform or other infrastructure-as-code tools
• Exposure to real-time data processing frameworks (Kafka, Pub/Sub, etc.)

Benefits

• Join a growing team and help us move to the next level
• Amazing benefits & perks, including equity for all Lightspeeders
• Constant development of both your skill-set and business acumen with limitless growth opportunities
• Lots of autonomy, flexible work culture
• Innovation time to explore and learn at work
• Shaping the company by joining cultural & technical committees
• Tons of growth opportunities into technical or people management roles
• Opportunity to join a fast-paced, high-growth company
• Opportunity to learn, expand your skill set, forge wonderful relationships and make your mark within the diverse and inclusive Lightspeed family, a true Canadian tech success story
• ���.  And enjoy a range of benefits that will keep you happy, healthy and (not) hungry
• Lightspeed equity scheme (we are all owners)
• Flexible paid time off and remote work policies
• Health insurance
• Contributions to your pension plan - RRSP
• Health and wellness benefit of $500 per year
• Paid leave and assistance for new parents
• Mental health online platform and counseling & coaching services
• Training opportunities to grow your skills and career
• Volunteer day
• Fully stacked kitchen (hot and cold beverages, meals served)
• Happy hours to build your relationships with colleagues after work