Staff Data Engineer

Summary

Join Swapcard as a Staff Data Engineer and play a pivotal role in designing and building robust, efficient data pipelines. You will design and implement data pipelines using tools like Fivetran, Airbyte, or Python; develop and optimize transformation models using DBT, Redshift, and Dagster; and oversee the management and optimization of the Redshift data warehouse. Responsibilities also include monitoring and troubleshooting data pipelines, collaborating with cross-functional stakeholders, setting data engineering standards, and creating detailed documentation. This role requires extensive experience in data engineering, DBT, Redshift, SQL, and ETL processes. Swapcard offers a remote-first policy, generous paid time off, remote perks, full health insurance coverage, and a work-from-home budget, among other benefits.

Requirements

• 10+ years of hands-on experience in data engineering, building scalable and reliable data systems in production environments
• 4+ years of experience with DBT , implementing, optimizing, and managing transformation pipelines in DBT for cloud data warehouses
• 5+ years of experience with Redshift , managing, optimizing, and troubleshooting Redshift in AWS
• Advanced SQL skills and a deep understanding of data warehousing principles, including performance tuning, indexing, partitioning, and query optimization
• Proven experience in ETL processes , from extracting data from various sources, transforming it, and loading it into cloud-based data warehouses
• Experience with data orchestration tools such as Airflow, Dagster, or Prefect, to design and manage data workflows
• Hands-on experience with Python for building custom data processing scripts and automation
• Fluency in English (both written and verbal)

Responsibilities

• Designing and implementing data pipelines: Build scalable and maintainable data pipelines using tools such as Fivetran, Airbyte, or Python, ensuring that data is efficiently moved from various sources to our cloud data warehouse
• Data transformation and modeling: Develop and optimize transformation models using tools like DBT, Redshift, and Dagster, ensuring high-quality and timely data for analysis
• Cloud Data Warehouse Management: Oversee the management and optimization of our Redshift data warehouse, ensuring smooth operations and data integrity
• Monitoring and troubleshooting: Continuously monitor the data pipelines and infrastructure, ensuring uptime, quality, and the timely availability of data for decision-making
• Team Collaboration: Collaborate cross-functionally with stakeholders (ML team, Infra team, Growth team, ...), and business teams to address their data engineering needs and deliver impactful solutions
• Setting Data Engineering Standards: Define, enforce, and improve data engineering standards, best practices, and processes across the organization
• Documentation : Create and maintain detailed documentation for pipelines, data models, and architecture to ensure transparency and knowledge sharing within the team and organization
• Data Governance: Establish and enforce data governance standards across the organization, ensuring data quality, consistency, security, and compliance. Collaborate with data privacy and legal teams to ensure that all data practices meet regulatory requirements
• Setting Data Engineering Standards: Define, enforce, and improve data engineering standards, best practices, and processes across the organization

Preferred Qualifications

• Experience working with other AWS services such as S3, Lambda, etc
• Expertise in Dagster as an orchestration tool for data workflows
• Experience with data visualization tools like Tableau, helping to bridge the gap between engineering and business teams
• Experience with Infra tools such as Docker, Terraform, and Helm, enhancing the scalability and portability of our data infrastructure

Benefits

• International team with 40+ nationalities (more on the way!)
• Remote-first policy with headquarters in Paris
• Thriving startup with career growth opportunities
• Open-minded culture that appreciates differences
• Feedback-driven, supportive & curious team with a DIY mindset
• Generous Paid Time Off to ensure you have time for what matters most
• Remote perks designed to optimize your working experience
• In-person social gatherings to celebrate our achievements
• 100% of your health insurance contribution paid by Swapcard
• Work-from-home budget (one-off contribution for equipment in addition to your initial equipment setup)
• Co-working space budget to support remote work in professional environments
• Learning budget to help you develop new and existing skills
• Mental health care initiatives to support your well-being