Senior Data Engineer

Summary

Join Fetch Rewards as a Senior Data Engineer and play a pivotal role in designing and building scalable data pipelines. You will process terabytes of data daily, ensuring data governance, security, and compliance. Collaborate with cross-functional teams, develop data products, and mentor junior engineers. Leverage technologies like Apache Kafka, Apache Flink, and Apache Spark within the AWS cloud. This role requires expertise in data architecture, modern programming languages, and CI/CD processes. Fetch offers a competitive compensation and benefits package, including equity, 401k matching, comprehensive health benefits, paid time off, parental leave, and flexible work arrangements.

Requirements

• Be a self-starter that can take a project from architecture to adoption
• Have experience with Infrastructure as Code tools such as Terraform or CloudFormation. Ability to automate the deployment and management of data infrastructure
• Have familiarity with Continuous Integration and Continuous Deployment (CI/CD) processes. Experience setting up and maintaining CI/CD pipelines for data applications
• Have proficiency in software development lifecycle process. Release fast and improve incrementally
• Have experience with tools and frameworks for ensuring data quality, such as data validation, anomaly detection, and monitoring. Ability to design systems to track and enforce data quality standards
• Have proven experience in designing, building, and maintaining scalable data pipelines capable of processing terabytes of data daily using modern data processing frameworks (e.g., Apache Spark, Apache Kafka, Flink, Open Table Formats, modern OLAP databases)
• Have a strong foundation in data architecture principles and the ability to evaluate emerging technologies
• Be proficient in at least one modern programming language (Go, Python, Java, Rust) and SQL
• Be comfortable presenting and challenging technical decisions in a peer review environment
• Have an Undergraduate or graduate degree in relevant fields such as Computer science, Data Science, Business Analytics

Responsibilities

• Design and implement both real-time and batch data processing pipelines, leveraging technologies like Apache Kafka, Apache Flink, or managed cloud streaming services to ensure scalability and resilience
• Create data pipelines that efficiently process terabytes of data daily, leveraging data lakes and data warehouses within the AWS cloud. Must be proficient with technologies like Apache Spark to handle large-scale data processing
• Implement robust schema management practices and lay the groundwork for future data contracts. Ensure pipeline integrity by establishing and enforcing data quality checks, improving overall data reliability and consistency
• Develop tools to support rapid development of data products. Provide recommended patterns to support data pipeline deployments
• Designing, implementing, and maintaining data governance frameworks and best practices to ensure data quality, security, compliance, and accessibility across the organization
• Develop tools to support the rapid development of data products and establish recommended patterns for data pipeline deployments. Mentor and guide junior engineers, fostering their growth in best practices and efficient development processes
• Collaborate with the DevOps team to integrate data needs into DevOps tooling
• Champion DataOps practices within the organization, promoting a culture of collaboration, automation, and continuous improvement in data engineering processes
• Stay abreast of emerging technologies, tools and trends in data processing and analytics, and evaluate their potential impact and relevance to Fetch’s strategy

Benefits

• Equity: We offer employees equity in Fetch, so that everyone can benefit from Fetch’s growth
• 401k Match: Dollar-for-dollar match up to 4%
• Benefits for humans and pets : We offer comprehensive medical, dental and vision plans for everyone including your pets
• Continuing Education : Fetch provides ten thousand per year in education reimbursement
• Employee Resource Groups : Take part in employee-led groups that are centered around fostering a diverse and inclusive workplace through events, dialogue and advocacy. The ERGs participate in our Inclusion Council with members of executive leadership
• Paid Time Off: On top of our flexible PTO, Fetch observes 9 paid holidays, including Juneteenth and Indigenous People’s Day, as well as our year-end week-long break
• Robust Leave Policies: 20 weeks of paid parental leave for primary caregivers, 14 weeks for secondary caregivers, and a flexible return to work schedule
• Calvin Care Cash : Employees who are welcoming new family members will also receive a one time $2,000 incentive to assist employees with covering the cost of childcare, clothing, diapers and much more!
• Flexible Work Environment : Collaborate with your team in one of our stunning offices in Madison, Birmingham, or Chicago. Or you can work fully remotely from anywhere in the US. We’ll ensure you are equally equipped with the hardware and software you need to get your job done in the comfort of your home