Data Ops Senior Data Engineer

Summary

Join Fetch as a DataOps - Senior Data Engineer to design and build scalable data pipelines and data transformation systems to process terabytes of data each day.

Requirements

• Self starter that can take a project from architecture to adoption
• Experience with Infrastructure as Code tools such as Terraform or CloudFormation. Ability to automate the deployment and management of data infrastructure
• Familiarity with Continuous Integration and Continuous Deployment (CI/CD) processes. Experience setting up and maintaining CI/CD pipelines for data applications
• Proficiency in software development lifecycle process. Release fast and improve incrementally
• Experience with tools and frameworks for ensuring data quality, such as data validation, anomaly detection, and monitoring. Ability to design systems to track and enforce data quality standards
• Proven experience in designing, building, and maintaining scalable data pipelines capable of processing terabytes of data daily using modern data processing frameworks (e.g., Apache Spark, Apache Kafka, Flink, Open Table Formats, modern OLAP databases)
• Strong foundation in data architecture principles and the ability to evaluate emerging technologies
• Proficient in at least one modern programming language (Go, Python, Java, Rust) and SQL
• Comfortable presenting and challenging technical decisions in a peer review environment
• Undergraduate or graduate degree in relevant fields such as Computer science, Data Science, Business Analytics

Responsibilities

• Design and implement both real-time and batch data processing pipelines, leveraging technologies like Apache Kafka, Apache Flink, or managed cloud streaming services to ensure scalability and resilience
• Create data pipelines that efficiently process terabytes of data daily, leveraging data lakes and data warehouses within the AWS cloud. Must be proficient with technologies like Apache Spark to handle large-scale data processing
• Implement robust schema management practices and lay the groundwork for future data contracts. Ensure pipeline integrity by establishing and enforcing data quality checks, improving overall data reliability and consistency
• Develop tools to support rapid development of data products. Provide recommended patterns to support data pipeline deployments
• Designing, implementing, and maintaining data governance frameworks and best practices to ensure data quality, security, compliance, and accessibility across the organization
• Develop tools to support the rapid development of data products and establish recommended patterns for data pipeline deployments. Mentor and guide junior engineers, fostering their growth in best practices and efficient development processes
• Collaborate with the DevOps team to integrate data needs into DevOps tooling
• Champion DataOps practices within the organization, promoting a culture of collaboration, automation, and continuous improvement in data engineering processes
• Stay abreast of emerging technologies, tools and trends in data processing and analytics, and evaluate their potential impact and relevance to Fetch’s strategy

Benefits

• Equity for everyone
• 401k Match: Dollar-for-dollar match up to 4%
• Benefits for humans and pets : We offer comprehensive medical, dental and vision plans for everyone including your pets
• Continuing Education : Fetch provides ten Thousand per year in education reimbursement
• Employee Resource Groups : Take part in employee-led groups that are centered around fostering a diverse and inclusive workplace through events, dialogue and advocacy. The ERGs participate in our Inclusion Council with members of executive leadership
• Paid Time Off: On top of our flexible PTO, Fetch observes 9 paid holidays, including Juneteenth and Indigenous People’s Day, as well as our year-end week-long break
• Robust Leave Policies: 20 weeks of paid parental leave for primary caregivers, 14 weeks for secondary caregivers, and a flexible return to work schedule. $2000 baby bonus