Data Engineer

Summary

Join Vetcove's growing team as a Data Engineer and help transform the veterinary supply industry. You will design, develop, and maintain scalable data pipelines, leveraging LLMs and AI to improve data management. This role involves building and optimizing data infrastructure, integrating external data sources, and collaborating with other engineers. You will work with large datasets using technologies like ClickHouse and Snowflake. Vetcove is a Y Combinator and venture-backed company committed to modernizing the animal health industry. We are looking for talented and passionate individuals to join our team.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field
• 3+ years of experience using Python for data-centric programming tasks
• 3+ years of professional experience in data engineering
• Proven experience implementing Large Language Models in data pipelines
• Ability to design new features around data models with accuracy, security, and performance in mind
• Strong ability to process and analyze large volumes of quantitative and qualitative data
• A methodical and analytical mindset with robust problem-solving skills
• Excellent attention to detail and organizational abilities

Responsibilities

• Design and build infrastructure to efficiently ingest and support billions of records
• Utilize databases such as ClickHouse for high-performance storage and querying of large datasets
• Monitor, troubleshoot, and optimize data workflows, including ETL processes
• Assist in integrating external data sources into our analytics team’s enterprise data warehouse (Snowflake) using data orchestrators (like Airflow and Dagster)
• Collaborate closely with backend application engineers to ensure seamless data integration
• Apply LLMs and other AI technologies to automate data cleaning and structuring processes