Pipeline Engineer

Summary

Join Trunk Tools, a leading AI company revolutionizing the construction industry, and help build the future of construction through intelligent automation. We are seeking a Data Engineer to design, develop, and maintain robust file processing pipeline infrastructure. You will orchestrate data flow, ensure pipeline health, integrate data from various sources, implement data quality checks, and collaborate with the machine learning team. This role requires a BS/MS in Computer Science or a related field, 5+ years of ETL development experience, strong Python and database skills, and experience with pipeline orchestration and infrastructure-as-code tools. We offer a competitive salary, stock options, comprehensive health benefits, 401k, a learning stipend, free lunch, unlimited PTO, and in-person retreats. We are an equal-opportunity employer committed to building an inclusive environment.

Requirements

• BS/MS in Computer Science, Information Systems, or a related field
• 5+ years of experience in ETL development and data engineering
• Strong coding proficiency in Python and database systems (SQL, noSQL)
• Strong experience with pipeline orchestration tools (eg. Prefect), infrastructure-as-code (eg. Terraform), and observability and monitoring tools
• Understanding of serverless architectures (eg. AWS Lambda)
• Familiarity with ML workflows and requirements (to effectively collaborate with the ML team)
• Knowledge of data modeling and data warehouse concepts
• Interest in the construction industry

Responsibilities

• Design, develop and maintain robust file processing pipeline infrastructure
• Orchestrate the flow of data through various stages of processing
• Ensure observability and monitoring of the pipeline’s health
• Integrate data from various sources including industry storage platforms, project management tools, and external APIs
• Implement data quality checks and error handling mechanisms to ensure data integrity
• Collaborate with the machine learning team to enhance pipeline functionality and efficiency

Benefits

• Competitive salary and stock option equity packages
• 3 Medical Plans to choose from including 100% covered option. Plus Dental and Vision Insurance!
• 401K
• Learning & Growth stipend
• Free lunch provided in NYC and Austin office
• Unlimited PTO
• IRL / In-Person retreats throughout the year