Remote Senior Data Engineer

Summary

Join Trunk as a founding member of our Data Engineering team and leverage your technical expertise to build data pipelines for processing and storing the data generated by our customer's CI/CD and automated tests.

Requirements

• 5+ years of experience as a software engineer with a strong understanding of key concepts in distributed systems
• 3+ years of experience in building and deploying data applications, with a track record of regularly shipping new features
• Fluency in at least two of these languages: Java/Scala/Kolin, Python, Go, Rust, or C++
• Good understanding and practical experience with partitioning, replication, map-reduce, indexing, and CAP theorem
• Experience with distributed storage systems (S3, HDFS, Hive, ClickHouse, Elastic, etc), distributed processing engines (Spark, etc), and message queues (Kafka, SQS, etc)
• Passion for building large-scale ML applications and improving software engineers' productivity
• Understanding of key concepts in natural language processing, machine learning, or statistical analysis

Responsibilities

• Build fault-tolerant and scalable data pipelines
• Design efficient data storage, collaborating with product engineers to create fast and reliable data-driven features
• Debug, profile, and optimize distributed data-intensive applications to improve their latency, accuracy, resource consumption, and throughput
• Design and build observability of data quality and accuracy
• Integrate ML models like Llama to analyze data and create features

Benefits

• Unlimited PTO
• Competitive salary and equity
• Work-life balance
• Flexibility to be fully or partly remote
• Up to $200/month stipend for coworking space for remote folks
• One Medical membership on us!
• Top-notch medical, dental, vision, short-term disability, long-term disability, and life insurance
• All insurance is 100% company-paid ($0 premiums) for employees and highly subsidized for dependents
• FSA, HSA with company contributions, and pre-tax commuter benefits
• 401(k) plan
• Paid parental leave (up to 12 weeks)