Data Engineer

Summary

Join Twilio as a Software Engineer (L3) in the Warehouse Activation group and build scalable systems processing over 1 billion rows monthly. You will contribute to a team deeply familiar with large-scale data processing and work with customer data warehouses like Snowflake and Databricks. Responsibilities include designing and building the next-generation Warehouse Activation platform, ensuring high availability and throughput, collaborating with engineering and product teams, and mentoring other engineers. The ideal candidate possesses 5+ years of experience in production-grade code, expertise in distributed systems, and experience with cloud infrastructure and message passing systems. Twilio offers competitive pay, generous time off, parental and wellness leave, healthcare, and a retirement savings program.

Requirements

• 5+ years of experience writing production-grade code in a modern programming language
• Strong theoretical fundamentals and hands-on experience designing and implementing highly available and performant fault-tolerant distributed systems
• Experience programming in one or more of the following: Go, Java, Scala, or similar languages
• Well-versed in concurrent programming, along with a solid grasp of Linux systems and networking concepts
• Experience operating large-scale, distributed systems on top of cloud infrastructure such as Amazon Web Services (AWS) or Google CloudCompute Platform (GCP)
• Experience in message passing systems (e.g., Kafka, AWS Kinesis) and/or modern stream processing systems (e.g., Spark, Flink)
• Have hands-on experience with container orchestration frameworks (e.g. Kubernetes, EKS, ECS)
• Experience shipping services (products) following CI/CD development paradigm
• Strong understanding of architectural patterns of high-scale web applications (e.g., well-designed APIs, high volume data pipelines, efficient algorithms)
• Have a track record of successfully delivering on large or complex projects delivered iteratively
• Strong written and verbal technical communication skills to convey complex technical concepts effectively
• Comfortable asking questions and taking initiative to solve problems where it is often necessary to “ draw the owl ”

Responsibilities

• Design and build the next generation of Warehouse Activation platform, process billions of events, and power various use cases for Twilio Segment customers. This encompasses working on stream data processing, storage, and other mission-critical systems
• Ship features that opt for high availability and throughput with eventual consistency
• Collaborate with engineering and product leads, as well as teams across Twilio Segment
• Support the reliability and security of the platform
• Build and optimize globally available and highly scalable distributed systems
• Mentor other engineers on the team in technical architecture and design
• Partner with application teams to deliver end to end customer success

Preferred Qualifications

Ideally domain expertise in the Modern Data stack with experience in developing cloud-based data solution components and architecture covering data ingestion, data processing and data storage

Benefits

• Competitive pay
• Generous time-off
• Ample parental and wellness leave
• Healthcare
• A retirement savings program