Staff Data Engineer

Summary

Join Twilio as a Staff Software Engineer and lead a team focused on Warehouse Activation, building and scaling systems processing over 1 billion rows of data monthly. You will design and build the next generation of the Warehouse Activation platform, ensuring high availability and throughput. Collaborate with engineering and product leads, support platform reliability and security, and mentor other engineers. This role requires expertise in distributed systems, cloud infrastructure (AWS or GCP), and modern data stack technologies. The position is remote and based in India.

Requirements

• 8+ years of experience writing production-grade code in a modern programming language
• Strong theoretical fundamentals and hands-on experience designing and implementing highly available and performant fault-tolerant distributed systems
• Experience programming in one or more of the following: Go, Java, Scala, or similar languages
• Well-versed in concurrent programming, along with a solid grasp of Linux systems and networking concepts
• Experience operating large-scale, distributed systems on top of cloud infrastructure such as Amazon Web Services (AWS) or Google Cloud Platform (GCP)
• Experience in message passing systems (e.g., Kafka, AWS Kinesis) and/or modern stream processing systems (e.g., Spark, Flink)
• Have hands-on experience with container orchestration frameworks (e.g. Kubernetes, EKS, ECS)
• Experience shipping services (products) following CI/CD development paradigm
• Deep understanding of architectural patterns of high-scale web applications (e.g., well-designed APIs, high volume data pipelines, efficient algorithms)
• Have a track record of successfully leading teams, large projects, or owned and built an important, complex system end to end, delivered iteratively
• Excellent written and verbal technical communication skills to convey complex technical concepts effectively

Responsibilities

• Design and build the next generation of Warehouse Activation platform, process billions of events, and power various use cases for Twilio Segment customers. This encompasses working on stream data processing, storage, and other mission-critical systems
• Ship features that opt for high availability and throughput with eventual consistency
• Collaborate with engineering and product leads, as well as teams across Twilio Segment
• Support the reliability and security of the platform
• Build and optimize globally available and highly scalable distributed systems
• Be able to act as a team Tech Lead as needed
• Mentor other engineers on the team in technical architecture and design
• Partner with application teams to deliver end to end customer success

Preferred Qualifications

Ideally domain expertise in the Modern Data stack with experience in developing cloud-based data solution components and architecture covering data ingestion, data processing and data storage

Benefits

• Competitive pay
• Generous time-off
• Ample parental and wellness leave
• Healthcare
• A retirement savings program