Twilio is hiring a
Data Engineer, Remote - Estonia

Summary

The job is for a Staff Data Engineer at Twilio's Messaging Data Platform team. The role involves building and maintaining data pipelines, driving the development of innovative data solutions, and providing architectural guidance among other responsibilities. The required qualifications include experience with Big Data processing tools, ETL tools, cloud services, Key-Value, Streaming, and Search Database technologies, Lakehouse technologies, and AI/ML pipelines.

Requirements

• 5+ years of experience with Big Data processing tools and frameworks such as Apache Spark, PySpark, SparkSQL
• Deep technical understanding of ETL tools, low-latency data stores, multiple data warehouses and data catalogs
• Familiarity with data testing and verification tooling and best practices
• Experience with cloud services (AWS preferred, Google, Azure etc.)
• Proficient in working with Key-Value, Streaming, and Search Database technologies, including AWS DynamoDB, Apache Kafka, and ElasticSearch
• Experience with Lakehouse technologies, such as Apache Hudi, Apache Iceberg, Databricks Delta Lake
• Experience in building AI/ML pipelines
• Readiness to participate in the on-call rotation

Responsibilities

• Oversee the design, construction, testing, and maintenance of advanced, scalable data architectures and pipelines
• Drive the development of innovative data solutions that meet complex business requirements
• Create and enforce best practices for data architecture, ensuring scalability, reliability, and performance
• Provide architectural guidance and mentorship to junior engineers
• Tackle the most challenging technical issues and provide advanced troubleshooting support
• Collaborate with senior leadership to align data engineering strategies with organizational goals
• Participate in long-term planning for data infrastructure and analytics initiatives
• Lead cross-functional projects, ensuring timely delivery and alignment with business objectives
• Coordinate with product managers, analysts, and other stakeholders to define project requirements and scope
• Continuously monitor and enhance the performance of data systems and pipelines

Preferred Qualifications

• Demonstrated technical breadth and depth as evidenced by papers, code, and/or presentations
• Experience with high-level programming languages, like Java, Python, Scala
• Exposure to service-oriented architectures, microservices and REST APIs
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes)

Benefits

• Competitive pay
• Generous time-off
• Amyount of parental and wellness leave
• Healthcare
• Retirement savings program