Senior Software Engineer

Logo of Twilio

Twilio

πŸ“Remote - Canada

Job highlights

Summary

Join the team as our next Senior Software Engineer - Profiles. This position is needed to create high-quality, modern solutions to complex engineering problems and help define the future of Modern Data Warehouse and Customer Data Platforms.

Requirements

  • 5+ years of experience in software engineering, with a focus on data engineering and lake house architecture
  • Strong proficiency in Spark and Scala; experience with Databricks technologies is highly desirable
  • Strong proficiency with cloud platforms (e.g., AWS, GCP) and data storage solutions (e.g., Delta Lake, Iceberg)
  • Solid understanding of ETL processes and data pipeline architecture
  • Experience with SQL and data modeling; knowledge of NoSQL databases is a plus
  • Fundamental understanding and experience with asynchronous architectures, their benefits and challenges including various broker implementations (Kafka, SQS, MQ)
  • Experience operating large-scale, distributed systems on top of cloud infrastructure such as Amazon Web Services (AWS) or Google Compute Platform (GCP)
  • Experience shipping services (products) following CI/CD development paradigm
  • Excellent written and verbal communication skills

Responsibilities

  • Design and develop robust, scalable data pipelines using Databricks, Apache Spark, and Delta Lake
  • Optimize performance and scalability of data pipelines, ensuring high availability and reliability
  • Monitor and troubleshoot data workflows and systems, providing timely resolutions to issues
  • Stay current with industry trends and technologies to continuously improve our data architecture
  • Build globally available and highly scalable distributed systems
  • Participate in an on-call rotation to support our business-critical infrastructure

Benefits

  • Generous time-off
  • Ample parental and wellness leave
  • Healthcare
  • A retirement savings program

Share this job:

Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.
Please let Twilio know you found this job on JobsCollider. Thanks! πŸ™