Senior Data Engineer

Summary

Join Iterable, a top-rated AI-powered customer engagement platform, and make a significant impact on our machine learning platform. You will own Spark pipelines in Databricks, optimize for scale and performance, and handle Iterable's unique data model, including unstructured data. You'll design end-to-end machine learning systems, build feature stores, collaborate with engineering, and integrate new models. We seek individuals with expertise in scalable data processing, backend systems, and ML platform technology. Iterable offers a competitive salary, comprehensive benefits, and a supportive work environment.

Requirements

• You have built and managed highly scalable data processing solutions (e.g. Spark, Flink), data lakes or warehouses (e.g. Databricks, Snowflake), authored queries (SQL), used workflow management (e.g. Airflow), and have experience maintaining the infra that supports these
• You’ve tackled problems involving unstructured data in big data systems
• You understand how different parts of the system work together, from data model to user interface, and have an understanding of distributed computing
• You have a strong understanding of system design, data structures, and algorithms
• Extensive experience with Scala or Python, with a preference for Scala competency
• Demonstrated expertise in how data flows to and from a machine learning tech platform
• Knowledge of statistics, modern and classic machine learning techniques
• You communicate nuanced ideas clearly, whether you're explaining technical decisions in writing or brainstorming in real-time and engage thoughtfully with other perspectives

Responsibilities

• Own the Spark pipelines at the core of our ML platform in Databricks and optimize for scale, performance, and cost
• Determine the best way to handle Iterable’s unique data model, including the intricacies of our customer’s unstructured data
• Design end-to-end machine learning systems, including data acquisition, data cleaning, data models, model training, model serving, and evaluation
• Build and own the batch and real-time feature stores that house our ML models
• Work closely with the Iterable engineering team to improve our machine learning infrastructure and data quality
• Build, evaluate, and integrate new models that add intelligence to our core product
• Improve our model performance tracking system
• Collaborate cross-team and cross-functionally to build data and AI products

Preferred Qualifications

• Experience building and supporting complex and modern end-to-end ML systems, like LLM pipelines
• AWS experience
• Experience in a SaaS environment
• Experience with IaC (Terraform preferred)
• Exposure to marketing technology

Benefits

• Paid parental leave
• Competitive salaries, meaningful equity, & 401(k) plan
• Medical, dental, vision, & life insurance
• Balance Days (additional paid holidays)
• Fertility & Adoption Assistance
• Paid Sabbatical
• Flexible PTO
• Monthly Employee Wellness allowance
• Monthly Professional Development allowance
• Pre-tax commuter benefits
• Complete laptop workstation