Senior Ml Engineer

Summary

Join our team as a Senior ML Engineer for a 3-month project migrating an ML model from various AWS tools to Databricks. This full-time, 100% remote position requires 6+ years of data engineering and ML experience, including MLOps, MLflow, Apache Spark, and AWS. The project involves assessing requirements, designing architecture, data processing, ETL pipeline creation, MLOps implementation, testing, and documentation. Excellent communication skills and teamwork are essential. The client is based in the USA, but flexible working hours are possible.

Requirements

• 6+ years of experience in data engineering
• Solid experience in ML
• Experience with MLOps and MLflow
• Very good knowledge of Apache Spark and the DataBricks platform
• Experience working in an AWS environment
• Experience in conducting similar migrations
• Interpersonal and teamwork skills
• Ability to take initiative and work independently
• English at a level that allows for fluent communication in a team

Responsibilities

• Assess project requirements, analyze the current architecture, and create a new model architecture
• Prepare the platform for integration with Databricks, ensuring compatibility and Unity Catalog configuration
• Process and transform data with metric aggregation for two related Glue tasks
• Create ETL pipelines to process data on platform visits and users, including data flattening for the model
• Implement MLOps using MLflow
• Run the model on Databricks Serving Endpoints to test latency
• Create test frameworks and support the Tealium team in testing
• Prepare an implementation plan for live launch
• Document work results using Unity Catalog

Preferred Qualifications

• Experience in designing and optimizing data flows using DBT, SSIS, TimeXtender, or similar solutions (ETL, ELT)
• Experience with any big data or NoSQL platforms (Redshift, Hadoop, EMR, Google Data, etc.)

Benefits

• Private medical care (Medicover)
• Multisport card for contractors
• Remote work