Model Monitoring Analyst

Summary

Join Octane®, a fintech revolutionizing recreational purchases with a seamless digital buying experience, as a Model Monitoring Analyst. You will be part of a team analyzing the performance of deployed machine learning models, using dedicated monitoring tools and metrics. Your responsibilities include applying state-of-the-art model monitoring techniques, converting insights into actionable recommendations, analyzing large datasets to detect drift, and researching new visualization techniques. You will report key findings and metrics regularly. This role requires an advanced degree in a quantitative field or a bachelor's degree with relevant experience. Familiarity with SQL, data visualization tools, and Excel is essential. Octane offers a competitive salary, stock options, and a comprehensive benefits package.

Requirements

• A recent advanced degree in Math, Statistics, Physics, Engineering, Computer Science or another quantitative field, OR a bachelor's degree followed by 2+ years of experience inclusive of business analytics, performance analysis, mathematical modeling, and/or data science
• Ability to critically think and prioritize needs of the business
• Familiarity / Experience with SQL
• Familiarity / Experience with some data visualization tools, such as Tableau, Looker, Periscope, PowerBI, or similar software for reporting
• Familiarity / Experience with Excel, Google Sheets or similar software

Responsibilities

• Apply state of the art machine learning model monitoring techniques to drive business value
• Convert insights into concrete, significant recommendations for business or product improvement, and succinctly communicate these findings to both executive and non-executive partners
• Analyze large data sets of proprietary and third-party data to detect drift in features and/or model score and suggest recommendations for policy, strategy, or product decisions
• Research and keep up to date with new visualization and monitoring techniques and tools

Preferred Qualifications

• Knowledge of Python, PySpark, SparkSQL, and statistical / ML packages
• Experience with Databricks
• Experience with cluster computing for data manipulation, analysis and data science
• Possesses understanding of machine learning algorithms and techniques
• Basic command line experience
• Experience with AWS or other cloud computing environments, specifically within the data domain
• Experience with Git for code management
• Experience with MLflow

Benefits

• Robust Health Care Plans (Medical, Dental & Vision)
• Generous Parental Leave
• Up to 5 weeks time off (self-managed)
• Retirement Plan (401k) with company match!
• Educational Assistance/Tuition Reimbursement up to $3K/year
• Life Insurance (Basic, Voluntary & AD&D)
• Short Term / Long Term Disability
• Robust Ancillary benefits including accident insurance, hospital insurance, etc
• Wellhub wellness benefit
• Powersports Safety Benefit
• Stock option package