AI Model Validation Intern

Summary

Join CSAA Insurance Group's Data Science department as an AI Model Validation Intern! This 11-week summer internship (May 19-August 1) offers hands-on experience in testing and validating AI models. The role is primarily remote, with a hybrid option in Glendale, AZ, and pays $36/hour. You'll contribute to real-world projects, participate in professional development, and network with professionals. The internship focuses on generating insights, defining benchmark datasets, and collaborating with various teams. Successful candidates will possess strong analytical and communication skills and be pursuing a quantitative degree.

Requirements

• Current graduate student pursuing a quantitative or analytically focused degree, ideally graduating December 2025 or later
• Interested to begin a career with a focus on data or statistical analysis
• Familiar with manipulating raw data with Python or R
• Must have authorization to work indefinitely in the US

Responsibilities

• Generates actionable insights and solutions to help business leaders and clients make optimal data-driven decisions. Identifies meaningful insights from varied and moderate to large data sources
• Define curated benchmark datasets for prompt engineering in order to validate large language models (LLMs) are not subject to errors including factuality (hallucinations, consistency), relevance, toxicity, etc
• Additional prompt engineering to be used by a non-LLM judge with semi-automated validation performed via regular expressions
• Consult with Model Governance team to ensure process guidelines are met and enforce model lifecycle controls of Testing, Validation, and Monitoring
• Performs statistical analysis and models to interpret, quantify and validate trends or patterns
• Communicates insights and findings from analysis to business stakeholders. Typically uses well-established statistical models
• Contributes to cross-functional analytics projects including working with partner teams and summarizing key insights in support of decision making
• May work with developers to support the definition and development of data acquisition processes and to implement analytics solutions
• Actively seeks to expand use of new statistical tools, technology, models and standards for possible use with CSAA core businesses. Presents findings to peers
• Maintains consultative relationships with key business stakeholders

Preferred Qualifications

• Creative problem solver with a strong interest in machine learning
• High-energy, high-impact individual who can provide statistical insights with data
• Self-motivated and results-oriented professional with strong written or verbal communication skills
• Able to influence and effectively manage multiple projects while communicating effectively in front of others
• Enthusiastic to learn new concepts and committed to self-development
• Has a keen analytical mind with a sharp eye for details

Benefits

• 11-week summer internship experience with an emphasis on hands-on learning and real-world immersion into our business
• Professional development and job-specific training
• Plenty of networking opportunities
• Intern Hackathon
• Executive meet and greets
• Community service opportunities
• Social bonding activities
• Primarily remote but can be hybrid based out of our Glendale, AZ office
• $36.00 hourly rate