Remote Senior Prompt Engineer

Summary

Join Assured's mission to modernize insurance by designing, testing, and iterating on prompt structures for large language models (LLMs) as a Sr. Prompt Engineer.

Requirements

• B.S. or higher in a quantitative field or one related to language models (linguistics, philosophy, AI, etc.)
• Proficiency in Python or TypeScript for writing API-enabled scripts and automating tasks
• Hands-on experience with frontier-scale LLMs (e.g., GPT, Claude, PaLM) applied programmatically toward specific applications or implementations
• Familiarity with model evaluation metrics such as BLUE, ROUGE, and MAUVE, as well as proficiency in analyzing and visualizing model performance data
• Experience building LLM-based applications or hacking LLMs to solve novel problems and uncover vulnerabilities
• Strong understanding of NLP and language model behavior, with a focus on prompt engineering
• Exceptional written and verbal communication skills, capable of translating complex AI concepts to both technical and non-technical stakeholders

Responsibilities

• Design, develop, and implement LLM applications to evaluate data quality, solve complex synthetic data challenges, and execute AI-driven business solutions
• Conduct jailbreaks and find vulnerabilities in LLMs and other generative AI models. Develop and deliver training materials on adversarial analysis and vulnerability identification to operational teams
• Design and refine natural language prompts to elicit desired outputs from AI models. Experiment with different prompt structures to evaluate performance, accuracy, and relevance, using data-driven approaches to optimize prompts for various use cases
• Analyze language model behavior in response to prompts and provide detailed insights into model performance. Leverage industry-standard metrics (BLUE, ROUGE, MAUVE) to ensure output quality and alignment with business requirements
• Work with ML engineers, software engineers, and product managers to integrate LLM capabilities into platforms and ensure robust deployment. Share prompt engineering best practices with engineering teams and help enhance their skills through training sessions
• Develop clear documentation, style guides, and prompt templates to standardize prompt engineering across teams. Conduct training sessions to introduce new prompt engineering techniques to internal staff
• Create data creation and vulnerability testing scripts using Python or TypeScript. Collaborate with engineers to ensure reliable implementation and platform integration
• Lead experimentation and internal R&D efforts by creating new prompt engineering methods, exploring LLM applications, and driving creative problem-solving for AI use cases

Benefits

• Competitive Compensation: Enjoy a competitive salary and equity package!
• Comprehensive Health Care: Access to multiple medical plans with an HSA option and minimal out-of-pocket expenses. Certain plans covered 100%
• Dental Insurance: We protect those pearly whites
• Vision Insurance: Everyone can see clearly now at Assured
• Life Insurance: It's on the house! Provided at no cost to you
• Paid Time Off: Uncapped vacation days and paid holidays. Take that vacation!
• Family Leave: Maternity and paternity leave options
• Financial Wellness: 401(k) contribution with Assured contributing 3% of your income, even if you don't contribute
• Flexible Spending Accounts: Health and dependent care FSAs for pre-tax flexible spending