Senior Optimization Analyst, A/B Testing

Summary

Join Brillio as a Senior Optimization Analyst and lead our A/B testing program. You will drive data-informed decisions to enhance user experience and conversion rates for client websites. This role requires expertise in Optimizely and Adobe Analytics, and experience designing, implementing, and analyzing experiments. You will collaborate with cross-functional teams and present findings to stakeholders. The position is remote, ideally based out of our Cary, NC office. Brillio offers a competitive salary and a dynamic, collaborative work environment.

Requirements

• 5+ years of experience in digital optimization, A/B testing, or website analytics
• Strong proficiency in Optimizely and Adobe Analytics
• Experience designing and analyzing experiments, including statistical significance testing and KPI measurement
• Strong analytical and problem-solving skills with the ability to translate data into actionable insights
• Excellent communication skills and the ability to convey complex data findings to non-technical stakeholders
• A proactive, detail-oriented mindset with a passion for experimentation and continuous improvement

Responsibilities

• Lead the end-to-end A/B testing program, including test ideation, prioritization, execution, and analysis
• Use Optimizely to set up and manage experiments on website user experience changes
• Analyze experiment data using Adobe Analytics and other web analytics tools to evaluate test performance and impact on downstream web KPIs (e.g., conversion rates, engagement, revenue impact)
• Collaborate with cross-functional teams, including UX designers, developers, and product managers, to implement and refine testing strategies
• Develop and maintain a structured experimentation roadmap aligned with business objectives
• Present findings, insights, and recommendations to stakeholders to drive optimization initiatives
• Stay up to date with industry best practices and emerging trends in A/B testing, personalization, and website optimization

Preferred Qualifications

• Experience working in e-commerce, professional services, or digital marketing environments
• Knowledge of additional analytics tools such as Google Analytics, SQL, Python, or R is a plus
• Exposure to personalization strategies and AI-driven optimization

Benefits

• Remote work
• $110 - $120 a year