Senior Software Engineer II, MLOps, Retrieval Infra

Summary

Join HubSpot's MLOps Group as a Senior Software Engineer and contribute to the development of cutting-edge AI. As part of the ML Retrieval Infra team, you will design, develop, and maintain scalable retrieval infrastructure for AI applications like RAG and recommendation engines. Collaborate with machine learning and product engineering teams to integrate this infrastructure into HubSpot's product ecosystem. Stay current with advancements in retrieval technologies and experiment with new strategies to enhance AI capabilities. Ensure data security, privacy, and compliance throughout the process. This role requires backend development experience and ideally, experience with vector databases and scalable retrieval applications.

Requirements

• Have backend development experience
• Have experience in building scalable retrieval applications
• Have worked with cloud infrastructure
• Take ownership, work collaboratively, and figure things out
• Show that you can solve complicated technical problems and analyse tradeoffs with empathy for the developers, yet build creative solutions

Responsibilities

• Design & Develop Scalable Retrieval Infrastructure
• Build and maintain the infrastructure powering retrieval-based AI features like Retrieval Augmented Generation and recommendation engines
• Ensure the vector search engine is scalable, reliable, and easy to maintain by enhancing deployment, monitoring, and fault tolerance
• Develop monitoring solutions to maintain the health and performance of the retrieval infrastructure
• Collaborate with AI and Product Engineering Teams
• Partner with machine learning and product engineering teams to integrate retrieval infrastructure into HubSpot’s product ecosystem
• Provide tooling and support to accelerate AI adoption and scaling across products
• Innovate in Retrieval Technologies
• Stay current with advancements in retrieval, databases, and AI infrastructure, applying cutting-edge solutions to enhance HubSpot’s AI capabilities
• Experiment with new retrieval strategies, AI model integration, and distributed systems to improve AI applications
• Ensure Data Security, Privacy, and Compliance
• Implement security and compliance measures, including anonymization and encryption, to manage sensitive data in retrieval systems
• Work with compliance teams to align retrieval infrastructure with HubSpot’s data governance policies

Preferred Qualifications

• Ideally, you have experience managing or working closely with a vector database
• You are excited about current developments and the future of the retrieval space

Benefits

• At HubSpot, we value both flexibility and connection. Whether you’re a Remote employee, or work from the Office
• If you are joining our Engineering team in a full-time role, you will be required to attend a regional HubSpot office for in-person onboarding
• If you join our broader Product team, you’ll also attend other in-person events such as HubSpot’s annual PEER week, your Product Group Summit, and other in-person gatherings to continue building on those connections
• If you require an accommodation due to travel limitations or other reasons, please inform your recruiter during the hiring process. We are committed to supporting candidates who may need alternative arrangements