Senior Software Engineer II, MLOps, Retrieval Infra

Summary

Join HubSpot's MLOps Group as a Senior Software Engineer and contribute to the development of cutting-edge AI. You will be part of the ML Retrieval Infra team, responsible for building and maintaining the infrastructure powering retrieval-based AI features. Collaborate with machine learning and product engineering teams to integrate retrieval infrastructure into HubSpot's product ecosystem. Stay current with advancements in retrieval, databases, and AI infrastructure. Ensure data security, privacy, and compliance. This role requires backend development experience and ideally, experience with vector databases and scalable retrieval applications. HubSpot offers a flexible work environment with opportunities for in-person collaboration.

Requirements

• Have backend development experience
• Have experience in building scalable retrieval applications
• Have worked with cloud infrastructure
• Take ownership, work collaboratively, and figure things out
• Have shown that they can solve complicated technical problems and analyse tradeoffs with empathy for the developers, yet build creative solutions

Responsibilities

• Design & Develop Scalable Retrieval Infrastructure
• Build and maintain the infrastructure powering retrieval-based AI features like Retrieval Augmented Generation and recommendation engines
• Ensure the vector search engine is scalable, reliable, and easy to maintain by enhancing deployment, monitoring, and fault tolerance
• Develop monitoring solutions to maintain the health and performance of the retrieval infrastructure
• Collaborate with AI and Product Engineering Teams
• Partner with machine learning and product engineering teams to integrate retrieval infrastructure into HubSpot’s product ecosystem
• Provide tooling and support to accelerate AI adoption and scaling across products
• Innovate in Retrieval Technologies
• Stay current with advancements in retrieval, databases, and AI infrastructure, applying cutting-edge solutions to enhance HubSpot’s AI capabilities
• Experiment with new retrieval strategies, AI model integration, and distributed systems to improve AI applications
• Ensure Data Security, Privacy, and Compliance
• Implement security and compliance measures, including anonymization and encryption, to manage sensitive data in retrieval systems
• Work with compliance teams to align retrieval infrastructure with HubSpot’s data governance policies

Preferred Qualifications

• Ideally, you have experience managing or working closely with a vector database
• You are excited about current developments and the future of the retrieval space

Benefits

• At HubSpot, we value both flexibility and connection. Whether you’re a Remote employee, or work from the Office
• If you are joining our Engineering team in a full-time role, you will be required to attend a regional HubSpot office for in-person onboarding
• If you join our broader Product team, you’ll also attend other in-person events such as HubSpot’s annual PEER week, your Product Group Summit, and other in-person gatherings to continue building on those connections
• If you require an accommodation due to travel limitations or other reasons, please inform your recruiter during the hiring process. We are committed to supporting candidates who may need alternative arrangements