Senior Software Engineer II, MLOps, Retrieval Infra

POS-23567

About the Role:

HubSpot is at the forefront of empowering businesses with cutting-edge AI, and our MLOps Group is at the heart of this initiative. We are seeking a Senior Software Engineer with a passion for machine learning operations and data engineering to join our ML Retrieval Infra team.

The ML Retrieval Infra team is part of the MLOps whose goal is to provide infrastructure and tooling to Machine Learning Engineers to be able to excel in their work while also accelerating HubSpot Product & Engineering teams to adopt AI throughout the HubSpot product suite.

Specifically, the ML Retrieval Infra team owns the lower-level components to power retrieval-powered AI applications like RAG (Retrieval Augment Generation) or recommendation use cases. Some of those components include a VectorDB and the layers on top of it.

Responsibilities:

Design & Develop Scalable Retrieval Infrastructure:

• Build and maintain the infrastructure powering retrieval-based AI features like Retrieval Augmented Generation and recommendation engines.
• Ensure the vector search engine is scalable, reliable, and easy to maintain by enhancing deployment, monitoring, and fault tolerance.
• Develop monitoring solutions to maintain the health and performance of the retrieval infrastructure.

Collaborate with AI and Product Engineering Teams:

• Partner with machine learning and product engineering teams to integrate retrieval infrastructure into HubSpot’s product ecosystem.
• Provide tooling and support to accelerate AI adoption and scaling across products.

Innovate in Retrieval Technologies:

• Stay current with advancements in retrieval, databases, and AI infrastructure, applying cutting-edge solutions to enhance HubSpot’s AI capabilities.
• Experiment with new retrieval strategies, AI model integration, and distributed systems to improve AI applications.

Ensure Data Security, Privacy, and Compliance:

• Implement security and compliance measures, including anonymization and encryption, to manage sensitive data in retrieval systems.
• Work with compliance teams to align retrieval infrastructure with HubSpot’s data governance policies.

You'll be a fit if:

• You have backend development experience. We work with Java, MySQL, Hbase, AWS, DropWizard, Kafka and Kubernetes primarily, but experience with specific technologies is secondary to understanding programming fundamentals.
• Ideally, you have experience managing or working closely with a vector database
• Have experience in building scalable retrieval applications
• You are excited about current developments and the future of the retrieval space
• Have worked with cloud infrastructure
• You not only get excited about big, technical challenges but also about being very close to the business and our go-to-market strategies
• Take ownership, work collaboratively, and figure things out
• Someone who has shown that they can solve complicated technical problems and analyse tradeoffs with empathy for the developers, yet build creative solutions.

We know the confidence gap* and* imposter syndrome can get in the way of meeting spectacular candidates, so please don’t hesitate to apply — we’d love to hear from you.

**If you need accommodations or assistance due to a disability, please reach out to us using this form.* This information will be treated as confidential and used only for the purpose of determining an appropriate accommodation for the interview process.*

*At HubSpot, we value both flexibility and connection. Whether you’re a Remote employee, or work from the Office, we want you to start your journey here by building strong connections with your team and peers. *

If you are joining our Engineering team in a full-time role, you will be required to attend a regional HubSpot office for in-person onboarding. If you join our broader Product team, you’ll also attend other in-person events such as HubSpot’s annual PEER week, your Product Group Summit, and other in-person gatherings to continue building on those connections.

If you require an accommodation due to travel limitations or other reasons, please inform your recruiter during the hiring process. We are committed to supporting candidates who may need alternative arrangements.

**Germany Applicants:* (m/f/d) - link to HubSpot's Career Diversity page here.*

**India* Applicants: link to HubSpot India's equal opportunity policy here.*

About HubSpot

HubSpot (NYSE: HUBS) is a leading customer relationship management (CRM) platform that provides software and support to help businesses grow better. We build marketing, sales, service, and website management products that start free and scale to meet our customers’ needs at any stage of growth. We’re also building a company culture that empowers people to do their best work. If that sounds like something you’d like to be part of, we’d love to hear from you.

You can find out more about our company culture in the HubSpot Culture Code, which has more than 5M views, and learn about our commitment to creating a diverse and inclusive workplace, too. Thanks to the work of every employee globally, HubSpot was named the #2 Best Place to Work on Glassdoor in 2022 and has been recognized for its award-winning culture by Great Place to Work, Comparably, Fortune, Entrepreneur, Inc., and more.

Headquartered in Cambridge, Massachusetts, HubSpot was founded in 2006. Today, thousands of employees across the globe work remotely and in HubSpot offices. Visit our careers website to learn more about the culture and opportunities at HubSpot.

By submitting your application, you agree that HubSpot may collect your personal data for recruiting, global organization planning, and related purposes. HubSpot's *Privacy Notice** explains what personal information we may process, where we may process your personal information, our purposes for processing your personal information, and the rights you can exercise over HubSpot’s use of your personal information.*