Avatar for Rapid7
Vulnerability management & penetration testing software
  • B2B
  • Public Stage
    Publicly traded company

Principal AI Engineer

  • $221k – $299k
  • |Remote ()
  • |12 years of exp
  • |Full Time
Posted: 1 week ago
Hires remotely in
Remote Work Policy

Remote only

Company Location
Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
Distributed Systems
Memory
Tokenization
Distillation
Dpo
LoRa
PyTorch
Attention
FSDP
Quantization
Distributed Training
DeepSpeed
QLoRA
vLLM
Predictive AI
Transformer Architecture
Context Management
SGLang
GRPO
Retrieval
Parameter-Efficient Fine-Tuning
TensorRT-LLM
Classical ML
Mixed Precision
Speculative Decoding
KV-Cache Management
FlashAttention
Training Loops
Decode
PagedAttention
Continuous Batching
Prefix Caching
Full Fine-Tuning
Positional Encodings
Prefill
Evaluation Strategy
Preference Methods
Custom Model Code
RL-Based Methods
Benchmarks for LLM and Agent Systems

About the job

Our Engineering organisation is scaling its AI Engineering capabilities under new leadership, creating an opportunity to build the next generation of AI at Rapid7. We’re looking for Principal AI Engineers to join us and help shape what comes next by defining and influencing the technical direction of our LLM and agentic AI systems. As a Principal AI Engineer, you’ll raise the bar for engineering standards, and build truly cutting edge greenfield solutions that deliver real impact for our Global customers. Through your technical leadership and mentoring, you’ll help shape our product and platform investments and influence how we build and scale AI across the organisation.About The TeamAI is reshaping cybersecurity on both sides. Attackers can use AI to strike at machine speed, and only AI-powered defense can keep up. At the same time, organizations can only adopt AI with confidence if it is secure. Rapid7 sits at the intersection of security and AI, and we are building industry-defining products for this new era.Rapid7's AI Engineering team builds the AI that powers our security platform. We are AI engineers and applied scientists who take models from research to production, combining open-source and frontier LLMs, AI agents, and fast predictive models with more than 20 years of Rapid7 security expertise. Our work drives core use cases across Detection and Response, such as alert triage, threat investigation, and automated response, and Exposure and Remediation, such as vulnerability prioritization, attack surface risk assessment, and guided remediation. Together, these help customers stop threats faster and fix what matters most.About The RoleAs a Principal AI Engineer, you will set the technical direction for how Rapid7 builds, tunes and serves LLMs and agentic systems across its security products. You understand LLMs from the ground up, from transformer internals and training to fine-tuning and inference optimization, and you stay hands-on with the hardest problems. You know where LLMs shine and where they fall short, and you treat them as one tool in the AI toolbox, alongside predictive AI and classical ML, choosing the right approach for each problem. Specifically your focus will be to:Define the architecture and technical roadmap for LLM and agentic AI systems across Detection and Response and Exposure and RemediationLead model strategy: when to use frontier or open-source models, and when to fine-tune, distill, or post-train Fine-tune, distill and post-train open-source LLMs on security data, from data curation through training, evaluation and deploymentSet engineering standards for context engineering, inference optimization, and evaluation across teamsOptimize LLM inference at scale with techniques such as speculative decoding, KV-cache management, continuous batching, quantization and custom kernels, balancing quality, latency and cost Establish evals as the release gate for every AI system we shipLead design reviews and resolve the hardest technical trade-offsStay hands-on: prototype and build critical model, training and inference code yourselfMentor Staff and Senior engineers and shape product and platform investmentThe Skills And Qualities You’ll Bring Include12+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems. A PhD in Computer Science, Machine Learning, AI or a related field is preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributionsA track record of building scalable, production-grade AI systems used across multiple teams or products with a strong history of organization-wide impact through technical leadership, mentoring, and shared platforms and standards LLMs from first principles: deep understanding of transformer architecture, attention, tokenization and positional encodings, and how models are trained and served, with the ability to implement core components from scratchPyTorch: expert-level, including custom model code, training loops, mixed precision and distributed training (e.g., FSDP, DeepSpeed)Fine-tuning and post-training: hands-on full and parameter-efficient fine-tuning (LoRA, QLoRA) of open-weight LLMs, distillation, and preference or RL-based methods (e.g., DPO, GRPO) Context engineering: retrieval, memory, and context management for long-running agent workflowsInference optimization: deep knowledge of prefill and decode, KV-cache management (e.g., PagedAttention, prefix caching), continuous batching, speculative decoding, FlashAttention and quantization, and serving at scale with vLLM, SGLang or TensorRT-LLM Evals: defining evaluation strategy and benchmarks for LLM and agent systemsStrong predictive AI and classical ML fundamentals, and the judgment to choose between them and LLMs based on accuracy, latency and costStrong distributed systems and Python fundamentalsTakes ownership of significant technical outcomes across multiple teams, proactively identifying and addressing risks, driving complex challenges to resolution and ensuring solutions deliver against agreed technical and customer objectivesStrong communicator with the ability to explain technical trade-offs to engineering, product, and leadership audiencesBuilds strong cross functional partnerships across Engineering, Product, and other teams to align on technical direction and deliver shared outcomesConnects customer needs and business priorities to technical decisions, evaluating the value, cost and trade-offs of AI solutions to ensure investments deliver measurable customer and business outcomesEmbody our core values to foster a culture of excellence that drives meaningful impact and collective successPreferred Skills And ExperienceExperience pre-training or training LLMs from scratchExperience writing GPU kernels (CUDA or Triton) and profiling GPU workloadsSecurity domain experience, such as detection engineering, SOC/MDR, or vulnerability managementExperience running AI workloads on AWS at scalePublications, patents, or open-source contributions in AIWe know that the best ideas and solutions come from multi-dimensional teams. That’s because these teams reflect a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact, please don’t be shy - apply today.About Rapid7At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what’s possible and drive extraordinary impact. We’re building a dynamic and collaborative workplace where new ideas are welcome.Protecting 11,500+ customers against bad actors and threats means we’re continuing to push the envelope just like we’ ve been doing for the past 20 years. If you ’re ready to solve some of the toughest challenges in cybersecurity, we’re ready to help you take command of your career. Join us.Rapid7, Inc. is committed to fair and equitable compensation practices. A candidate’s salary is determined by various factors including, but not limited to, relevant work experience, skills, and certifications. We evaluate compensation decisions on a case-by-case basis, and it is not typical for an individual to be hired at the very top of the salary range.The annual salary range for this role, depending on location, is:United States: $221,000.00 - 299,000.00 USD AnnualSalary ranges may vary based on geographical location. This range does not include variable/incentive compensation, equity and benefits (where applicable/eligible).All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or any other status protected by applicable national, federal, state or local law.

About the company

Rapid7 company logo
Vulnerability management & penetration testing software5000+ Employees
  • B2B
  • Public Stage
    Publicly traded company

Employees joined from

Learn more about Rapid7 image

Funding

AMOUNT RAISED
$91M
FUNDED OVER
6 rounds
Rounds
IPO
Undisclosed amount
IPO - Jul 2015+5

Perks

Health
Rest assured with medical and dental insurance through Blue Cross Blue Shield, plus vision insurance for those baby blues.
Compensation
Competitive compensation packages, tax savings accounts, 401K contributions, and an employee stock purchase plan (ESPP).
Time Off
Keep your life in balance with unlimited paid vacation days, company holidays, maternity/paternity leave and a flexible work schedule as needed.
Philanthropy
We love to give back with company-wide community giving days, plus ample opportunity to spend time on the causes you care about.
Modern Workplace
Enjoy a modern workplace featuring the latest collaboration tech, healthy snacks and beverages, quiet spaces, and many ways to let off some steam.
Discounts
From gym memberships to pet insurance, we’re always looking for ways to save you a dime.

Similar Jobs

Archesys company logo
Archesys
Improving the government services that impact everyday lives
TrialSpark company logo
TrialSpark
Our mission is to bring new treatments to patients faster and more efficiently
Blue Ink Digital company logo
Blue Ink Digital
Automated Marketplace for real-time exclusive leads
Lexi company logo
Lexi
Multilingual AI for language access in healthcare
TrialSpark company logo
TrialSpark
Our mission is to bring new treatments to patients faster and more efficiently
TrialSpark company logo
TrialSpark
Our mission is to bring new treatments to patients faster and more efficiently
Iterative Health company logo
Iterative Health
Pioneering the use of artificial intelligence-based solutions for gastroenterology
Snout company logo
Snout
Affordable vet care, for every pet