Avatar for Bishop Fox
Bishop Fox
Actively Hiring
Experienced hackers use the latest techniques to simulate real-world attacks on a business
  • B2B
  • Growth Stage
    Expanding market presence
  • 4.9
    Highly rated
    Bishop Fox is highly rated on Glassdoor, with 4.9 out of 5 stars
  • +1

Senior AI/LLM Penetration Tester

Posted: 3 weeks ago
Hires remotely in
Remote Work Policy

Remote only

Company Location
Atlanta • 
Barcelona • 
New York • 
Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
Java
Javascript
Networking
Authentication
Azure
AWS
authorization
Go
Application Security Assessments
Dynamic Testing
GCP
APIs
Source Code Review
Google Vertex AI
Azure OpenAI
Sliver
Amazon Bedrock
Prompt Injection
AI Governance Frameworks
Secure Software Development Practices
Penetration Tests
Red Team Engagements
Model Security
Modern AI Architectures
Building AI Agents
Jailbreak Techniques
Indirect Prompt Injection
APIs Security Testing
AI Software Development Lifecycle
Manual Application Security Testing
AIMap
Data Leakage and Sensitive Information Disclosure
Insecure Tool/function Calling
Agentic AI Abuse
Model Misuse and Unsafe Output Generation
OWASP Top 10 Web
OWASP Agentic
OWASP LLM Applications
Cloud Infrastructure Security Testing
Application Logic Security Testing
LLM Application Orchestration Frameworks
Agent-Orchestration Frameworks
Inference Provider APIs
External Capability Integration for Models
Commercial LLM Tooling
Self-Hosted LLM Tooling
AI Red Team Exercises
Emerging AI Attack Techniques Research
Offensive Security Community Contributions
Securing AI Agents
Building Autonomous Workflows
Securing Autonomous Workflows
Adversarial Machine Learning Concepts

About the job

For more than two decades, Bishop Fox has defined the forefront of offensive security. By combining elite human expertise with the power of its proprietary Cosmos AI engine, the firm delivers industry-leading cloud and application security services, including AI-powered penetration testing and AI/LLM security assessments that reflect real-world attacker behavior. Renowned for its innovation and contributions to the open-source community through flagship tools likeSliver and AIMap, Bishop Fox has released 25+ tools and 75+ advisories in the last 10 years. 

As a trusted partner to the world’s most recognizable brands, Bishop Fox protects 26 of the Fortune 100, eight of the top 10 global tech companies, all of the top five global media companies, 10 of the top 20 retailers and 7 of the top 10 manufacturers. A consistent market leader, Bishop Fox has been recognized as a Leader and "Fast Mover" in the GigaOm Radar for Attack Surface Management for five consecutive years. With a 70 NPS rating, the firm remains the trusted partner for organizations seeking to stay ahead of the evolving threat landscape. Learn more at bishopfox.com.

We are now hiring a Senior AI/LLM Security Consultant to help clients stay ahead of emerging AI threats by conducting cutting-edge security assessments of large language models, AI agents, and AI-powered applications.

Who You Are and What You’ll Do

Our wants are simple: be good at—and most importantly—love what you do. Here's what we're looking for:

  • 5+ years of offensive security experience performing penetration tests, red team engagements, or application security assessments

  • Experience assessing AI/LLM-powered applications for vulnerabilities such as:

    • Prompt injection
    • Jailbreak techniques
    • Indirect prompt injection
    • Data leakage and sensitive information disclosure
    • Insecure tool/function calling
    • Agentic AI abuse
    • Model misuse and unsafe output generation
    • Understanding of modern AI architectures, including:
  • Experience performing manual application security testing beyond automated scanning

  • Strong understanding of web application security fundamentals, including the OWASP Top 10 Web, Agentic, and LLM Applications.

  • Experience reviewing AI application architectures and identifying security weaknesses across APIs, cloud infrastructure, and application logic

  • Experience performing source code review and dynamic testing

  • Familiarity with cloud platforms (AWS, Azure, or GCP) and securing AI workloads

  • Scripting or programming experience in Python, JavaScript Go, Java, or similar languages

  • Familiarity with LLM application and agent-orchestration frameworks, inference provider APIs, external capability integration for models, and open source tooling across commercial and self-hosted ecosystems.

  • Knowledge of authentication, authorization, networking, APIs, and secure software development practices

  • Excellent written and verbal communication skills, including presenting findings to technical and executive audiences

  • Ability to mentor teammates and contribute to internal research, tooling, and methodology development

  • OSCP, OSEP, GWAPT, GPEN, GXPN, or other relevant certifications are helpful but not required

  • Bachelor's degree in Computer Science, Cybersecurity, or a related technical field is a plus

What Sets You Apart

  • Experience conducting AI red team exercises against production or pre-production AI systems

  • Research into emerging AI attack techniques or contributions to the offensive security community

  • Experience building or securing AI agents and autonomous workflows

  • Knowledge of adversarial machine learning concepts and model security

  • Experience with cloud-native AI platforms such as Azure OpenAI, Amazon Bedrock, or Google Vertex AI

  • Familiarity with AI software development lifecycle (AI SDLC) and AI governance frameworks

Why Bishop Fox

At Bishop Fox, we're driven by a simple mission: deliver exceptional quality to our clients, foster a vibrant and fulfilling environment for our team, and champion excellence within our industry. Our core values, which we live by every day, are:

  • Be Excellent to Each Other

  • Do the Right Thing

  • Do What You’ll Say You’ll Do

  • Get Better Together

  • Give a Sh*t

This position is not eligible for visa sponsorship. Applicants must be authorized to work in the United States of America for the duration of employment without sponsorship.

Bishop Fox has always allowed its employees to work remotely, and this role can be based anywhere in the United States.

Our comprehensive benefits program is tailored to meet your needs at an affordable price. We embrace diversity and foster an inclusive culture where employees are empowered to do their best work while advancing the security community through world-class research and consulting.

Bishop Fox is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including sexual orientation and gender identity), national origin, disability, protected veteran status, or any other characteristic protected by applicable federal, state, or local law. All new hires must successfully complete a background check as a condition of employment.

Interested? Apply today!

About the company

Bishop Fox company logo

Bishop Fox

Actively Hiring
Experienced hackers use the latest techniques to simulate real-world attacks on a business201-500 Employees
  • B2B
  • Growth Stage
    Expanding market presence
  • 4.9
    Highly rated
    Bishop Fox is highly rated on Glassdoor, with 4.9 out of 5 stars
  • 4.8
    Strong Leadership
    Employees rate Bishop Fox 4.8/5 on Glassdoor for faith in leadership
Learn more about Bishop Fox image

Funding

AMOUNT RAISED
$146M
FUNDED OVER
3 rounds
Rounds
B
$46000000
Series B - Nov 2022+2

Perks

healthcare package
Full medical, dental and vision
family leave
Maternity and paternity leave
ALL YOU, ALL THE TIME
Work from anywhere Annual training budgets
time off
Paid vacations and holidays
PURE FREEBIE GLUTTONY
Fully stocked kitchen So much swag…like, SO much
personal perks
Phone plan Commuter benefits program