Avatar for Microsoft
Microsoft
Actively Hiring
More jobs
Help People and Businesses Throughout the World Realize Their Full Potential
  • B2C
  • B2B
  • Public Stage
    Publicly traded company

AI Security Engineer

Posted: 1 month ago
Hires remotely in
Remote Work Policy

Remote only

Company Location
Redmond
Visa Sponsorship

Not Available

RelocationAllowed
Skills
Cybersecurity
Anomaly Detection
modeling
Threat Analysis
Software Development Lifecycle
Vulnerability Research
Large-Scale Computing

About the job

Overview

The Cloud & AI organization accelerates Microsoft's mission to secure digital technology platforms, devices, clouds, and AI systems across customers' heterogeneous environments and Microsoft's internal estate. Our culture is centered on a growth mindset, inspiring excellence, and helping teams and leaders bring their best every day.

Microsoft Red Team (MRT) emulates real-world advanced persistent threats against Microsoft, external customers, and frontier AI systems. As AI systems become increasingly capable at reasoning, coding, tool use, exploitation, and autonomous execution, understanding when and how those systems materially increase offensive cyber capability is an important component of Microsoft's AI security mission.

MRT Strategic AI is seeking an AI Security Engineer focused on Cyber Capability Evaluation. This is a hands-on technical role for implementing and executing evaluations of frontier AI models and agentic systems in realistic, controlled cyber environments. The engineer will work at the intersection of offensive security, AI agents, model evaluation, and experimental engineering to build and maintain evaluation tasks, run experiments, analyze model behavior, and determine whether observed results represent meaningful cyber capability, an evaluation artifact, or a limitation in the test environment.

The role requires the ability to work independently within established technical direction, solve engineering and security problems, and contribute improvements to evaluation methods, cyber ranges, scoring, telemetry, and containment. The right candidate combines offensive-security experience with experimental discipline, programming skills, and an interest in emerging AI capabilities.

Responsibilities

  • Design, implement, and operate offensive cyber-capability evaluations for frontier, preview, production, and open-weight AI models.
  • Build and maintain realistic evaluation tasks covering vulnerability analysis, exploit development, application and system exploitation, attack-path reasoning, post-exploitation activities, and multi-step offensive workflows.
  • Execute controlled experiments using AI models; define success criteria and baselines; collect reliable telemetry; and document results.
  • Analyze model trajectories and investigate unexpected behavior to determine whether it reflects genuine capability, task leakage, environmental flaws, scoring errors, or other evaluation artifacts.
  • Develop and maintain cyber ranges, vulnerable applications, exploit-development targets, and evaluation harnesses, and apply security controls for sandboxing, secrets management, telemetry, access, and containment when testing autonomous AI systems.
  • Partner with red-team operators, researchers, engineers, and Responsible AI stakeholders to translate evaluation findings into security insights, and communicate results through reports, documentation, and briefings.

Qualifications

Minimum Qualifications:

  • Master's Degree in Statistics, Mathematics, Computer Science, Computer Security, or related field AND 1+ year(s) experience in software development lifecycle, large-scale computing, threat analysis or modeling, cybersecurity, vulnerability research, and/or anomaly detection.

  • OR Bachelor's Degree in Statistics, Mathematics, Computer Science, Computer Security, or related field AND 2+ years experience in software development lifecycle, large-scale computing, threat analysis or modeling, cybersecurity, vulnerability research, and/or anomaly detection.

  • OR equivalent experience.

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

Microsoft Cloud Background Check

  • This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter.
  • This role will require access to information that is controlled for export under export control regulations, potentially under the U.S. International Traffic in Arms Regulations or Export Administration Regulations, the EU Dual Use Regulation, and/or other export control regulations. As a condition of employment, the successful candidate will be required to provide proof of citizenship, U.S. permanent residency, or other protected status (e.g., under 8 U.S.C.
  • 1324b(a)(3)) for assessment of eligibility to access the export-controlled information. To meet this legal requirement, and as a condition of employment, the successful candidate’s citizenship will be verified with a valid passport. Lawful permanent residents, refugees, and asylees may verify status using other documents, where applicable.
  • This position requires verification of citizenship due to citizenship-based legal restrictions. Specifically, this position supports United States federal, state, and/or local government agency customers and is subject to certain citizenship-based restrictions where required or permitted by applicable law. To meet this legal requirement, and as a condition of employment, the successful candidate’s citizenship will be verified with a valid passport.

Preferred Qualifications

  • Doctorate in Statistics, Mathematics, Computer Science, Computer Security, or related field OR Master's Degree in Statistics, Mathematics, Computer Science, Computer Security, or related field AND 3+ years experience in software development lifecycle, large-scale computing, threat analysis or modeling, cybersecurity, vulnerability research, and/or anomaly detection.

  • OR Bachelor's Degree in Statistics, Mathematics, Computer Science, Computer Security, or related field AND 5+ years experience in software development lifecycle, large-scale computing, threat analysis or modeling, cybersecurity, vulnerability research, and/or anomaly detection.

  • OR equivalent experience.

  • Programming ability, particularly in Python, with experience building automation, scripts, or security tooling.

  • Familiarity with large language models, generative AI systems, coding models, AI agents, or model APIs.

  • Ability to follow experimental methodology, record results accurately, and document technical findings clearly.

  • Exposure to security labs, cyber ranges, capture-the-flag environments, or vulnerable applications.

  • Experience contributing to cyber-capability evaluations or model-evaluation work for AI or agentic systems.

  • Coursework, internship, competition, or project experience in exploit development, vulnerability research, penetration testing, application security, or red teaming.

  • Experience working with coding agents, tool-using models, or autonomous agent frameworks.

  • Experience building capture-the-flag challenges, vulnerable applications, or exploit-development targets.

  • Familiarity with PyRIT, adversarial-testing tools, or comparable model-evaluation frameworks.

  • Familiarity with containers, sandboxed execution, or cloud-based test infrastructure.

  • Hands-on cybersecurity experience with systems, networks, applications, vulnerability analysis, penetration testing, red teaming, or exploitation in authorized environments.

  • Experience working with large language models, generative AI systems, coding models, AI agents, model APIs, or model-evaluation frameworks.

  • Experience designing controlled experiments, defining success criteria, analyzing results, and documenting technical findings.

  • Familiarity with common evaluation risks, including contamination, task saturation, unreliable scoring, weak baselines, environmental leakage, and limited reproducibility.

#MSSecurity

Security Research IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

Security Research IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

About the company

Microsoft company logo

Microsoft

Actively Hiring
More jobs
Help People and Businesses Throughout the World Realize Their Full Potential5000+ Employees
Company Location
Redmond
Company Size
5000+
Company Type
VC Firm
  • B2C
  • B2B
  • Public Stage
    Publicly traded company
Learn more about Microsoft image

Funding

AMOUNT RAISED
Undisclosed amount
FUNDED OVER
1 round
Round
IPO
Undisclosed amount
IPO - Mar 1986

Perks

Industry leading healthcare
Maternity and paternity leave
Generous time away
Giving programs
Discounts on products and services
Educational Resources
Opportunities to network and connect
Savings and Investments

Founders

Adam Menges
Lobe
San Francisco
image
Phung Huynh Ngoc
Founder
image
Sergey Yaroslav
Lead Developer • 18 years
Auckland
image
View the team image