Cybersecurity Expert - AI Model Evaluation

Get paid to help build better AI.

Alpheva AI (www.Alpheva.ai), the Silicon Valley company that is building intelligence behind frontier AI, is looking for experienced cybersecurity professionals to participate in paid, project-based work that helps train and evaluate the next generation of AI systems.

You work remotely and asynchronously on projects that fit around your existing schedule.

Your cybersecurity expertise becomes the signal that helps AI systems learn what accurate, secure, and professionally sound cybersecurity work actually looks like.

IMPORTANT: To be considered, Apply directly through: https://alpheva.ai/experts/

What you'll do

Depending on the project, you may:

• Analyze: Review cybersecurity scenarios, security architectures, vulnerabilities, threats, incidents, logs, and security controls.
• Evaluate: Review AI-generated cybersecurity analysis, recommendations, risk assessments, and security solutions.
• Validate: Determine whether AI-generated cybersecurity outputs are accurate, technically sound, secure, and consistent with established security principles.
• Review: Assess security configurations, incident response plans, vulnerability assessments, threat models, access controls, and security policies.
• Reason: Solve realistic cybersecurity problems and explain how an experienced cybersecurity professional would approach them.
• Compare solutions: Assess multiple AI-generated cybersecurity solutions and identify meaningful differences in accuracy, security, reasoning, risk, and professional judgment.
• Create evaluations: Develop challenging cybersecurity tasks and criteria for measuring AI systems.
• Provide expert judgment: Identify vulnerabilities, security gaps, incorrect assumptions, unsafe recommendations, and technically incorrect conclusions in AI-generated work.

Projects may involve information security, network security, cloud security, application security, cybersecurity risk management, threat intelligence, vulnerability management, incident response, penetration testing, identity and access management, security operations, compliance, and other areas depending on your expertise.

Who we're looking for

We're looking for experienced cybersecurity professionals, not necessarily AI researchers.

You should have:

1. 3+ years of professional experience in cybersecurity, information security, network security, application security, cloud security, or a related field
2. Strong cybersecurity and analytical reasoning skills
3. Experience working with real-world security systems, incidents, vulnerabilities, or security operations
4. Ability to evaluate cybersecurity analysis and recommendations critically
5. Strong attention to detail
6. Ability to identify security vulnerabilities, risks, inconsistencies, and unsupported assumptions
7. Strong professional judgment
8. Ability to clearly explain why a security recommendation, assessment, or conclusion is correct or incorrect
9. Experience with any of the following is valuable:
10. Information and network security
11. Cloud security
12. Application and software security
13. Vulnerability management
14. Penetration testing and security testing
15. Threat intelligence and threat analysis
16. Security operations and incident response
17. Identity and access management
18. Security architecture and engineering
19. Governance, risk, and compliance
20. Security monitoring and detection
21. Security frameworks, standards, and best practices
22. Relevant cybersecurity degree, certification, or professional qualification
23. You do not need prior experience working in AI.

What matters most is that you know how to do cybersecurity work well.

You might be asked to:

Review an AI-generated cybersecurity analysis and identify the issues.

Evaluate whether an AI-generated vulnerability assessment is technically accurate.

Assess whether a security recommendation appropriately addresses a specific threat or risk.

Review an AI-generated incident response plan and identify weaknesses.

Compare two AI-generated cybersecurity solutions and determine which is stronger.

Evaluate an AI-generated security architecture or configuration.

Analyze a realistic cybersecurity scenario and explain your reasoning.

Identify security vulnerabilities, gaps, inconsistencies, or unsupported conclusions.

Assess whether an AI-generated recommendation appropriately considers attack surfaces, security controls, risk, business impact, and operational constraints.

Create challenging cybersecurity problems that can be used to evaluate AI systems.

The goal is not simply to determine whether cybersecurity work looks reasonable.

The goal is to capture the judgment an experienced cybersecurity professional uses to determine whether cybersecurity work is actually secure and technically sound.

Compensation

Paid project-based work.

Rates vary based on your experience, specialization, and project requirements. Your applicable rate and project scope will be shown before you commit to a project.

Some projects are short assignments. Others may involve recurring work over a longer period.

There is no fixed schedule and no minimum commitment.

Work arrangement

• Remote
• Asynchronous
• Project-based
• Flexible hours
• Work around your existing job or commitments
• Paid for qualifying project work

But producing a plausible-looking cybersecurity answer is not the same as demonstrating strong cybersecurity judgment.

AI needs to learn how experienced cybersecurity professionals:

• Analyze security information
• Identify vulnerabilities and threats
• Evaluate security controls
• Assess attack surfaces and risks
• Analyze security architectures
• Evaluate incident response strategies
• Assess access controls and security configurations
• Identify security gaps and weaknesses
• Evaluate assumptions and supporting evidence
• Recognize important security edge cases
• Compare alternative security solutions
• Assess business and operational impact
• Explain security conclusions clearly
• Determine when cybersecurity analysis is actually reliable

That's where you come in.

Your cybersecurity expertise helps shape how AI learns to reason about security.

How it works

1. Apply

Tell us about your cybersecurity background, experience, qualifications, and areas of expertise.

1. Get qualified

Complete a short assessment designed around the type of cybersecurity work you'll perform.

1. Get matched

When your experience matches an active project, we'll share the scope, requirements, and compensation.

1. Do the work

Complete projects remotely and asynchronously.

1. Get paid

Receive the agreed rate for your completed work.

Help teach AI how great cybersecurity professionals actually work.

Apply directly through: https://alpheva.ai/experts/