Avatar for Raydar
Helping companies find solutions to supercharge growth

Machine Learning Engineer

Posted: 4 days ago
Job Location
Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Evaluation Infrastructure
LLM-Based Agent Applications
Structured ML Experiments

About the job

About the Company

Our client is a Series B AI company, valued above $1B, whose agents do real work in a high-stakes, regulated professional domain. Founded in 2023, it has raised more than $100M, has grown from about 60 to roughly 150 employees this year and expects to keep growing quickly. The team is based in New York City.

About the Role

Own end-to-end projects that bring intelligence into production. You will be responsible for systems that help agents reason, plan and evaluate themselves, with full autonomy to plan projects, define success, run experiments and decide when a system is ready to ship. This role suits engineers who want to operate like researchers and builders at once.

What You Will Do

• Design and iterate multi-agent architectures, encoding autonomy boundaries, tool use and fallback behavior that make agents safe and reliable.

• Build scalable offline and online evaluation pipelines that run hundreds of experiments, with golden tasks, labeling strategies and metrics.

• Instrument the stack to detect regressions, track error taxonomies and drive closed-loop improvement.

• Engineer context and retrieval: prompt stacks, indexing pipelines and parsing of messy documents into structured representations.

• Scope projects clearly, write concise specs and communicate progress within your pod.

What We Are Looking For

• Four to twelve years as a machine learning engineer, with end-to-end LLM-based agent applications including benchmarking, orchestration and evaluations.

• Experience at a fast-paced startup (Series A to D), a quant or hedge fund, or a top-tier technology company.

• Experience running structured ML experiments and building evaluation infrastructure.

• A CS, Physics, Math or related technical degree from a top school. The role is applied rather than research-focused.

• A very clear communicator who can break complex ideas down.

• Currently located in the US or Canada, ideally on the East Coast.

Bonus Points

• Deep Python expertise and LLM or transformer-based systems.

• Interest in the impact of AI on professional services and the economy.

Compensation and Benefits

$175,000-$350,000 base salary plus highly competitive equity, depending on experience. Visa transfers and sponsorship are available.

Location and Work Model

Full-time and on-site five days a week in Flatiron, New York City.

Similar Jobs

Kick Health company logo
Kick Health
The Online Performance Medicine Clinic for Energizing Sleep and Confident Presentations
Scale AI company logo
Scale AI
Accelerate the development of AI applications
Pulse company logo
Pulse
Transforming healthcare by creating remarkable experiences for doctors and patients
Merciv company logo
Merciv
The Future of Enterprise Intelligence. Read your data’s past. Write your company’s future
Counsel Health company logo
Counsel Health
Counsel offers 24/7 physician-led, AI-enhanced medical advice
Crosby company logo
Crosby
AI-native law firm that combined AI & lawyers to redefine the speed of legal services
Alloy company logo
Alloy
Alloy helps banks and fintech companies make safe and seamless fraud, credit