AI Data Project Manager

Company Intro

At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use a combination of Experts + Crowd + Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domains - from doctors and lawyers to physicists and engineers - and boast one of the most diverse global crowds, representing over 100 countries and speaking 40+ languages. We are a well-funded startup with an enviable portfolio of clients including Anthropic, Amazon, Microsoft, Poolside, Recraft, and Shopify.

Recently, we secured strategic investment led by Bezos Expeditions and Nebius Group with participation from Mikhail Parakhin, CTO of Shopify and board advisor to leading GenAI companies, who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world: USA, UK, the Netherlands, Serbia, and more.

About the position

We're seeking a AI Data Project Manager based in New York City to join our Delivery team and help build, drive, and maintain solutions for our clients.

Joining us in this role means you will lead a virtual cross-functional team and manage successful project implementation end to end. This involves both client communication and internal coordination.

The team consists of talented engineers, supply managers, and other functions involved on an as-needed basis. This is a key role for us to ensure we deliver the best possible experience for our clients and continue growing the business.

Example Projects

• SFT (supervised fine tuning) data generation pipeline producing thousands of prompts and completions weekly across several languages and domains of knowledge;
• Evaluation pipeline helping to estimate LLMs’ responses quality and reaching a throughput of hundred thousands weekly;
• A red-teaming project helping to collect malicious prompts of different kinds to ensure models’ safety.

Key Responsibilities

• Take ultimate ownership for all delivery team projects, including data quality, delivery timelines, unit economics and overall transparency for stakeholders;
• Lead a cross-functional delivery team ensuring projects are on track, any issues and risks are highlighted and resolved proactively;
• Own operations of the delivery team: including internal and external communication, activities planning, posting summaries and status updates, conducting retros etc.;
• Drive and motivate the team, seek out change to increase the organization’s efficiency;
• Help roll out improvements to the delivery team focussing on increased adoption and providing feedback for further improvements.

Qualifications

• Experience leading technical cross-functional teams;
• Experience managing complex projects including discovery, decomposition, scope planning, implementation and adoption;
• Client facing experience;
• Being generally agile, able to switch quickly to new domains and subjects;
• Consulting, Tech, Competitors background is a big plus;
• Good understanding of LLMs and their life cycle in particular;
• Experience in data generation;
• Experience and proactiveness in suggesting process changes is appreciated;
• Proven experience in the AI space, including working with clients and managing teams or projects at scale;

What we can offer

• On-site role based in New York, with periodic travel across the city and surrounding areas to meet with clients. All business travel expenses are covered by the company;
• Toloka compensation for this role is benchmarked to local market rates and varies by location within the United States. For candidates in the US, the base salary range for this role is USD 150.000 - 200.000 $ per year. Since this is a remote role, actual compensation will depend on factors such as location, relevant experience, skills, knowledge, internal pay equity, and market conditions. In addition to base salary, this role may be eligible for other elements of compensation such as [bonus/commission/equity, as applicable], as well as a comprehensive benefits package. Additional information about total compensation and benefits will be shared with candidates during the hiring process.
• Personal and career development: we support employee’s ambition for professional development and encourage them to implement their ideas in their projects;
• Flexibility: we offer remote or hybrid employment. You will also design with your manager a workday that works best for you;
• Paid parental leave and sick leave;
• Medical insurance fully covered for the employee;
• 25 vacation days per year.

To learn how we collect, use, disclose, and store personal data, check out our Privacy Notice.