Avatar for Biz-Tech Analytics
Biz-Tech Analytics
Actively Hiring
  • Growing fast
    Showed strong hiring growth in the past month

AI Data Operations Specialist

  • ₹5L – ₹8L
  • |
  • |1 year of exp
  • |Full Time
Reposted: 1 month ago• Recruiter recently active
Job Location
Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
Coding
Program Management
Project Management
Data Annotation
Large Language Models (LLMs)
Reinforcement Learning from Human Feedback (RLHF)
Fine-Tuning (SFT, RLHF)
Hiring contact
Palak Kalra
Employee
Delhi
image

About the job

Own the execution engine behind high-quality AI training data. At Biz-Tech Analytics, our Specialized Data Services team builds complex datasets across coding, mathematics, and STEM domains for frontier AI labs. You’ll drive day-to-day operations, translate ML requirements into scalable workflows, and ensure consistent, high-quality delivery across projects.

WHAT YOU'LL OWN
• Own end-to-end execution of AI data workflows across coding, math, and STEM datasets
• Translate ML requirements into structured, scalable task pipelines for data creation and evaluation
• Plan and manage timelines, throughput, and delivery targets across multiple projects
• Design and optimize workflows for code generation, debugging tasks, mathematical reasoning datasets, and scientific QA
• Track project progress, manage timelines, and ensure delivery against volume and quality targets
• Work closely with freelance coders and contributors — resolve doubts, unblock issues, and guide outputs
• Be hands-on with QnA and QC — review submissions, enforce quality standards, and improve consistency
• Drive quality control processes including evaluation frameworks, accuracy checks, and reviewer alignment
• Monitor key operational metrics such as annotation accuracy, inter-annotator agreement, and benchmark performance
• Coordinate across engineers, annotators, and domain experts (including PhD-level specialists)
• Act as the central point of execution, ensuring clarity, speed, and accountability across teams
• Identify bottlenecks, solve for scale, and continuously improve data operations processes

WHAT WE'RE LOOKING FOR
• 2–4 years in AI data operations, project execution, or technical program management
• Strong understanding of AI/ML workflows, especially training data pipelines and model evaluation
• Technical familiarity with programming, mathematics, or STEM domains (enough to understand and review outputs)
• Ability to manage distributed contributors including engineers, annotators, and domain experts
• Strong operational thinking — ability to structure ambiguous problems into clear workflows
• Excellent communication, organization, and problem-solving skills
• Degree in CS, Engineering, Mathematics, Physics, or a related technical field
• Must work from our Delhi office — this is an in-person role

BONUS
• Experience with RLHF workflows, model benchmarking, or LLM training pipelines
• Exposure to coding datasets, algorithmic problem design, or mathematical reasoning tasks
• Familiarity with LLM development lifecycle and evaluation methods
• PMP, Scrum, or similar certifications

NOT A FIT IF
• Your experience is purely non-technical and you’re not comfortable working with technical content
• You haven’t worked with AI/ML workflows or data operations environments
• You prefer high-level planning roles without hands-on execution ownership
• You’re not comfortable working with highly specialized contributors (PhDs, senior engineers, etc.)

About the company

Biz-Tech Analytics company logo

Biz-Tech Analytics

Actively Hiring
11-50 Employees
  • Growing fast
    Showed strong hiring growth in the past month
Learn more about Biz-Tech Analytics image