Avatar for Vraify
Vraify
Actively Hiring
More jobs
AI data and evaluation solutions for training smarter AI models
  • Growing fast
    Showed strong hiring growth in the past month

Senior Software Engineer – Java (LLM Evaluation & Repository Validation) | Job ID 37597

Posted: 1 month ago
Hires remotely in
Remote Work Policy

Remote only

Company Location
Visa Sponsorship

Not Available

RelocationAllowed
Skills
Java
Git
Docker

About the job

Vraify is hiring Java software engineers for a remote contract focused on LLM evaluation and repository validation. This is an approximately 3-month assignment with a start date to be confirmed.

Eligible locations
Applicants may be based in Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, or Vietnam.

What you will do

  • Analyze and triage issues in widely used public GitHub repositories.
  • Set up and configure repositories, including Docker and development environment automation.
  • Evaluate unit test coverage and quality, and run or modify code locally to assess AI-assisted bug fixing.
  • Collaborate with researchers on challenging repositories and issues; there may be opportunities to lead junior engineers.

What you bring

  • Strong Java skills and proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to navigate complex codebases and run, modify, and test real-world projects locally.
  • Experience with well-maintained, widely used public GitHub repositories, including repositories with 5,000+ stars.
  • At least 2 years of software engineering experience and the ability to work at a technical lead level.
  • Open-source contributions, LLM evaluation, developer tools, or automation agents are helpful.

Engagement and pay

  • Remote contractor assignment for approximately 3 months, 40 hours per week, with 4 hours of daily overlap with Pacific time.
  • Hourly pay: $15 USD for 2–4 years of experience or $20 USD for 4+ years of experience. The exact rate is confirmed during screening.
  • Contractor benefits do not include medical coverage or paid leave.
  • Shortlisted applicants complete an online coding assessment.

Similar Jobs

Spenza company logo
Spenza
"Connectivity as a Service". Enable any business to be a virtual mobile operator
StackPro company logo
StackPro
StackPro is a new age product & services studio, helping companies big or small go digital
ONI company logo
ONI
ONI is building the world 1st AI ObGyn 'Continuum Pregnancy Care' for pregnant mothers
Navtech  company logo
Navtech
We design and develop the most innovative solutions for your users!
Nexera company logo
Nexera
Answer engine for professional traders
EaseOps company logo
EaseOps
Salesforce for hospital operations—automating compliance, workflows, and patient services for India