Vraify is hiring Java software engineers for a remote contract focused on LLM evaluation and repository validation. This is an approximately 3-month assignment with a start date to be confirmed.

Eligible locations
Applicants may be based in Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, or Vietnam.

What you will do

Analyze and triage issues in widely used public GitHub repositories.
Set up and configure repositories, including Docker and development environment automation.
Evaluate unit test coverage and quality, and run or modify code locally to assess AI-assisted bug fixing.
Collaborate with researchers on challenging repositories and issues; there may be opportunities to lead junior engineers.

What you bring

Strong Java skills and proficiency with Git, Docker, and basic software pipeline setup.
Ability to navigate complex codebases and run, modify, and test real-world projects locally.
Experience with well-maintained, widely used public GitHub repositories, including repositories with 5,000+ stars.
At least 2 years of software engineering experience and the ability to work at a technical lead level.
Open-source contributions, LLM evaluation, developer tools, or automation agents are helpful.

Engagement and pay

Remote contractor assignment for approximately 3 months, 40 hours per week, with 4 hours of daily overlap with Pacific time.
Hourly pay: $15 USD for 2–4 years of experience or $20 USD for 4+ years of experience. The exact rate is confirmed during screening.
Contractor benefits do not include medical coverage or paid leave.
Shortlisted applicants complete an online coding assessment.