Avatar for Vraify
Vraify
Actively Hiring
More jobs
AI data and evaluation solutions for training smarter AI models
  • B2B
  • Growing fast
    Showed strong hiring growth in the past month

Senior Software Engineer – Ruby (LLM Evaluation & Repository Validation) | Job ID 37600

Posted: 1 month ago
Hires remotely in
Remote Work Policy

Remote only

Company Location
Visa Sponsorship

Not Available

RelocationAllowed
Skills
Ruby
Git
Docker

About the job

Vraify is hiring experienced Ruby software engineers for a remote contractor assignment focused on LLM evaluation and repository validation. The engagement is expected to last approximately 3 months; the start date is to be confirmed.

Eligible locations
Applicants may be based in Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, or Vietnam.

What you will do

  • Analyze and triage issues in public GitHub repositories.
  • Set up repositories and development environments, including Docker.
  • Evaluate unit test coverage and quality, and run or modify code locally to assess AI-assisted bug fixing.
  • Collaborate with researchers on challenging software engineering tasks; there may be opportunities to lead junior engineers.

What you bring

  • At least 3 years of strong Ruby experience and the ability to contribute at a technical lead level.
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to navigate, run, modify, and test complex real-world codebases.
  • Experience with well-maintained, widely used public GitHub repositories, including repositories with 5,000+ stars.
  • Open-source contributions, LLM evaluation, developer tools, or automation-agent experience are helpful.

Engagement and pay

  • Remote contractor assignment for approximately 3 months, 40 hours per week, with 4 hours of daily overlap with Pacific time.
  • Hourly pay: $15 USD for 2–4 years of experience or $20 USD for 4+ years of experience. The exact rate is confirmed during screening.
  • Contractor benefits do not include medical coverage or paid leave.
  • Shortlisted applicants complete an online coding assessment.

Similar Jobs

Gyrus.AI company logo
Gyrus.AI
AI for Image/Video Analytics
Securitybulls Intelligence company logo
Securitybulls Intelligence
Uncover high level picture of how prepared your organisation is to meet threat you face
ONI company logo
ONI
ONI is building the world 1st AI ObGyn 'Continuum Pregnancy Care' for pregnant mothers
Navtech  company logo
Navtech
We design and develop the most innovative solutions for your users!
EaseOps company logo
EaseOps
Salesforce for hospital operations—automating compliance, workflows, and patient services for India