Generative AI Engineer

Computer Programmer – Generative AI Engineer (Python/Azure)

Position Title: Computer Programmer – Generative AI Engineer (Python/Azure)

Location: Remote (Continental U.S.)

Company: JR Software Solutions Inc. (JRSS)

Employment Type: Full-time

Openings: 2

About JR Software Solutions Inc.

JRSS is a certified Women-Owned Small Business (WOSB), Small Disadvantaged Business (SDB), and HUBZone business headquartered in Tampa, FL. We specialize in Cloud Services, AI and Machine Learning, Big Data and BI Analytics, Enterprise Resource Planning, IT Project Management, and Staff Augmentation for Federal Civilian agencies (e.g., CDC) and Fortune 500 clients. Our AI engineering teams build secure, production-grade generative AI applications that help public health programs put enterprise knowledge to work.

Position Overview

The JRSS team is seeking two mid-level Generative AI Engineers to build, enhance, and support generative AI web applications for a federal public health client, including retrieval-based knowledge assistants, chatbots, and agent workflows. You will implement features, integrate enterprise data and services, troubleshoot issues, and improve application quality, working alongside senior AI engineers, architects, product owners, data engineers, and DevSecOps teams to deliver secure, maintainable production applications.

Key Responsibilities

• Build, enhance, and support production generative AI applications and web-based AI solutions.
• Develop Python backend services and AI integrations using Azure OpenAI, Azure AI Foundry, and related Azure services.
• Implement retrieval-augmented generation (RAG) pipelines, including document processing, chunking, embeddings, search, context preparation, and source citations.
• Implement agent workflows using tool/function calling, structured outputs, conversation context, error handling, execution limits, and human review where needed.
• Integrate AI applications with APIs, enterprise data sources, databases, cloud services, and Model Context Protocol (MCP)-based tools.
• Test and evaluate retrieval relevance, answer correctness and grounding, reliability, latency, and cost.
• Instrument applications with logging, tracing, and metrics to monitor model calls, retrieval steps, tool execution, errors, and token usage.
• Troubleshoot application issues, fix defects, and support deployments and production monitoring.
• Participate in code reviews, document implementation decisions, and collaborate with engineering and DevSecOps teams.

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3+ years of technical experience, including developing and supporting production software applications.
• 1+ year of hands-on generative AI development, including RAG-based assistants or chatbots.
• Experience with Python backend development, including asynchronous APIs, using FastAPI, Pydantic, or comparable tools.
• Experience with Azure, including Azure OpenAI, Azure AI Search, and integration with databases and external services.
• Hands-on RAG experience with document processing, chunking, embeddings, vector or hybrid search, and citations.
• Demonstrated agent workflow experience with tool calling, structured outputs, and context management using PydanticAI, Microsoft Agent Framework, LangGraph, Foundry Agent Service, or similar tools.
• Ability to conduct LLM evaluation and troubleshooting using test datasets, logs, and traces to assess quality, latency, and cost.
• Experience with Git, code reviews, automated testing, CI/CD, and Agile team delivery.
• Must be a U.S. Citizen or Lawful Permanent Resident (Green Card holder).
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination.

Preferred Qualifications

• Experience with Langfuse, Pydantic Logfire, or similar AI observability tools, and OpenTelemetry.
• Experience with advanced RAG techniques, multi-agent workflows, or MCP integrations.
• Experience with Docker, Azure deployment services, or frontend development using React, Angular, or TypeScript.
• Knowledge of open-source LLM hosting using vLLM, SGLang, or similar frameworks.
• Knowledge of LLM fine-tuning and optimization, including PEFT, LoRA/QLoRA, and quantization.
• Prior experience supporting CDC or other federal public health programs.

What We Offer

• 401(k) plan with a 4% company match.
• Two weeks of paid time off.
• Comprehensive medical, dental, and vision insurance.
• Ongoing investment in professional growth and development.

Equal Opportunity Statement

JR Software Solutions Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.