GenAI Engineer (LLM)

OverviewBeing good neighbors – helping people, investing in our communities, and making the world a better place – is who we are at State Farm. It is at the core of how we operate and the reason for our success. Come join a #1 team and do some good!HYBRID: Hybrid Work Arrangement: A “Hybrid” position means selected candidates will be assigned to a facility and will spend some time working both in the office and from home. For Enterprise Technology, a hybrid work arrangement will require approximately 40% in-office time each month, beginning in late 2027.HUB LOCATIONS: Bloomington, IL; Dunwoody, GA; Richardson, TX; or Tempe, AZSPONSORSHIP: Applicants for this position are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g. H-1B visa) for this opportunityResponsibilitiesGrow Your Skills, Grow Your PotentialWe are looking for a skilled Lead Software Engineer with strong expertise in Python backend development and AI/LLM integration. In this role, you will be responsible for designing, building, and maintaining the LARRY FastAPI backend, including LLM-powered conversation flows, RAG (Retrieval-Augmented Generation) pipelines, and knowledge ingestion APIs. You will collaborate with architects, product owners, and SMEs to shape a platform that processes interviews, documents, and mainframe artifacts into structured, queryable knowledge objects.This role offers the opportunity to work on impactful greenfield AI work while navigating the unique challenges of enterprise-scale knowledge management. If you are passionate about Python, LLMs, and cloud-native architecture, you will thrive on our team.Design, develop, and maintain the LARRY FastAPI backend, including REST API endpoints for conversation, ingestion, and knowledge retrievalBuild and support LLM-powered RAG pipelines that query the kcd-repository knowledge base and surface relevant answersLead backend architecture decisions and mentor junior engineers on the teamCollaborate with business stakeholders, product owners, and architects to ensure accurate knowledge processing and retrievalImplement and maintain CI/CD pipelines via GitLab CI/CD for deployment to ROSA (OpenShift)Participate in code reviews, unit testing, and integration testing to maintain high-quality, secure codeIntegrate with Entra ID (Azure AD) for authentication and manage secure API access patternsResearch and adopt emerging LLM and RAG patterns to improve knowledge quality and retrieval accuracyQualificationsStrong Python or React experience, including FastAPI or similar async web frameworksExperience with LLM integration and RAG architecture patternsExperience designing, developing, and maintaining RESTful APIsHands-on experience with CI/CD pipelines and containerized deploymentSolid understanding of Git and version control workflowsExperience with AWS or other cloud environmentsPreferred QualificationsProcess and transform mainframe artifacts (JCL, DB2 , COBOL) into structured, schema-compliant knowledge objectsExperience with vector databases or embedding-basedExperience with JSON schema design and knowledge graph or structured data patternsIntegrate with Entra ID (Azure AD) for authentication and manage secure API access patternsOur BenefitsBecause work-life balance is a priority at State Farm, compensation is based on our standard 38:45-hour work week!Potential starting salary range: $85,000 - $142,000 (Starting salary will be based on skills, background, and experience. High end of the range limited to applicants with significant relevant experience.)Potential yearly incentive pay up to 15% of base salaryAt State Farm, we offer more than just a paycheck. Check out our suite of benefits designed to give you the flexibility you need to take care of you and your family!Get Paid! On top of our competitive pay, you are eligible for an annual raise and bonus. Stay Well! Focus on you and your family’s health with our robust health and wellbeing programs. State Farm pays most of your healthcare premium, and we offer multiple healthcare plan options, including a high deductible plan. All medical plans provide 100% coverage for in-network preventative care, AND you and your family have access to vision, dental, telemedicine, 24/7 mental health professionals, and much more!Develop and Grow! Take advantage of educational benefits like industry leading training programs, top-notch tuition assistance programs, employee resource groups, and mentoring. Plan Ahead! Plan for those big moments in life with benefits like fertility/IVF/adoption assistance, college coaching, national discount programs, interactive monthly financial workshops, free financial coaching, and more. You can also start a savings account or consider financing through our State Farm Federal Credit Union!Take a Little “You” Time! You will have access to our generous time off policies designed so you can plan around holidays, family events, volunteering, or just to take a relaxing day off. With the opportunity to initially earn up to 20 days annually plus parental leave, paid holidays, celebration day, life leave (40 hours/year), bereavement leave, and community service/education support days, there will be plenty of time for you!Give Back! We offer several ways to give back through our Matching Gift Program, Good Neighbor Grant Program, and the Employee Assistance Fund. Finish Strong! Plan for retirement using free financial advisors and a 401(k) plan with company contributions of up to 7% of your salary. Visit our State Farm Careers page for more information on our benefits, locations, and the hiring process of joining the State Farm team!