In office
Not Available
About the job
We are seeking a highly experienced AI/LLM Optimization Engineer to optimize production-grade Generative AI applications for accuracy, performance, scalability, and reliability.This is a hands-on engineering role—not a prompt engineering or POC-focused position.Key ResponsibilitiesOptimize enterprise LLM applications, RAG pipelines, and AI agents.Improve model accuracy, response quality, throughput, and inference latency.Implement advanced RAG techniques, embeddings, hybrid search, and re-ranking.Develop automated LLM evaluation frameworks, regression testing, and performance benchmarks.Apply fine-tuning (LoRA/QLoRA), quantization, caching, and inference optimization.Deploy and optimize scalable LLM solutions in AWS/cloud environments.Mandatory Technical Requirements13+ years in software/ML engineering, including 3+ years of production LLM engineering.Advanced Python, PyTorch, Hugging Face, and LLM architectures.Strong hands-on experience with RAG, vector databases, and LangChain/LangGraph or LlamaIndex.Proven LLM evaluation and optimization experience using Ragas, DeepEval, LangSmith, or equivalent.Experience with AWS Bedrock/SageMaker or comparable enterprise AI platforms.Must demonstrate measurable improvements in LLM accuracy, latency, or throughput in production.Preferred: vLLM, TensorRT-LLM, model fine-tuning, AI guardrails, financial services experience.
About the company
Similar Jobs









