Senior Machine Learning Engineer (Prompt)

Assured is on a mission to modernize insurance. Claims processing (i.e. should we pay this claim?), while often overlooked, is the foundation of the entire industry. It’s currently highly manual, involving phone calls, faxes, and gut instinct—costing tens of billions of dollars a year. We can do better.

At Assured, we provide large insurers with the software solutions they need to win in a modern, technology-driven world. From self-service claim filing software to backend fraud detection, we’re the engine that powers claims processing for some of the largest insurers in the world.

The challenges we face are deep and diverse—from creating digital experiences that provide comfort and clarity to claimants at their most stressed and vulnerable to orchestrating large-scale ML-driven decision-making on billions of dollars of claims payments, life at Assured is dynamic, collaborative, and rewarding.

As a Senior Machine Learning Engineer (Prompt), you will be responsible for designing, testing, and iterating on prompt structures to ensure optimal outputs from large language models (LLMs). You will work closely with engineers and product managers to tailor AI responses that meet business requirements and improve user experience. Your creativity and analytical skills will help refine AI behaviors, enhance product capabilities, and contribute to innovative customer solutions.

You will…

💡 Design, develop, and implement LLM applications to evaluate data quality, solve complex synthetic data challenges, and execute AI-driven business solutions.

🔐 Conduct jailbreaks and find vulnerabilities in LLMs and other generative AI models. Develop and deliver training materials on adversarial analysis and vulnerability identification to operational teams.

🔍 Design and refine natural language prompts to elicit desired outputs from AI models. Experiment with different prompt structures to evaluate performance, accuracy, and relevance, using data-driven approaches to optimize prompts for various use cases.

📊 Analyze language model behavior in response to prompts and provide detailed insights into model performance. Leverage industry-standard metrics (BLUE, ROUGE, MAUVE) to ensure output quality and alignment with business requirements.

🤝 Work with ML engineers, software engineers, and product managers to integrate LLM capabilities into platforms and ensure robust deployment. Share prompt engineering best practices with engineering teams and help enhance their skills through training sessions.

📚 Develop clear documentation, style guides, and prompt templates to standardize prompt engineering across teams. Conduct training sessions to introduce new prompt engineering techniques to internal staff.

🛠 Create data creation and vulnerability testing scripts using Python or TypeScript. Collaborate with engineers to ensure reliable implementation and platform integration.

🧠 Lead experimentation and internal R&D efforts by creating new prompt engineering methods, exploring LLM applications, and driving creative problem-solving for AI use cases.

You Have…

🎓 B.S. or higher in a quantitative field or one related to language models (linguistics, philosophy, AI, etc.).

💻 Proficiency in Python or TypeScript for writing API-enabled scripts and automating tasks.

🌐 Hands-on experience with frontier-scale LLMs (e.g., GPT, Claude, PaLM) applied programmatically toward specific applications or implementations.

📊 Familiarity with model evaluation metrics such as BLUE, ROUGE, and MAUVE, as well as proficiency in analyzing and visualizing model performance data.

🔧 Experience building LLM-based applications or hacking LLMs to solve novel problems and uncover vulnerabilities.

🧩 Strong understanding of NLP and language model behavior, with a focus on prompt engineering.

🗣 Exceptional written and verbal communication skills, capable of translating complex AI concepts to both technical and non-technical stakeholders.

🚀 A creative mindset with the ability to drive experimentation, R&D, and innovative solutions for AI and LLM challenges.

📈 Strong problem-solving skills and a passion for understanding and improving human-computer interaction.

Benefits:

🤑 Competitive Compensation: Enjoy a competitive salary and equity package!

🏥 Comprehensive Health Care: Access to multiple medical plans with an HSA option and minimal out-of-pocket expenses. Certain plans covered 100%.

🦷 Dental Insurance: We protect those pearly whites

👀 Vision Insurance: Everyone can see clearly now at Assured

🌧 Life Insurance: It's on the house! Provided at no cost to you

🏄 Paid Time Off: Uncapped vacation days and paid holidays. Take that vacation!

👶 Family Leave: Maternity and paternity leave options

📈 Financial Wellness: 401(k) contribution with Assured contributing 3% of your income, even if you don't contribute

👪 Flexible Spending Accounts: Health and dependent care FSAs for pre-tax flexible spending

Our Commitment:

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment. Please contact us to request accommodation.