Avatar for Gap, Inc
Gap, Inc
Actively Hiring
Be creative. Take risks. Do what’s right. Stay focused on customers

Principal Engineer, Agent Platform

Posted: 4 days ago• Recruiter recently active
Hires remotely in
Remote Work Policy

Remote only

Company Location
Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
Quality Assurance
Cloud Security
OAuth
Fault Tolerance
Resiliency
Big Query
Gemini
Llm
Testing Methodologies
GKE
Observability
Pub/Sub
Cloud Run
Vertex AI
Vector Search
Generative AI
AI Evaluation
Embeddings
Context Management
Policy-As-Code
Retrieval Systems
Retries
Secure-by-Design
Workload Identity
Agent-Based Solutions

About the job

About the Role

We are building the enterprise AI agent platform that teams across the company will use to create, deploy, govern, and operate AI-powered solutions at scale. As a Principal Engineer, you will help define the technical foundation for agent development across the organization, building the services, frameworks, and guardrails that make AI agents secure, reliable, observable, and easy to adopt.

This is a hands-on engineering role focused on architecture, software design, and platform development. You will work across AI, distributed systems, cloud infrastructure, security, and governance to deliver a platform that enables product and engineering teams to move quickly while meeting enterprise standards for security, compliance, and operational excellence.

What You'll Do

  • Design and build core platform services that enable enterprise AI agent development and operations

  • Define the architecture, engineering patterns, and technical standards for the AI agent platform

  • Develop and maintain a centralized model gateway for routing, governance, resiliency, and cost management

  • Build agent runtime capabilities that support long-running workflows, orchestration, and human-in-the-loop processes

  • Design secure identity, authorization, and policy enforcement mechanisms for agents and tools

  • Establish platform capabilities for context management, memory, retrieval, and data isolation

  • Create testing, evaluation, and release frameworks that ensure agent quality, safety, and performance

  • Implement observability, auditability, and operational tooling for monitoring and troubleshooting agent behavior

  • Partner with Security, Data Governance, and Cloud Infrastructure teams to define platform controls and guardrails

  • Mentor engineers, influence technical direction, and raise engineering standards across multiple teams

Who You Are

  • Extensive experience building and operating large-scale distributed systems in production

  • Strong software engineering background with expert-level Python development skills

  • Hands-on experience delivering production LLM, generative AI, or agent-based solutions

  • Deep understanding of agent architectures, orchestration patterns, and enterprise AI platforms

  • Experienced with retrieval systems, embeddings, vector search, and context management strategies

  • Knowledgeable in AI evaluation, testing methodologies, and quality assurance for non-deterministic systems

  • Proficient with Google Cloud services including Vertex AI, Gemini, GKE, Cloud Run, BigQuery, and Pub/Sub

  • Experienced with cloud security, workload identity, OAuth, policy-as-code, and secure-by-design architectures

  • Strong understanding of distributed system reliability patterns, including resiliency, retries, observability, and fault tolerance

  • Proven ability to influence technical direction, drive adoption of architectural standards, and lead through expertise rather than authority

Similar Jobs

GVOS  company logo
GVOS
An Edge Cloud for Autonomous Driving
Instrumentl company logo
Instrumentl
The best platform for nonprofits looking to grow revenue (YC S16)
Shef company logo
Shef
Authentic dishes. Homemade. Delivered. Explore who's cooking in your neighborhood
Astranis company logo
Astranis
Building next-generation internet satellites to get the world online
Astranis company logo
Astranis
Building next-generation internet satellites to get the world online
Astranis company logo
Astranis
Building next-generation internet satellites to get the world online
Scale AI company logo
Scale AI
Accelerate the development of AI applications