Principal Engineer - AI Platform & Operations

  • $148k – $210k
  • |Remote ()
  • |12 years of exp
  • |Full Time
Posted: 1 week ago
Hires remotely in
Remote Work Policy

Remote only

Company Location
Auckland
Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
Azure
Docker
AWS
Kubernetes
Triton
GCP
helm
Kubeflow
MLFlow
vLLM
Ray Serve
Weights & Biases

About the job

Serko is a cutting-edge tech platform in global business travel & expense technology. When you join Serko, you become part of a team of passionate travellers and technologists bringing people together, using the world's leading business travel marketplace. We are proud to be an equal opportunity employer, and we embrace the richness of diversity, showing up authentically to create a positive impact. There's an exciting road ahead of us, where travel needs real, impactful change.With offices in New Zealand, Australia, North America, and China, we are thrilled to be expanding our global footprint, landing our new hub in Bengaluru, India. With a rapid growth plan in place, we're hiring people from different backgrounds, experiences, abilities, and perspectives to help us build a world-class team and product.We are looking for a Principal Engineer to serve as the technical expert for our AI Platform & Operations. This isn't just a role about maintaining infrastructure; it's about owning the technical vision for the foundational systems that will power every AI product team across the company.Remote Role - can be based in either Washington or California State.RequirementsBy building robust, self-serve internal developer platforms, you'll enable our engineers to deploy, monitor, and scale AI models with unprecedented efficiency and safety. Your work ensures that our "Agentic" future is reliable, cost-effective, and cutting-edge.What You'll Be DoingArchitect the Future: Define the long-term technical roadmap for our AI platform, covering everything from model serving and feature stores to experiment tracking and CI/CD for MLSet the Gold Standard: Establish engineering benchmarks for deployment, versioning, A/B testing, and automated rollbacksOptimize & Scale: Lead strategies for GPU/compute efficiency and cost optimization while managing the complexities of LLM inference (quantization, batching, and latency) at scaleEnhance Observability: Design sophisticated monitoring and alerting systems specifically tailored for AI workloads in productionChampion Reliability: Drive platform stability and partner with application teams to ensure our infrastructure meets evolving product needsTechnical Leadership: Mentor Senior engineers, lead architecture reviews, and evaluate the next generation of cloud services and ML frameworksWhat You'll BringWe are looking for a heavy-hitter in the ML infrastructure space who thrives on solving complex, distributed systems problems.Senior Expertise: 12+ years of engineering experience, with at least 4 years at a Principal or Distinguished levelML Infrastructure Mastery: Expert-level knowledge of model serving (e.g., Triton, vLLM, Ray Serve) and deep experience with Kubernetes and cloud ecosystems (AWS/GCP/Azure)The MLOps Toolkit: Proven experience with tools like MLflow, Weights & Biases, or KubeflowCoding & Systems: High proficiency in Python and a "systems-thinking" approach to Docker, Helm, and containerizationAI Specialization: Hands-on experience operating LLM inference at scale and a deep understanding of the trade-offs between throughput and latencyPlatform Mindset: A track record of building internal platforms that treat other engineers as the primary customer, drastically improving engineering velocityBenefitsAt Serko, we aim to create a place where people can come and do their best work. This means you'll be operating in an environment with great tools and support to enable you to perform at the highest level of your abilities, producing high-quality and delivering innovative and efficient results. Our people are fully engaged, continuously improving, and encouraged to make an impact.Some of the benefits of working at Serko are:A competitive base payMedical BenefitsDiscretionary incentive plan based on individual and company performanceFocus on development: Access to a learning & development platform and opportunity for you to own your career pathwaysFlexible work policyThe pay range is between $168,000 - $230,000 USD as a base salary offering annually

Similar Jobs

Neuralink company logo
Neuralink
Ultra-high bandwidth brain-machine interfaces to connect humans and computers
Reedsy company logo
Reedsy
A friendly place for authors to learn, create and market the best indie books
Proof of Skill company logo
Proof of Skill
A protocol where experts collectively authenticate skills & issue Skill Credentials
Kraftbase company logo
Kraftbase
A full service design studio as good as the brands we build
MatX company logo
MatX
Be the compute platform for AGI