In office - WFH flexibility
Not Available
About the job
AI Architect
Remote
Role Summary
This role combines hands-on forward deployment with AI architecture ownership. The architect leads the reference architecture and planning for the AI Center of Excellence (CoE), centered on an AI plane built on Google Cloud, and works with business and engineering teams to put AI systems into production. A documented GCP-based AI reference architecture, a prioritized CoE roadmap, and at least two production use cases running on shared patterns is expected success criteria in first 90 days.
Key Responsibilities
- Define and maintain the enterprise AI reference architecture and AI plane, covering model access, retrieval, agent orchestration, evaluation, guardrails, observability, and governance.
- Develop and execute the AI CoE roadmap aligned with business objectives, including architecture decision records, reusable patterns, and reference implementations.
- Lead the end-to-end lifecycle of AI projects, from data engineering and model or prompt development through testing and production deployment on GCP.
- Design and deploy AI solutions for predictive analytics, intelligent automation, and real-time decision systems using BigQuery, Pub/Sub, and Dataflow.
- Build and optimize infrastructure for LLM serving, fine-tuning, and distributed training on GPUs and TPUs, and implement MLOps for deployment and monitoring.
- Embed with business and engineering teams to scope, prototype, and deploy LLM and agentic solutions into production.
- Establish evaluation harnesses, guardrails, and responsible AI controls covering bias, fairness, security, and regulatory compliance.
- Partner with security, legal, and compliance teams on AI risk assessment, data residency, and governance controls.
- Enable internal teams through standards, templates, runbooks, and training so they can operate and extend AI solutions independently.
Required Qualifications
- 8+ years in software engineering, solution architecture, or AI/ML delivery, with at least 3 years building and deploying LLM or AI systems to production.
- Hands-on experience with Google Cloud Platform, including Vertex AI, GKE or Cloud Run, and data services such as BigQuery.
- Deep working knowledge of transformer-based models, LLMs, retrieval-augmented generation, and multimodal AI, with hands-on use of PyTorch or TensorFlow.
- Proven experience designing AI reference architectures or platforms and presenting architecture artifacts to executive audiences.
- Strong Python skills and experience integrating enterprise APIs and data sources.
Tech Stack
Python, Google Cloud Platform, Vertex AI, Gemini, RAG, LangChain, LlamaIndex, MCP, BigQuery, GKE, Cloud Run, Pub/Sub, Dataflow, Terraform, PyTorch
Preferred Qualifications
- Google Cloud Professional Cloud Architect or Professional Machine Learning Engineer certification.
- Experience establishing an AI center of excellence, AI governance model, or AI operating model.
- Familiarity with NIST AI RMF, ISO/IEC 42001, and the EU AI Act.
- Telecom or network infrastructure background.
- Experience with ServiceNow, Salesforce, or Oracle Fusion integrations.
