Cloud Machine Learning Engineer

About the Role
We are looking for a Cloud Machine Learning engineer responsible to help build machine learning solutions used by millions leveraging cloud technologies. You will work on Outpost framework for running AI and batch workloads across multi-cloud infrastructure, ensuring high GPU availability on leading cloud platforms or managed SaaS solutions.

Responsibilities

• Designing & Developing easy-to-use, secure, and robust Developer Experiences & APIs for our users.
• Work with AWS, GCP, and Azure cloud APIs for Outpost framework to help user provision and orchestrate EC2, S3, and other cloud services.
• Apply and scale optimization techniques across a wide range of ML models, particularly large language models.
• Write technical documentation, examples and notebooks to demonstrate new features.

About you

• Expert in Python, Typescript, Go, Node.js, PostgreSQL, Docker, and Kubernetes.
• Strong knowledge of cloud platforms like AWS and services like Amazon SageMaker, EC2, S3, CloudWatch and/or Azure and GCP equivalents.
• Experience in building MLOps pipelines for containerizing models and solutions with Docker.
• Ability to write clear documentation, examples and definition and work across the full product development lifecycle.
• Familiarity with Deep Learning Framework, preferably PyTorch.

Bonus

• Proficiency in enhancing the performance of software systems, particularly in the context of LLMs.
• Familiar with LLM optimization techniques (quantization, speculative decoding, continuous batching, etc.).
• Experience with CUDA or similar technologies.

Benefits and perks
All team members have company equity as part of their compensation package. If we succeed in becoming a next big cloud distribution platform in machine learning and artificial intelligence, everyone enjoys the upside.

• Ownership: We're a company with high ownership and high autonomy culture. We hope that you'll come in, help us, and over the course of many years do the best work of your life. When we bring you on board, we expect you to grow and change the company for the better.
• Novel problems/solutions: We're a startup, with cool problems, which lets us implement novel solutions! We abhor “busy work” and think, whether it's the community, engineering, operations, etc there's always an opportunity for creative and high leverage solutions.
• Growth: We want you to grow with us, but we know that talent is loaned, so when you figure out what area you want to grow in next, whether it's at Outpost or outside, we'll make sure you land there.

We look forward to hearing from you! ☺️