Machine Learning Engineer - LLM

What will you do?

• Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
• Build abstractions to automate various steps in different ML workflows.
• Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features.
• Leverage your experience to drive best practices in ML and data engineering.

What do you bring to the table?

• Significant academic background in ML and/or industry experience in Machine Learning, Infrastructure or related fields.
• Expertise in Python and Golang.
• Experience with building end-to-end machine learning systems.
• Experience building scalable micro services and ETL pipelines.
• Experience with deep learning framework such as Pytorch or Huggingface.
• A love of research publications in the machine learning and software engineering communities.
• Effective communicator with experience collaborating cross-functionally with other teams.

Nice to have:

• Experience with ML Inference framework such as TensorrtLLM or Nvidia Triton.
• Experience with distributed training frameworks such as Deepspeed.

Compensation Range: $160,000-190,000