In-Ho Yi

Experience

Microsoft AI

Member of Technical Staff 2025 - 2026 (9 months)

Frontier AI Infra
- Improve Ray, K8s based training infra stack
- Uncovered performance and init time bottleneck by scale testing workload on CPUs
- Create AI toolchain... more

Anagenex

Principal Engineer / Director of Engineering 2022 - 2023 (over 1 year)

Heading the Compute team at the company

- AI/ML engineering to design, implement, deploy and optimize AI/ML training loop
- Promoted to Director of Engineering in... more

Snap Inc.

Machine Learning Infrastructure Engineer 2019 - 2022 (almost 3 years)

Perception Team
- Pipeline to productionize serving PyTorch/ONNX model at scale
- Patch and compile PyTorch models to run on Triton with TensorRT optimisation, delivering... more

Google

Software Engineer

2024 - 2025 (about 1 year)


Cloud ML Platform Readiness. ML Infra Engineering

- Validate AI/ML workloads on the latest hardware/software packages
- Troubleshoot AI/ML workload performance and... more reliability issues
- Design and implement AI/ML workload updates to improve developer experience

Senior Software Engineer

2018 - 2019 (about 1 year)


Senior Software Engineer
Legal Works Team
- Tech Lead for a Legal Enterprise team, responsible for full-stack software architecture
- Develop internal tools for legal... more operations

Senior Software Engineer

2015 - 2018 (about 3 years)


Google Chrome Sync Server Team
- Develop and maintain service to synchronize browser preferences across multiple devices.
- User analytic and data warehousing for massive... more amount of access logs (~PBs) and data dumps (~200TBs).
- Tech stack: Java for server application layer (gRPC, Spanner), Google internal proprietary tools for distributed systems and data analysis (MapReduce, FlumeJava)

Exit

Amazon

Software Engineer 2013 - 2014 (about 1 year)

Kindle Eink Reader Team
- Glue layer for reader client software
- Maintained and updated across the whole stack from low-level C code all the way up to Java GUI layer
-... more

Employee

Amazon, Google, Snap Inc., Anagenex, Microsoft AI

Education

About

Achievements

2003 ACM ICPC - South Pacific Regional Contest: Participated as a member of Melbourne University B team. 10th in the region

Describe the most impressive thing you've done.

Skills

Java Javascript Scala SQL Data Analysis Distributed Systems Software Development Python PyTorch Apache Spark

Locations

Seattle Bellevue

In-Ho Yi

Interested in Data Science, Machine Learning and Infrastructure

2003 ACM ICPC - South Pacific Regional Contest: Participated as a member of Melbourne University B team. 10th in the region