Avatar for AMD
Software Development

Sr. Software Engineer - AI Triton Communication

Posted: 1 week ago
Hires remotely in
Remote Work Policy

Remote only

Company Location
Visa Sponsorship

Not Available

RelocationAllowed
Skills
LLVM
CUDA
Triton
MLIR
Hip
ROCM

About the job

ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.The RoleTriton is a widely adopted language and compiler for high-performance GPU kernels, powering major AI frameworks such as PyTorch, vLLM, and SGLang. As AI workloads increasingly scale across multiple GPUs and nodes, first-class support for distributed execution and communication in Triton is strategically critical to enabling efficient large-scale training and inference on AMD Instinct Accelerators.AMD GPUs are an official Triton backend, and delivering industry-leading distributed performance and scalability on AMD Instinct accelerators is a key priority. The performance, scalability, and usability of Triton directly impact the competitiveness of AMD hardware in large-scale AI deployments.In this role, you will advance the Triton compiler and runtime stack for AMD CDNA and next-generation GPU architectures by building native distributed execution and communication capabilities. You will develop compiler and runtime infrastructure that enables efficient inter-GPU communication, scalable execution, and optimal hardware utilization. You will work across compiler, runtime, and hardware layers, collaborating closely with GPU architecture and software teams to help establish AMD GPUs as a best-in-class platform for Triton-based distributed AI.The PersonThe ideal candidate has deep expertise in GPU architecture, compiler technologies, and distributed GPU systems, with proven experience optimizing workloads at multi-GPU scale. You are comfortable working across the full execution stack — from compiler and runtime to hardware — and understand how GPU execution, memory hierarchy, and inter-GPU communication impact performance.You have experience working close to the GPU runtime, communication stack, or compiler backend, and are motivated to build native distributed execution and communication capabilities tightly integrated with the compiler and runtime to maximize scalability and hardware utilization. You thrive on solving complex system-level performance challenges and delivering scalable, high-performance GPU infrastructure.Key ResponsibilitiesDesign and develop native distributed communication and execution capabilities within the Triton AMDGPU backend, enabling scalable multi-GPU execution for large-scale AI workloadsDesign and implement Triton compiler and runtime mechanisms for native GPU-initiated communication, including collective operations, remote memory access, synchronization, and distributed execution primitivesDrive performance optimization across compute and communication, including inter-GPU data movement, communication/computation overlap, memory hierarchy utilization, and GPU-driven scheduling efficiencyDevelop and optimize distributed Triton kernels and execution models to achieve high performance, scalability, and efficient hardware utilization for AI workloads Analyze, profile and debug complex cross-stack issues spanning Triton compiler, runtime, ROCm stack, and GPU hardware executionCollaborate closely with GPU architecture, compiler, runtime, and performance teams to co-design and enable next-generation distributed GPU programming and execution capabilitiesContribute to open-source Triton and ROCm distributed ecosystem, driving innovation in distributed GPU computingPreferred ExperienceDeep experience in compiler development, GPU software, distributed systems, or performance engineeringFamiliarity or hands-on experience with Triton compiler and runtime Deep understanding of modern GPU architectures, including execution model, memory hierarchy (LDS, L2, HBM), scheduling, occupancy, and hardware performance characteristics Good understanding of GPU runtime systems, communication stacks, and multi-GPU interconnects such as XGMI, NVLink, PCIe, or InfiniBand and their performance implications  Familiarity with distributed GPU communication libraries such as RCCL, NCCL, NVSHMEM, rocSHMEM, or MPI and similar technologiesExperience developing, optimizing, and scaling workloads across multiple GPUs, including inter-GPU communication, synchronization, and communication/computation overlapStrong experience with GPU programming using Triton, HIP, CUDA, or similar parallel programming environmentsStrong knowledge of MLIR and/or LLVM internalsExperience profiling, debugging, and optimizing performance across compiler, runtime, and hardware layersFamiliarity with ROCm, HIP, CUDA, or similar GPU programming ecosystems, including performance profiling and optimization toolsExperience optimizing large-scale AI, machine learning or HPC workloads across multi-GPU systemsExperience contributing to open-source projects and working in collaborative, cross-functional engineering environmentsStrong problem-solving, communication, and technical leadership skillsPreferred Academic CredentialsBachelor’s or Master's Degree in Computer Engineering, Computer Science, Electrical Engineering or equivalent practical experienceLOCATION: San Jose, CAThis role is not eligible for visa sponsorship.Benefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.

Similar Jobs

Astranis company logo
Astranis
Building next-generation internet satellites to get the world online
MatX company logo
MatX
Be the compute platform for AGI
Bobyard company logo
Bobyard
Build the future of construction estimating
Pulley company logo
Pulley
Helping project teams break ground faster
Axle Health company logo
Axle Health
Scheduling and workforce management software for in-home care providers
Super company logo
Super
Super is the AI assistant for property management
Rocket Money company logo
Rocket Money
The Money App That Works for You
Convex company logo
Convex
The reactive backend platform that keeps up with you and your agents