Avatar for MusicGremlin
Data storage solutions: memory cards, SSDs, USB drives, and embedded storage

Staff Engineer AI/HPC Infrastructure

  • $153k – $261k
  • |
  • |10 years of exp
  • |Full Time
Posted: 1 week ago
Job Location
Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
Linux
Distributed Systems Engineering
Infiniband
RDMA
Docker
Slurm
Kubernetes
Ccl
RoCE
vLLM
SGLang
RAG Systems
TensorRT-LLM
Agentic AI Frameworks
Triton Inference Server
Hardware/software Co-Design
Nvidia Dynamo
Memory Hierarchy Optimization
SSD Architecture
Multi-Node Inference
AI Accelerator Architecture
GPU Cluster Administration
Distributed AI Clusters
Storage-Memory Co-Design
AI Performance Modeling

About the job

Sandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today’s needs and tomorrow’s next big ideas. With a rich history of groundbreaking innovations in Flash and advanced memory technologies, our solutions have become the beating heart of the digital world we’re living in and that we have the power to shape.Sandisk meets people and businesses at the intersection of their aspirations and the moment, enabling them to keep moving and pushing possibility forward. We do this through the balance of our powerhouse manufacturing capabilities and our industry-leading portfolio of products that are recognized globally for innovation, performance and quality.Sandisk has two facilities recognized by the World Economic Forum as part of the Global Lighthouse Network for advanced 4IR innovations. These facilities were also recognized as Sustainability Lighthouses for breakthroughs in efficient operations. With our global reach, we ensure the global supply chain has access to the Flash memory it needs to keep our world moving forward.DescriptionThe AI/HPC Infrastructure Engineer will modify and operate advanced GPU computing platforms for AI training, inference, and memory-system research. The engineer will work at the intersection of AI infrastructure, LLM serving, memory architecture, storage systems, and AI workload characterization. The role supports development of next-generation HBF, SSD, and memory-centric AI systems through hardware/software co-design and real-world AI workload analysis.Essential Duties And ResponsibilitiesBuild and Modify AI/HPC Research InfrastructureBuild AI testbeds supporting 8-100+ GPU environmentsManage server, networking, storage, and software infrastructureSupport cloud-scale and edge-AI deployment modelsDevelop benchmarking and validation environments for emerging AI workloadsDeploy and Optimize LLM Serving PlatformsInstall and optimize:vLLMNVIDIA DynamoTensorRT-LLMTriton Inference ServerSGLangSupport distributed inference and agentic AI workloadsOptimize latency, throughput, and GPU utilizationEvaluate inference cost and scalability across different architecturesAI Workload CharacterizationCapture workload traces from training and inference platformsAnalyze:Memory bandwidthKV-cache growthStorage access patternsNetwork trafficDevelop forecasting models for future memory such as HBF and storage requirementsGenerate insights that guide next-generation memory product developmentAI Memory and Storage Architecture EvaluationEvaluate system bottlenecks across:SSDNetworkingGPU interconnectsPrototype new memory-system architecturesStudy disaggregated memory and storage approachesValidate AI infrastructure benefits of future SANDISK technologiesDigital Twin and SimulationBuild simulation environments for AI systemsDevelop digital-twin platforms based on real workload tracesModel future AI infrastructure configurationsEvaluate performance of future HBM, SSD, and memory products before silicon availabilityResearch and Ecosystem CollaborationCollaborate with:UniversitiesStartup companiesNational laboratoriesCloud service providersSystem OEMsJointly evaluate emerging AI infrastructure architecturesPublish technical papers and contribute to industry standardsRequiredBS+ 10 years or MS+ 6 years or PhD+ 3 years. Relevant AI experience for BS is 5 years, MS is 3 years, PhD is coursework and 2 years.Technical QualificationsAI InfrastructureLinuxKubernetesDockerSlurmPythonGPU cluster administrationDistributed systems engineeringAI ServingvLLMNVIDIA DynamoTensorRT-LLMTritonSGLangAgentic AI frameworksRAG systemsNetworking and Scale-Out SystemsInfiniBandRoCERDMANCCLMulti-node inferenceDistributed AI clusters(These are not explicitly listed in all openings but are highly relevant to the AI/HPC infrastructure responsibilities described in the positions.)AI System ArchitectureAI accelerator architectureMemory hierarchy optimizationSSD architectureStorage-memory co-designAI performance modelingHardware/software co-designWhat SANDISK Would Likely ExpectThe AI/HPC engineer is expected to do three things simultaneously:Operate advanced AI infrastructure.Understand AI workloads deeply enough to identify memory and storage bottlenecks.Translate those findings into future SSD, HBF, and AI-memory product requirements.For the AI lab, the ideal candidate would be someone who has hands-on experience with vLLM, Dynamo, Ray, RDMA, KV-cache optimization, GPU clusters, and AI performance characterization, because that person can both run the infrastructure and provide direct feedback for future memory-system innovation.Additional InformationSandisk is committed to providing equal opportunities to all applicants and employees and will not discriminate based on their race, color, ancestry, religion (including religious dress and grooming standards), sex (including pregnancy, childbirth or related medical conditions, breastfeeding or related medical conditions), gender (including a person’s gender identity, gender expression, and gender-related appearance and behavior, whether or not stereotypically associated with the person’s assigned sex at birth), age, national origin, sexual orientation, medical condition, marital status (including domestic partnership status), physical disability, mental disability, medical condition, genetic information, protected medical and family care leave, Civil Air Patrol status, military and veteran status, or other legally protected characteristics. We also prohibit harassment of any individual on any of the characteristics listed above. Our non-discrimination policy applies to all aspects of employment. We comply with the laws and regulations set forth in the Equal Employment Opportunity is the Law poster.Sandisk thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We believe the fusion of various perspectives results in the best outcomes for our employees, our company, our customers, and the world around us. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution.Sandisk is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at [email protected] to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.