System Integration And Test Engineer

Senior Lead Engineer, Systems/Applications Validation

Summary

The Senior Lead, System Integration Test Engineer, works with cross functional teams of design engineers, customers, supply chain and project managers to rigorously test and validate rack-level, system solutions and ensure new product release readiness. This position will own the test system setup and function for complex, high-end servers and hyperscale compute & network racks, including applications and operating systems. The ideal candidate will have a rack-level, system integration test background in storage/server, GPU and networking products. He/she will develop and provide guidance on Celestica Storage/GPU/network system integration and verification plans, test cases and test coverage, such as: element function test, hardware integration test, system and rack integration verification.

Detailed Description

• Design & Execute the comprehensive validation and integration of all components within advanced AI compute racks, ensuring hardware and software elements function cohesively and optimally, ensuring compatibility, connectivity, performance, security, reliability, cost effectiveness and resilience.
• Contribute to the development and implementation of system integration test solutions and participate in project planning, scheduling, and reporting. Review and interpret product/system requirements/specifications and define system integration and validation plans.
• System Test Setup & Execution: Set up, rigorously test, and qualify complete rack solutions to guarantee they meet or exceed stringent performance, reliability, and efficiency standards. Own the test system setup and function for complex, high-end servers and hyperscale compute & network racks, including applications and operating systems. Oversee the qualification and seamless integration of rack components such as servers, accelerators, switches, power shelves, and cooling solutions.
• Power Distribution Management: Integrate and configure smart PDUs (Power Distribution Units) to efficiently manage power distribution within the rack. Ensure seamless compatibility with rack-level power management functions and overall system optimization.
• Rack-Level Management: Maintain a comprehensive understanding of and proficiency in rack-level management functions, including real-time monitoring, control, and automation of critical rack components.
• Hands-On Racking and Stacking: Execute hands-on lab racking and stacking procedures, including the assembly and setup of intricate, high-touch rack configurations. Ensure meticulous installation and integration of all components.
• Documentation and Reporting: Create and maintain thorough and detailed documentation for all rack level integrations. This includes documenting installation procedures, test plans, testing results, performance metrics, and any issues identified during the testing process.
• Cross-Functional Collaboration: Work closely and collaboratively with a diverse range of cross functional teams, including design engineers, program managers, customers, and vendors. The goal is to ensure seamless integration, optimal operation, and the successful delivery of cutting-edge rack level solutions.
• Test Automation & AI: Identify & automate system integration testing to reduce development time, increase quality and reduce errors. Identify and use AI tools to streamline and improve efficiency of planning, executing, analyzing & reporting.
• Troubleshooting & Root-Cause: Perform troubleshooting, debugging and root-cause analysis on hardware, network, and software related issues.

Knowledge/Skills/Competencies

• Experienced in troubleshooting with oscilloscopes, logic analyzers, and experienced with specialized test equipment such as PCI protocol analyzers and Traffic generators (Keysight/Ixia or Spirent)
• Experienced in defining test plans, creating & executing tests, and generating test reports for internal and external uses.
• Experienced with stress testing utilities, stressapp, stress-ng, iperf3, FIO, memtester, etc
• Experienced in Linux with RHEL, Ubuntu and CentOS
• Experienced in scripting languages: Python, Perl, VBA, REST API, Shell scripting, Ansible, Terraform etc.
• Experienced in test tools such as JIRA, Jenkin (CI/CD), and similar tools
• Prior experience in collaborating with a cross-functional team of engineers involved in the specification, design, development and test of hardware
• Knowledge and understanding of x86/Firmware/Linux.
• System/software/firmware integration and verification experience
• Prior experience in use of AI tools and test automation
• Past experience in project management. Able to handle simultaneous projects, predict your workload/execution, and deliver per plan.
• Must be self-motivated and able to work independently in a fast-paced, multi-tasking environment
• Rack-Level System Integration Expertise: 3+ years (hands-on) is mandatory
• Experience should include working with servers, accelerators, switches, CDU (Cooling Distribution Unit) systems, and high-power shelves.
• Possess and maintain a deep understanding of AI compute rack configurations and the functionality of all integrated components.
• Demonstrated hands-on experience with lab racking and stacking, as well as setting up complex, high touch rack configurations.
• Possess a strong understanding of rack-level management functions and integration best practices
• Proven experience in testing and qualifying rack-level solutions to ensure they meet or exceed performance and Reliability benchmarks.
• Excellent verbal and written communication skills
• Exceptional problem-solving skills and attention to detail is critical for success

Physical Demands

• Duties of this position are performed in a normal office environment.
• Duties may require extended periods of sitting and sustained visual concentration on a computer monitor or on numbers and other detailed data.
• Repetitive manual movements (e.g., data entry, using a computer mouse, using a calculator, etc.) are frequently required.
• Occasional travel may be required.

Typical Experience

• 4 to 7 years in a similar role or industry.