Senior Principal HPC/AI Architect

Make an impact with NTT DATA

Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

Your day at NTT DATA

We are seeking a highly skilled and visionary Senior Principal HPC/AI Infrastructure Architect to lead the technical design and architecture of large-scale AI infrastructure solutions. This role is pivotal in shaping next-generation AI Factories, supporting customer engagements, and driving technical excellence across compute, interconnect, and software stack domains.

Key Responsibilities

• AI Factory Architecture & Design (35%)
• Design GPU cluster architectures tailored for AI and HPC workloads.
• Define node configurations for diverse workload types including dense GPU nodes, cost-optimized nodes, and high-memory CPU nodes.
• Specify and validate performance metrics including compute throughput, memory bandwidth, and power consumption.
• Architect multi-tier interconnect networks using NVLink, InfiniBand, and high-speed Ethernet.
• Develop topology designs and calculate bandwidth and latency targets.
• Model performance for customer workloads and validate against industry benchmarks.
• Pre-Sales Technical Leadership (30%)
• Lead technical discussions with customer architects and stakeholders.
• Conduct workload sizing and architectural presentations.
• Develop technical content for proposals including BoMs, compliance matrices, and scoring alignment.
• Analyze competitor solutions and articulate technical differentiators.
• Demonstrator Lab Development (20%)
• Design and expand lab infrastructure for AI workload testing and validation.
• Build reference architectures across industries such as finance, manufacturing, healthcare, and research.
• Support lab operations including cluster configuration, workload orchestration, and software stack maintenance.
• Customer Demonstrations & PoCs (10%)
• Deploy and showcase customer-specific AI workloads including LLM training, computer vision, and scientific simulations.
• Manage proof-of-concept projects, define success criteria, and present outcomes to stakeholders.
• Technical Expertise & Innovation (5%)
• Maintain relationships with key technology vendors and participate in early access programs.
• Evaluate emerging technologies and contribute to innovation roadmaps and adoption strategies.
  
  

Required Skills & Experience

Technical Competencies

• GPU Architectures: NVIDIA (H100, H200, B100, B200), AMD (MI300X), Intel (Gaudi2/3)
• Interconnects: InfiniBand (HDR/NDR/XDR), NVLink, RoCE, Infinity Fabric
• Storage Systems: Lustre, GPFS, BeeGFS, NVMe-oF, S3-compatible object storage
• Container Platforms: Kubernetes, Docker, Singularity/Apptainer
• Performance Tools: NVIDIA Nsight, ROCm, Intel VTune
  
  

Certifications (Preferred)

• NVIDIA Deep Learning Institute (DLI)
• Red Hat Certified Specialist in OpenShift
• InfiniBand Certified Professional
  
  

Experience

• 8+ years in HPC/AI infrastructure design
• 5+ years working with GPU-accelerated systems
• Proven experience with large-scale GPU deployments (1000+ GPUs)
• Successful track record in technical bid support and customer engagement
  
  

What We Offer

• Opportunity to work on cutting-edge AI infrastructure projects
• Collaborative and innovative work environment
• Access to advanced lab infrastructure and vendor technologies
• Career development through technical leadership and innovation
  
  

Workplace type:

Hybrid Working

About NTT DATA

NTT DATA is a $30+ billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world’s leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. Our consulting and industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is part of NTT Group, which invests over $3 billion each year in R&D.

Equal Opportunity Employer

NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

Third parties fraudulently posing as NTT DATA recruiters

NTT DATA recruiters will never ask job seekers or candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties who may attempt to impersonate NTT DATA recruiters—whether in writing or by phone—in order to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will come from an @nttdata.com email address. If you suspect any fraudulent activity, please contact us.