Lead Architect for AI Cloud Infrastructure (m/f/d)

NVIDIA and Deutsche Telekom are jointly developing the world’s first industrial AI cloud for European manufacturers. This AI factory in Germany will host 10,000 GPUs across NVIDIA DGX B200 systems and RTX Pro Servers. Deutsche Telekom provides secure, sovereign and fast infrastructure, including data centers, operations, security, and AI solutions.
Role Overview:
We are seeking an Lead Architect for Network Infrastructure at Industrial AI Cloud to design, build, automate network platform for automation and operation related network components such as Switches, Firewalls, Routers, Border Gateways as part of core environment of the Industrial AI Cloud. In this role you will design, provision and manage above mentioned stack, implement and fine-tune monitoring, and deploy additional components if necessary. You’ll be working and coordinating between multiple teams (such as Infrastructure, Platform) to deliver and continuously improve infrastructure services following ITIL processes.
Lead Architect Considers and defines design to enable automated configuration management, release management, build, test and deployment activities. This is a customer facing role/ tailor made solutions and implementations for the customer including consultancy. Proprietary technologies used for managing above scope: InfiniBand, Cumullus OS, RoCE, UFM, FortiGate friewalls, Cisco Border gateways.
WHAT WILL YOU DO?
Coordinate Operations together with Data Center, IaaS & PaaS layer: Coordinate and support network lifecycle activities (installs, upgrades, changes, firmware updates) and manage /network interconnections and related documentation
Switch & Firewall Management: Provision and maintain InfiniBand switches according to ITIL Standards
Automation: Develop and maintain automation scripts to orchestrate overall scope. Fine tuning, configuration changes through whole project lifetime
OS & Firmware Management: Maintain network-based environments, apply patches, and manage firmware upgrades at scale.
Monitoring & Observability:
ITIL Processes: Follow and improve incident, problem, and change management workflows; document runbooks and standard operating procedures. Adhere to ZERO Outage guidelines.
Cross-Team Collaboration: Work closely with Platform Engineers and AI solution teams to ensure smooth deployments and operations.
Manage High-Speed Fabric: A unified network fabric utilizing both InfiniBand and Ethernet / RoCE technologies.
Build and develop concepts, processes and methods for automation, optimization, and standardization to satisfy efficiency and automation requirements.
Provide advice or information at request or at own initiative to all relevant employees or customers regarding technical aspects of products.
Mentor and train co-workers to spread knowledge level and develop their skills.
Act as technical lead and solve and coordinate activities across related technologies/outside own team.
The network architect must demonstrate expertise and experience with the following technologies, as our environment relies on their optimal configuration and management of InfiniBand, RoCE, managing UFM, FortiGate Firewalls and Cisco Border gateways.
Experience with the following technologies, as our environment relies on their optimal configuration and management of InfiniBand, RoCE, managing UFM, FortiGate Firewalls and Cisco Border gateways.
YOU WILL SUCCEED IF YOU:
Bring hands-on experience in network installation, maintenance, and operations.
Have knowledge of InfiniBand architecture, RDMA over Converged Ethernet (RoCE), and low-latency, high-throughput networking for AI/HPC workloads.
Possess knowledge of Data Center Routing & Border Gateway Protocols, including understanding of Cisco or Juniper routers (e.g., CR‑8608, PTX10004) and BGP/OSPF routing, as well as ASNs, IP Transit, peering, and failover connectivity.
Demonstrate strong Linux skills.
Are skilled in continuous monitoring, incident detection, and root-cause analysis for large-scale data center networks.
Have experience with Firewall & Security.
Have hands-on experience in Configuration & Lifecycle Management, including switch provisioning, firmware/OS upgrades, patch management, and configuration backups.
Have experience in the design and delivery of systems based on IaaS, PaaS, and SaaS.
Have experience with scripting in Python/Bash.
Use automation tools effectively (Ansible, SaltStack, Terraform, Helm) for deployments.
Are expert in automation using Git (GitHub, GitLab) and CI/CD tools such as GitHub Actions or GitLab CI/CD.
Understand Software-Defined Networking (SDN) principles.
Use monitoring and visualization tools such as Grafana and Prometheus.
Speak English at B2 level; German is an advantage.

Employment type
Full-time

Work arrangement
Hybrid