RemoteLeaf Logo
Log in Sign up

Principal AI Network Engineer

4 days, 11 hours ago
Anywhere
Full-time
Lead
Network Engineer
DevOps and Infrastructure
Ansible Python
Apply Now
Highrise AI

Highrise AI

One platform for developing, training, and deploying AI models.

Internet Software & Services
1-10
View All Jobs 7

Description

  • Lead commissioning and production readiness of AI cluster network fabrics, from switch initialization through host connectivity validation.
  • Configure and integrate high-speed Ethernet and InfiniBand fabrics, including RDMA/RoCE, storage, management, and out-of-band networks.
  • Validate network topology, routing, redundancy, addressing, port mappings, optics, cabling, and switch/NIC interoperability.
  • Develop network automation, configuration-management practices, firmware and OS baselines, and repeatable deployment procedures.
  • Execute fabric qualification and acceptance testing for link health, bandwidth, latency, congestion, resilience, and scaling behavior.
  • Tune RDMA transport, congestion control, QoS, PFC/ECN, routing, and switch/NIC settings to improve fabric performance.
  • Analyze NCCL and distributed-workload results with compute engineers to resolve multi-node communication bottlenecks.
  • Serve as a Tier 3 escalation point for production incidents, leading root-cause analysis and vendor escalations.
  • Support network upgrades, expansions, failover testing, controlled changes, and post-maintenance validation.
  • Create diagnostic automation, monitoring standards, runbooks, operational handoffs, and technical reporting for internal teams and stakeholders.

Requirements

  • Bachelor’s degree in computer science, engineering, networking, or a related discipline, or equivalent practical experience.
  • 10+ years of hands-on data center or high-performance networking experience, including deep troubleshooting and technical leadership.
  • Experience deploying and operating large-scale, low-latency networks for AI, HPC, cloud, or comparable distributed systems.
  • Deep expertise in Ethernet and/or InfiniBand fabrics, RDMA/RoCE, routing and switching, and multi-tier data center network architectures.
  • Experience with 200/400/800G networking, NICs, optical interconnects, performance testing, and network telemetry.
  • Proficiency with Linux networking and automation using Python, Ansible, or equivalent tools.
  • Familiarity with NVIDIA networking and fabric-management tools is highly desirable.
  • Expert problem-solving ability across physical, link, transport, and application-facing network performance layers.
  • Ability to independently make technical decisions and collaborate with compute, storage, systems, site, vendor, and customer teams.
  • Availability for data-center travel, critical incidents, and maintenance activities outside regular business hours; hybrid or remote work based on location.

Benefits

  • Hybrid or remote work arrangement, depending on location.
  • Opportunity to define technical standards and directly influence the reliability and performance of large-scale AI clusters.
  • Collaboration with experienced infrastructure engineers and cross-functional technology, energy, and infrastructure professionals.
  • Opportunity to propose new products, services, and initiatives to senior leadership.
  • Professional networking and learning opportunities across technology, energy, and infrastructure.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

T5 Data Centers

Sr Network Solutions Engineer

T5 Data Centers 201-500 IT Services

T5 is seeking a Network Engineer to design, secure, and support high-availability network infrastructure connecting data center operations and critical facility systems throughout the facility lifecycle.

Anywhere Senior Network Engineer
Cybersecurity Fortinet TCP/IP
11 hours, 5 minutes ago
Megaport

Senior Network Automation Engineer (EU)

Megaport 201-500 Diversified Telecommunication Services

Megaport is hiring a Senior Software Engineer to enhance and scale the network automation platform and internal tools that support its global Network as a Service offering.

United Kingdom Germany Full-time Senior Network Engineer
Cassandra CI/CD Perl PostgreSQL REST API SQL
2 days, 10 hours ago
Megaport

Compute Network Engineer

Megaport 201-500 Diversified Telecommunication Services

Megaport is seeking a Compute Network Engineer in Australia to design, deploy, and evolve the data centre network fabrics supporting Latitude’s bare-metal and accelerated compute platform.

Australia Full-time Senior Network Engineer
Agile Perl Python
2 days, 10 hours ago
Brillio

Senior Lead Engineer - R01572085

Brillio 1001-5000 IT Services

Morgan Stanley is seeking a Senior Lead Engineer to provide Level 3 operations, incident resolution, and automation support for its global load-balancing infrastructure and application delivery services.

India Lead Network Engineer
Ansible C# DNS HTTP Load Balancing Perl PowerShell Python TCP/IP Unix
4 days, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers