Key Points
- Nvidia’s GB200 NVL4 is part of the Grace Blackwell lineup, combining two Grace CPUs and four Blackwell GPUs.
- It features 144 Arm Neoverse V2 cores and supports up to 1.3 TB of combined memory.
- The NVL4 is designed for mid-range performance with an estimated power draw of 6 kW per server.
- It balances high performance and lower power requirements, making it ideal for memory-intensive workloads.
Nvidia has unveiled its GB200 NVL4, a cutting-edge platform for modern data centers and computational workloads. This launch follows Nvidia’s recent restructuring of its product lineup, prioritizing innovative solutions like the NVL4 while phasing out older NVL platforms.
The GB200 NVL4 is part of Nvidia’s Grace Blackwell family, designed to offer flexible and scalable options for various deployment needs. Positioned as a mid-range solution, it combines two Arm-based Grace CPUs with four Blackwell GPUs, delivering a robust blend of performance and efficiency. Each Grace CPU boasts 72 Arm Neoverse V2 cores, providing a total of 144 cores per unit. The four Blackwell GPUs enhance acceleration for AI, high-performance computing (HPC), and other demanding tasks.
With six MCIO connectors under each CPU, the NVL4 ensures seamless PCIe connectivity, supporting NICs, SSDs, and other critical components for high-speed data transfer. Despite its powerful capabilities, Nvidia has focused on maintaining efficiency. When fully configured, the GB200 NVL4’s estimated power consumption is just over 6 kW per server. While this is higher than older platforms like the Nvidia DGX-1 or HGX-1, which drew around 3.5 kW, the NVL4 offers a significant performance boost in exchange.
Another standout feature is its support for up to 1.3 TB of combined memory, making it ideal for memory-intensive applications and efficient data processing. This positions the NVL4 as a compelling choice for organizations seeking powerful solutions with lower power requirements than Nvidia’s higher-end NVL platforms.
Though it shares similarities with the flagship NVL72, the GB200 NVL4 distinguishes itself with a more compact and power-conscious design. The NVL72, with its edge connectors and spine configuration, caters to larger-scale deployments and boasts double the compute resources. In contrast, the NVL4 balances size, power consumption, and performance, making it a versatile option for diverse computational needs.