8-GPU AI servers: HGX, Instinct and Gaudi 3 nodes

49 models from 27 makers: 49 carry 8 GPUs. Stated chassis heights: 3 to 10U. Printed node power: 14.3 to 15 kW.

Eight accelerators on one baseboard is the standard training and inference node, and the unit most clusters are sized in. Compare chassis height, cooling and host memory here before you plan the rack.

Last verified

Server Maker GPU or accelerator GPUs Height (U) Cooling Rack kW
QCT QuantaGrid D75L-3U QCT (Quanta) NVIDIA HGX B300 8 3 Liquid —
AMAX AceleMax AXG-428ILC2 AMAX NVIDIA HGX B200 8 4 Liquid —
ASRock Rack 4U8X-GNR2/DLC SYN B200 ASRock Rack NVIDIA HGX B200 8 4 — —
GIGABYTE G4L3-SD1-LAX5 GIGABYTE NVIDIA HGX B200 8 4 Liquid —
GIGABYTE G4L4-SD3-LAX7 GIGABYTE NVIDIA HGX B300 8 4 Liquid —
MSI CG480-S5063 MSI NVIDIA RTX PRO 6000 Blackwell Server Edition 8 4 Air —
Pegatron AS404-2A1-8I2 Pegatron AMD Instinct MI355X 8 4 Liquid —
Penguin Solutions Altus XE4318GTS-DTC Penguin Solutions NVIDIA HGX B200 8 4 Liquid —
Supermicro A+ Server AS-4126GS-NBR-LCC Supermicro NVIDIA HGX B200 SXM 8 4 Liquid —
Supermicro AS-4126GS-NMR-LCC Supermicro AMD Instinct MI355X (one supported option) 8 4 Liquid —
Supermicro SYS-422GS-NB3RT-ALC Supermicro NVIDIA HGX B300 8 4 Liquid —
Supermicro SYS-422GS-NBRT-LCC Supermicro NVIDIA HGX B200 8 4 Liquid —
Lenovo ThinkSystem SR780a V3 Lenovo NVIDIA B200 SXM6 (one supported option) 8 5 Liquid —
Dell PowerEdge XE9680 Dell Technologies NVIDIA HGX H200 SXM5 (one supported option) 8 6 Air —
IEIT SYSTEMS (Inspur) NF5688G7 AMD IEIT Systems (Inspur) NVIDIA HGX Hopper 8 6 Air —
Colfax CX7850q-XK9 Colfax NVIDIA HGX H200 8-GPU SXM5 8 7 Air —
Exxact TensorEX TS4-128275176 Exxact NVIDIA B200 SXM 8 8 — —
GIGABYTE G893-SG1-AAX1 GIGABYTE Intel Gaudi 3 HL-325L OAM 8 8 — —
GIGABYTE G894-AD3-AAX7 GIGABYTE NVIDIA HGX B300 8 8 — —
GIGABYTE G894-SD3-AAX7 GIGABYTE NVIDIA HGX B300 8 8 — —
GIGABYTE G894-ZD3-AAX7 GIGABYTE NVIDIA HGX B300 8 8 — —
Hypertec CIARA TITAN GS685R-G6 B200 Hypertec NVIDIA HGX B200 8 8 Air —
Lenovo ThinkSystem SR680a V3 with B200 Lenovo NVIDIA B200 8 8 Air —
Lenovo ThinkSystem SR680a V4 Lenovo NVIDIA HGX B300 8 8 Air —
MiTAC Olympus G8825Z5U2BC-350X-755 MiTAC AMD Instinct MI350X 8 8 — —
Netweb Tyrone Camarero PDA200A2HG-812 Netweb NVIDIA HGX B200 8 8 — —
Supermicro AS-8126GS-TNMR Supermicro AMD Instinct MI350X (one supported option) 8 8 Air —
Supermicro GPU SuperServer SYS-822GS-NBRT Supermicro NVIDIA HGX B200 SXM6 8 8 Air —
Supermicro SYS-822GA-NGR3 Supermicro Intel Gaudi 3 (OAM) 8 8 Air —
Supermicro SYS-822GS-NB3RT Supermicro NVIDIA HGX B300 8 8 Air —
Thinkmate GPX GE95-2808-8HGX-B2 Thinkmate NVIDIA HGX B200 SXM 8 8 — —
xFusion FusionServer G8600 V7 xFusion — 8 8 — —
ASUS XA NB3I-E12 ASUS NVIDIA HGX B300 8 9 — —
Cisco UCS C880A M8 Cisco NVIDIA HGX B300 NVL8 8 10 Air —
Dell PowerEdge XE9785 Dell Technologies AMD Instinct MI355X (one supported option) 8 10 Air —
H3C UniServer R5500 G7 X H3C — 8 10 — —
HPE Compute XD690 HPE NVIDIA HGX B300 8 10 Air —
Inventec P9000IG6(AC) Inventec NVIDIA HGX B200 8 10 Air —
NVIDIA DGX B200 NVIDIA NVIDIA B200 8 10 — —
NVIDIA DGX B300 NVIDIA NVIDIA B300 Blackwell Ultra 8 10 — —
QCT QuantaGrid D75H-10U QCT (Quanta) NVIDIA HGX B300 8 10 — —
Bull (formerly Eviden) BullSequana AI 641-A02/H02 Bull (Eviden) NVIDIA HGX H200 8 — Air or liquid —
Compal SG720-2A Compal AMD Instinct MI355X (one supported option) 8 — Air or liquid —
Dell PowerEdge XE9780 Dell Technologies NVIDIA HGX B300 NVL8 (one supported option) 8 — Air —
Dell PowerEdge XE9780L Dell Technologies NVIDIA HGX B300 (one supported option) 8 — Liquid —
Dell PowerEdge XE9785L Dell Technologies AMD Instinct MI355X (one supported option) 8 — Liquid —
Fsas Technologies (Fujitsu) PRIMERGY GX2570 M8s Fsas Technologies (Fujitsu) NVIDIA HGX B200 8 — Air or liquid —
HPE ProLiant Compute XD685 HPE NVIDIA B300 (direct-liquid-cooled option) 8 — Air or liquid —
Supermicro SYS-222GS-NB3OT-ALC Supermicro NVIDIA HGX B300 8 — Liquid —

Next in the buying chain

Other lists