HGX H100系统中使用的NVIDIA H100 GPU具有变压器引擎,具有FP8 Precision,可为大型语言模型(例如GPT-3 175B)提供高达4倍的训练。The combination of fourth-generation NVLink, which offers 900GB/s of GPU-to-GPU interconnect, NVLink Switch System, which accelerates collective communication by every GPU across nodes, PCIe Gen5, and NVIDIA Magnum IO ™ software delivers efficient scalability, from small enterprises to massive, unified GPU clusters.这些基础架构与NVIDIA AI Enterprise Software Suite合作,使NVIDIA HGX H100成为最强大的端到端AI和HPC数据中心平台。
主要关键词