NVIDIA H100
Tap into exceptional performance, scalability, and security for every workload with the NVIDIA H100 Tensor Core GPU. The GPU also includes a dedicated Transformer Engine to solve trillion-parameter language models.
Key Facts
4X FASTER
Training for GPT-3 (175B)
The H100 provides up to 4X faster training over the prior generation for GPT-3 (175B) models.
12X PERFORMANCE
Model Performance
H100 NVL GPUs increase GPT-175B model performance up to 12X over A100.
183 GB
HBM3 Memory
GB200 NVL72 is 18X faster at processing data than Intel Xeon 8480+.
30X FASTER
AI Inference
Accelerate inference by up to 30X and deliver the lowest latency.
Our Nodes
The H100’s combined technology innovations can speed up large language models (LLMs) by an incredible 30X over the previous generation to deliver industry-leading conversational AI.
