GPU NODES
NVIDIA H100
Tap into exceptional performance, scalability, and security for every workload with the NVIDIA H100 Tensor Core GPU. The GPU also includes a dedicated Transformer Engine to solve trillion-parameter language models.
Key Facts
4X FASTER
Training for GPT-3 (175B)
The H100 provides up to 4X faster training over the prior generation for GPT-3 (175B) models.
12X PERFORMANCE
Model Performance
H100 NVL GPUs increase GPT-175B model performance up to 12X over A100.
80 GB
HBM3 Memory
High-bandwidth HBM3 memory built for large AI training and inference workloads.
30X FASTER
AI Inference
Accelerate inference by up to 30X and deliver the lowest latency.
Our Nodes
The H100’s combined technology innovations can speed up large language models (LLMs) by an incredible 30X over the previous generation to deliver industry-leading conversational AI.
