NVIDIA Investor Presentation Deck
20x
15x
10x
1x
5x
Ox
SINGLE-STREAM
Per-accelerator Normalized to Jetson AGX Xavier
0.9x
Centaur
NVIDIA Tops MLPerf Edge Inference Benchmarks
Leadership Performance for Edge Servers with T4, A100, and Edge Devices with Jetson
2.3x
NVIDIA Jetson AGX Xavier NVIDIA T4 E NVIDIA A100-PCle
2.0x 2.0x
X
2.9x
Object Image Speech
Detection Classification Recognition
SSD-Small ResNet-50
RNN-T
2.8x
Medical
Imaging.
3D U-Net
3.4x
Object
Detection
SSD-Large
4.8x
NLP
BERT
30x
25x
1x
20x
15x
10x
5x
Ox
X = No Result Submitted
MULTI-STREAM
Per-accelerator Normalized to Jetson AGX Xavier
■NVIDIA Jetson AGX Xavier
3.4x
Object
Detection
SSD-Small
NVIDIA T4
2.8x
Image
Classification
ResNet-50
E NVIDIA A100-PCle
MLPerf v0.7 Inference Closed; Edge Single-Stream derived from reported latencies and Multi-Stream. SSD-Small, ResNet-50 (Single-Stream): 0.7-131, 0.7-152, 0.7-153, 0.7-146 RNN-T, 3D U-Net 99.9%, SSD-Large,
BERT 99% (Single-Stream): 0.7-152, 0.7-153, 0.7-146 SSD-Small, ResNet-50, SSD-Large (Multi-Stream): 0.7-152, 0.7-153, 0.7-146 MLPerf name and logo are trademarks. See www.mlperf.org for more information.
4.0x
Object
Detection
SSD-LargeView entire presentation