NVIDIA Investor Presentation Deck
Software Acceleration
Hardware Acceleration
The NVIDIA AI Network Advantage
Hardware & software accelerated in-network computing
NCCL - NVIDIA Collective Communication Library
The SDK library for Al communications - connects the GPUs
and the network for the Al network operations.
SHARP - NVIDIA Scalable Hierarchical Aggregation and Reduction
Protocol Technology
SHARP is part of the InfiniBand and NVLink switch ASICs. It enables the
network to perform data reduction operations, an important element of Al
workloads. This decreases the amount of data traversing the network and
dramatically reduces collective operations time.
8
NCCL Performance With vs Without SHARP
(In-network Computing)
16
32 64
1.7X HIGHER
InfiniBand
(with SHARP)
Best Theoretical
Ethernet
performance
128 256 512 1024 2048 4096 8192 16384
Message Size (MiB)
nVIDIA
|View entire presentation