Generative AI Computing Platform
NVIDIA Gross Margins Reflect Value of Acceleration
Accelerated computing requires full-stack and data
center-scale innovation across silicon, systems,
algorithms and applications.
Significant expertise and effort are required, but
application speed-ups can be incredible, resulting
in dramatic cost and time-to-solution savings.
For example, 2 NVIDIA HGX nodes with 16 NVIDIA H100
GPUs that cost $400K can replace 960 nodes of CPU
servers that cost $10M for the same LLM workload.
NVIDIA chips carry the value of the full-stack,
not just the chip.
Gross Profit (Non-GAAP, $M) -Gross Margin (Non-GAAP)
$17,969
$15,965
$14,417
$10,947
67%
66%
$7,233
$6,821
63%
62%
59%
70%
Cost comparison example based on latest available NVIDIA A100 GPU and Intel CPU inference results in the commercially available category of
the MLPerf industry benchmark; includes related infrastructure costs such as networking.
FY19
FY20
FY21
FY22
FY23
1H FY24
FY23 financial metrics reflect a $2.2B charge for inventory and related reserves primarily related to Data Center and Gaming.
Fiscal year ends in January. Refer to Appendix for reconciliation of Non-GAAP measures. Gross margins are rounded to the nearest percent.
22
NVIDIA.View entire presentation