Introduction

Next Generation Graphics
The NVIDIA L40 brings the highest level of power and performance for visual computing workloads in the data center.

Powerful Compute and AI
Groundbreaking features in the NVIDIA L40 accelerate a wide range of compute-intensive workloads running in the data center, including training, inferencing, data science, and graphics applications.

Data Center-Ready
Designed for 24 x 7 enterprise data center operations and optimized to deploy at scale, the NVIDIA L40 utilizes enterprise-grade components, power-efficient hardware, and features like secure boot with internal root of trust.

Unprecedented Visual Computing Performance for the Data Center
From virtual workstations to large-scale modeling and simulation, modern visual computing and scientific applications are growing in complexity and quantity. Enterprises need data center solutions that can deliver extreme performance and scale with versatile capabilities to conquer the diverse computing demands of these increasingly complex workloads.

The NVIDIA L40 delivers unprecedented visual computing performance for the data center, providing next-generation graphics, compute, and AI capabilities to GPU-accelerated applications. Based on the Ada Lovelace GPU architecture, the L40 features third-generation RT Cores that enhance real-time ray tracing capabilities, and fourth-generation Tensor Cores with support for the FP8 data format to deliver over a petaflop of inferencing performance. These new features are combined with the latest generation CUDA Cores and 48GB of graphics memory to accelerate visual computing workload from high-performance virtual workstation instances to large-scale digital twins in NVIDIA Omniverse. With up to twice the performance of the previous generation at the same power, the NVIDIA L40 is uniquely suited to provide the visual computing power required by the modern data center.

Processor

CUDA

Yes

CUDA cores

18176

Graphics processor family

NVIDIA

Graphics processor

L40

Maximum resolution

7680 x 4320 pixels

Maximum displays per videocard

4

Memory

Discrete graphics card memory

48 GB

Graphics card memory type

GDDR6

Memory bus

384 bit

Data transfer rate

64 Gbit/s

Memory bandwidth (max)

864 GB/s

Ports & interfaces

Interface type

PCI Express x16 4.0

DisplayPorts quantity

4

DisplayPort version

1.4

Performance

TV tuner integrated

No

Design

Cooling type

Passive

Form factor

Full-Height/Half-Length (FH/HL)

Number of slots

2

Product colour

Black, Gold

Power

Power consumption (max)

300 W

Weight & dimensions

Depth

266.7 mm

Width

111.6 mm