Compare

NVIDIA RTX 2080 Ti vs NVIDIA Titan RTX vs NVIDIA Tesla V100

Quick links:

Best GPUs for deep learning, AI development, compute in 2023–2024. Recommended GPU & hardware for AI training, inference (LLMs, generative AI). GPU training, inference benchmarks using PyTorch, TensorFlow for computer vision (CV), NLP, text-to-speech, etc.

We benchmark these GPUs and compare AI performance (deep learning training; FP16, FP32, PyTorch, TensorFlow), 3d rendering, Cryo-EM performance in the most popular apps (Octane, VRay, Redshift, Blender, Luxmark, Unreal Engine, Relion Cryo-EM).

Our benchmarks will help you decide which GPU (NVIDIA RTX 4090/4080, H100 Hopper, H200, A100, RTX 6000 Ada, A6000, A5000, or RTX 6000 ADA Lovelace) is the best GPU for your needs. We provide an in-depth analysis of the AI performance of each graphic card's performance so you can make the most informed decision possible. We offer deep learning and 3d rendering benchmarks that will help you get the most out of your hardware.


Looking for a GPU workstation or server for AI/ML, design, rendering, simulation or molecular dynamics?
Explore BIZON AI workstations or GPU servers.
Contact us today or explore our various customizable AI solutions.


Featured GPU benchmarks:

Benchmarks

Deep Learning GPU Benchmarks 2023–2024 [Updated]

Resnet50 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
488.56
NVIDIA Titan RTX
599.29
NVIDIA Tesla V100
706.07
4 GPU
NVIDIA RTX 2080 Ti
1597.66
NVIDIA Titan RTX
1793.02
NVIDIA Tesla V100
2309.02
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Resnet50 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
741.26
NVIDIA Titan RTX
938.63
NVIDIA Tesla V100
1071.32
4 GPU
NVIDIA RTX 2080 Ti
2465.23
NVIDIA Titan RTX
3015.66
NVIDIA Tesla V100
3562.89
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Resnet50 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
302.88
NVIDIA Titan RTX
330.9
NVIDIA Tesla V100
321.57
4 GPU
NVIDIA RTX 2080 Ti
1075.19
NVIDIA Titan RTX
1111.27
NVIDIA Tesla V100
1141.56
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Resnet50 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
330.72
NVIDIA Titan RTX
364.35
NVIDIA Tesla V100
351.14
4 GPU
NVIDIA RTX 2080 Ti
1132.16
NVIDIA Titan RTX
1231.15
NVIDIA Tesla V100
1202.04
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Resnet152 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
213.35
NVIDIA Titan RTX
267.62
NVIDIA Tesla V100
308.35
4 GPU
NVIDIA RTX 2080 Ti
681.19
NVIDIA Titan RTX
751.47
NVIDIA Tesla V100
984.5
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Resnet152 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
290.23
NVIDIA Titan RTX
369.05
NVIDIA Tesla V100
419.46
4 GPU
NVIDIA RTX 2080 Ti
977.06
NVIDIA Titan RTX
1205.22
NVIDIA Tesla V100
1412.1
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Resnet152 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
139.43
NVIDIA Tesla V100
134.94
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
450.18
NVIDIA Tesla V100
452.05
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Resnet152 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
147.6
NVIDIA Tesla V100
143.28
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
502.34
NVIDIA Tesla V100
519.5
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Inception V3 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
293.76
NVIDIA Titan RTX
374
NVIDIA Tesla V100
424.55
4 GPU
NVIDIA RTX 2080 Ti
1031
NVIDIA Titan RTX
1226.21
NVIDIA Tesla V100
1490.05
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Inception V3 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
404.99
NVIDIA Titan RTX
543.32
NVIDIA Tesla V100
585.31
4 GPU
NVIDIA RTX 2080 Ti
1467.97
NVIDIA Titan RTX
1901.16
NVIDIA Tesla V100
2121.59
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Inception V3 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
198.81
NVIDIA Titan RTX
226.3
NVIDIA Tesla V100
211.08
4 GPU
NVIDIA RTX 2080 Ti
739.49
NVIDIA Titan RTX
814.29
NVIDIA Tesla V100
785.13
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Inception V3 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
215.54
NVIDIA Titan RTX
244.12
NVIDIA Tesla V100
228.85
4 GPU
NVIDIA RTX 2080 Ti
772.66
NVIDIA Titan RTX
967.93
NVIDIA Tesla V100
820.35
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Inception V4 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
155.84
NVIDIA Titan RTX
200.71
NVIDIA Tesla V100
225.21
4 GPU
NVIDIA RTX 2080 Ti
564.62
NVIDIA Titan RTX
664.39
NVIDIA Tesla V100
816.02
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Inception V4 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
220.7
NVIDIA Titan RTX
298.5
NVIDIA Tesla V100
318.96
4 GPU
NVIDIA RTX 2080 Ti
790.82
NVIDIA Titan RTX
1042.2
NVIDIA Tesla V100
1142.94
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Inception V4 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
111.56
NVIDIA Tesla V100
102.53
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
394.81
NVIDIA Tesla V100
383.89
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Inception V4 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
118.83
NVIDIA Tesla V100
108.26
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
427.81
NVIDIA Tesla V100
415.26
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

VGG16 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
264.14
NVIDIA Titan RTX
366.59
NVIDIA Tesla V100
381.74
4 GPU
NVIDIA RTX 2080 Ti
578.14
NVIDIA Titan RTX
518.28
NVIDIA Tesla V100
835.56
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

VGG16 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
324.85
NVIDIA Titan RTX
504.48
NVIDIA Tesla V100
469.5
4 GPU
NVIDIA RTX 2080 Ti
926.34
NVIDIA Titan RTX
1235.83
NVIDIA Tesla V100
1338.8
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

VGG16 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
178.65
NVIDIA Titan RTX
199.68
NVIDIA Tesla V100
189.68
4 GPU
NVIDIA RTX 2080 Ti
452.2
NVIDIA Titan RTX
400.25
NVIDIA Tesla V100
480.12
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

VGG16 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
194.89
NVIDIA Titan RTX
218.47
NVIDIA Tesla V100
206.92
4 GPU
NVIDIA RTX 2080 Ti
528.33
NVIDIA Titan RTX
559.34
NVIDIA Tesla V100
560.94
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Googlenet (FP16)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Googlenet (FP32)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

3D, GPU Rendering Benchmarks 2023–2024 [Updated]

V-Ray

1 GPU
NVIDIA RTX 2080 Ti
345
NVIDIA Titan RTX
382
NVIDIA Tesla V100
505
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Octane

1 GPU
NVIDIA RTX 2080 Ti
368
NVIDIA Titan RTX
377
NVIDIA Tesla V100
356
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Redshift

1 GPU
NVIDIA RTX 2080 Ti
8.38
NVIDIA Titan RTX
8.2
NVIDIA Tesla V100
8.24
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Blender

1 GPU
NVIDIA RTX 2080 Ti
3163.85
NVIDIA Titan RTX
3434.73
NVIDIA Tesla V100
2075.51
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Luxmark

1 GPU
NVIDIA RTX 2080 Ti
33195
NVIDIA Titan RTX
36654
NVIDIA Tesla V100
35698
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Unreal Engine

1 GPU
NVIDIA RTX 2080 Ti
30.1
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

RELION Cryo-EM Benchmarks 2023-2024 [Updated]

Total run time

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

BERT LARGE Training, Inference Benchmark 2023-2024 [Updated]

Training Time (FP16)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Performance (FP16)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Training Time (FP32)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Performance (FP32)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA Tesla V100
n/a

Technical Specifications

Board Design

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
Length 267 mm 267 mm 267 mm
Outputs 1x HDMI, 3x DisplayPort, 1x USB Type-C 1x HDMI, 3x DisplayPort, 1x USB Type-C No outputs
Power Connectors 2x 8-pin 2x 8-pin 2x 8-pin
Slot width Dual-slot Dual-slot Dual-slot
TDP 250 W 280 W 250 W

Clock Speeds

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
Boost Clock 1545 MHz 1770 MHz 1380 MHz
GPU Clock 1350 MHz 1350 MHz 1230 MHz
Memory Clock 14000 MHz 14000 MHz 1752 MHz

Graphics Card

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
Bus Interface PCIe 3.0 x16 PCIe 3.0 x16 PCIe 3.0 x16
Generation GeForce 20 GeForce 20 Tesla (Vxx)

Graphics Features

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
DirectX 12 Ultimate (12_1) 12 Ultimate (12_1) 12 Ultimate (12_1)
OpenCL 2.0 2.0 1.2
OpenGL 4.6 4.6 4.6
Shader Model 6.5 6.5 6.4
CUDA 7.5 7.5 7.0

Graphics Processor

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
Architecture Turing Turing Volta
Die Size 754 mm2 754 mm2 815 mm2
GPU Name TU102-300A-K1-A1 TU102-400-A1 GV100
Process Size 12 nm 12 nm 12 nm
Transistors 18600 million 18600 million 21100 million

Memory

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
Bandwidth 616 GB/s 672 GB/s 897 GB/s
Memory Bus 352 bit 384 bit 4096 bit
Memory Size 11 GB 24 GB 32 GB
Memory Type GDDR6 GDDR6 HBM2

Render Config

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
ROPs 88 96 128
RT Cores 68 72
Shading Units/ CUDA Cores 4352 4608 5120
TMUs 272 288 320
Tensor Cores 544 576 640

Theoretical Performance

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
FP16 (half) performance 26.9 TFLOPS 32.62 TFLOPS 28.26 TFLOPS
FP32 (float) performance 13.45 TFLOPS 16.31 TFLOPS 14.13 TFLOPS
FP64 (double) performance 420.2 GFLOPS 509.8 GFLOPS 7066 GFLOPS
Pixel Rate 136 GPixel/s 169.9 GPixel/s 176.6 GPixel/s
Texture Rate 420.2 GTexel/s 509.8 GTexel/s 441.6 GTexel/s

Price

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
MSRP 1199 $ 2499 $ 11459 $
Release Date Sep 20th, 2018 Dec 18th, 2018 Mar 27th, 2018

Test bench configuration

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
Hardware BIZON G3000 More details BIZON ZX5000 More details BIZON X5000 More details
Software Deep learning:
Nvidia Driver: 440
CUDA: 10.1
TensorFlow: 1.14
Batch size: 64
3D Rendering:
Nvidia Driver: 442.19
VRay Benchmark: 4.10.3
Octane Benchmark: 4.00
Redshift Benchmark: 3.0.x
Blender: 2.81
Luxmark: 3.1
Deep learning:
Nvidia Driver: 440
CUDA: 10.1
TensorFlow: 1.14
Batch size: 64
3D Rendering:
Nvidia Driver: 442.19
VRay Benchmark: 4.10.3
Octane Benchmark: 4.00
Redshift Benchmark: 3.0.x
Blender: 2.81
Luxmark: 3.1
Deep learning:
Nvidia Driver: 440
CUDA: 10.1
TensorFlow: 1.14
Batch size: 64
3D Rendering:
Nvidia Driver: 442.19
VRay Benchmark: 4.10.3
Octane Benchmark: 4.00
Redshift Benchmark: 3.0.x
Blender: 2.81
Luxmark: 3.1

Recommended hardware

NVIDIA RTX 2080 Ti NVIDIA Titan RTX NVIDIA Tesla V100
Best GPU workstations BIZON X5500 BIZON X5500
Need Help? We're here to help.

Unsure what to get? Have technical questions?
Contact us and we'll help you design a custom system which will meet your needs.

Explore Products