一文走进GpuGeek | GPU如何选型？
1、 消费级 GPU****
| 型号**** | 显存**** | 半精度(TFLOPS)**** | 单精度(TFLOPS)**** | CUDA核心数量**** | Tensor核心数量**** | 架构**** | 显存类型**** |
|---|
| RTX 4090 | 24GB | 165.16 | 82.58 | 16384 | 512 | Ada Lovelace | GDDR6X |
| RTX 4090D | 24GB | 147.08 | 73.54 | 14592 | 456 | Ada Lovelace | GDDR6X |
| RTX 4080 | 16GB | 97.48 | 48.74 | 9728 | 304 | Ada Lovelace | GDDR6X |
| RTX 4070 Ti | 12GB | 80.18 | 40.09 | 7680 | 240 | Ada Lovelace | GDDR6X |
| RTX 4070 | 12GB | 58.30 | 29.15 | 5888 | 184 | Ada Lovelace | GDDR6X |
| RTX 4060 Ti | 16GB | 44.12 | 22.06 | 4352 | 136 | Ada Lovelace | GDDR6 |
| RTX 4060 Ti | 8GB | 44.12 | 22.06 | 4352 | 136 | Ada Lovelace | GDDR6 |
| RTX 4060 | 8GB | 30.22 | 15.11 | 3072 | 96 | Ada Lovelace | GDDR6 |
| RTX 3090Ti | 24GB | 80.00 | 40.00 | 10752 | 336 | Ampere | GDDR6X |
| RTX 3090 | 24GB | 71.16 | 35.58 | 10496 | 328 | Ampere | GDDR6X |
| RTX 3080Ti | 12GB | 68.20 | 34.10 | 10240 | 320 | Ampere | GDDR6X |
| RTX 3080 | 12GB | 61.28 | 30.64 | 8960 | 280 | Ampere | GDDR6X |
| RTX 3080 | 10GB | 59.54 | 29.77 | 8704 | 272 | Ampere | GDDR6X |
| RTX 3070 Ti | 8GB | 43.50 | 21.75 | 6144 | 192 | Ampere | GDDR6X |
| RTX 3070 | 8GB | 40.62 | 20.31 | 5888 | 184 | Ampere | GDDR6 |
| RTX 3060 Ti | 8GB | 33.40 | 16.20 | 4864 | 152 | Ampere | GDDR6X |
| RTX 3060 Ti | 8GB | 33.40 | 16.20 | 4864 | 152 | Ampere | GDDR6 |
| RTX 3060 | 12GB | 25.48 | 12.74 | 3584 | 112 | Ampere | GDDR6 |
| RTX 3060 | 8GB | 25.48 | 12.74 | 3584 | 112 | Ampere | GDDR6 |
| RTX 2080 Ti | 11GB | 26.90 | 13.45 | 4352 | 544 | Turing | GDDR6 |
| GTX 1080 Ti | 11GB | 22.68 | 11.34 | 3584 | 无 | Pascal | GDDR5X |
****
2、 专业级 GPU****
| 型号**** | 显存**** | 半精度(TFLOPS)**** | 单精度(TFLOPS)**** | 双精度(TFLOPS)**** | CUDA核心数量**** | Tensor核心数量**** | 架构**** | 显存类型**** |
|---|
| NVIDIA RTX A6000 | 48GB | 77.42 | 38.71 | 1.209 | 10752 | 336 | Ampere | GDDR6 |
| NVIDIA RTX A5000 | 24GB | 55.54 | 27.77 | 0.867 | 10752 | 256 | Ampere | GDDR6 |
| NVIDIA RTX A4000 | 16GB | 38.34 | 19.17 | 0.599 | 6144 | 192 | Ampere | GDDR6 |
| Quadro RTX 8000 | 48GB | 32.62 | 16.31 | 0.509 | 4608 | 576 | Turing | GDDR6 |
| Quadro RTX 6000 | 24GB | 32.62 | 16.31 | 0.509 | 4608 | 576 | Turing | GDDR6 |
| Quadro RTX 5000 | 16GB | 22.30 | 11.15 | 0.348 | 3072 | 384 | Turing | GDDR6 |
****
3、 云与数据中心级 GPU****
Tesla NVIDIA A系列 GPU****
| 型号**** | 显存**** | 半精度(TFLOPS)**** | 单精度(TFLOPS)**** | 双精度(TFLOPS)**** | CUDA核心数量**** | Tensor核心数量**** | 架构**** | 显存类型**** |
|---|
| NVIDIA A100 SXM4 | 80GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A100 SXM4 | 40GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A100 PCIe | 80GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A100 PCIe | 40GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A800 PCIe | 80GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A800 SXM4 | 80GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A40 PCIe | 48GB | 74.84 | 37.42 | 1.169 | 10752 | 336 | Ampere | GDDR6 |
| NVIDIA A30 PCIe | 24GB | 20.64 | 10.32 | 0.322 | 3584 | 224 | Ampere | HBM2e |
| NVIDIA A10 PCIe | 24GB | 62.48 | 31.24 | 0.976 | 9216 | 288 | Ampere | GDDR6 |
Tesla NVIDIA V系列 GPU****
| 型号**** | 显存**** | 半精度(TFLOPS)**** | 单精度(TFLOPS)**** | 双精度(TFLOPS)**** | CUDA核心数量**** | Tensor核心数量**** | 架构**** | 显存类型**** |
|---|
| Tesla V100 PCIe | 16GB | 28.26 | 14.13 | 7.066 | 5120 | 640 | Volta | HBM2 |
| Tesla V100 PCIe | 32GB | 28.26 | 14.13 | 7.066 | 5120 | 640 | Volta | HBM2 |
| Tesla V100 SXM2 | 16GB | 32.71 | 16.35 | 8.177 | 5120 | 640 | Volta | HBM2 |
| Tesla V100 SXM2 | 32GB | 31.33 | 15.67 | 7.834 | 5120 | 640 | Volta | HBM2 |
| Tesla V100 SXM3 | 32GB | 32.71 | 16.35 | 8.177 | 5120 | 640 | Volta | HBM2 |
| Tesla V100S PCIE | 32GB | 32.71 | 16.35 | 8.177 | 5120 | 640 | Volta | HBM2 |
Tesla NVIDIA T系列 GPU****
| 型号**** | 显存**** | 半精度**** | 单精度(TFLOPS)**** | 双精度**** | CUDA核心数量**** | Tensor核心数量**** | 架构**** | 显存类型**** |
|---|
| NVIDIA Tesla T4 | 16GB | 65.13TFLOPS (8:1) | 8.141 | 254.4GFLOPS (1:32) | 2560 | 320 | Turing | GDDR6 |
Tesla NVIDIA P系列 GPU****
| 型号**** | 显存**** | 半精度**** | 单精度(TFLOPS)**** | 双精度**** | CUDA核心数量**** | Tensor核心数量**** | 架构**** | 显存类型**** |
|---|
| NVIDIA Tesla P4 | 8GB | 89.12GFLOPS (1:64) | 5.704 | 178.2(GFLOPS1:32) | 2560 | - | Pascal | GDDR5 |
| NVIDIA Tesla P40 | 24GB | 183.7GFLOPS (1:64) | 11.76 | 367.4(GFLOPS1:32) | 3840 | - | Pascal | GDDR5 |
Tesla NVIDIA L系列 GPU****
| 型号**** | 显存**** | 半精度(TFLOPS)**** | 单精度(TFLOPS)**** | 双精度**** | CUDA核心数量**** | Tensor核心数量**** | 架构**** | 显存类型**** |
|---|
| NVIDIA L40 | 48GB | 90.52 | 90.52 | 1414(GFLOPS1:64) | 18176 | 568 | Ada Lovelace | GDDR6 |
| NVIDIA L40S | 48GB | 91.61 | 91.61 | 1431(GFLOPS1:64) | 18176 | 568 | Ada Lovelace | GDDR6 |
