Directory
Hardware
GPUs for local inference — VRAM, bandwidth, power draw, MSRP, and which published models actually fit each card.
RTX 4060 8GB
- 8.00 GB VRAM
- 272 GB/s bandwidth
- 115 W TDP
- $300 MSRP
RTX 3060 12GB
- 12.00 GB VRAM
- 360 GB/s bandwidth
- 170 W TDP
- $280 MSRP
RTX 4070 Ti Super 16GB
- 16.00 GB VRAM
- 672 GB/s bandwidth
- 285 W TDP
- $800 MSRP
RTX 4090 24GB
- 24.00 GB VRAM
- 1008 GB/s bandwidth
- 450 W TDP
- $1,800 MSRP
Used Tesla T4 16GB
- 16.00 GB VRAM
- 320 GB/s bandwidth
- 70 W TDP
- $200 MSRP