All Local AI
Pick VRAM for fit estimates
gpu 24gb llm-inference

RTX 4090 24GB

Updated Sep 6, 2026

VRAM

24 GB

Bandwidth

1008 GB/s

TDP

450 W

MSRP

$1,800

Operator notes for RTX 4090 24GB are still landing. Specs and model-fit math below are live from directory data.

Models that fit on this card

Best quant that still fits the listed VRAM, from published listings only.

FP16
FP16
Qwen3-0.6B

0.8B

FP16
FP16
FP16
FP16
Qwen3-4B

4.0B

FP16
FP16
FP16
Q3_K_M
Q6_K
Q4_K_M