AI Training Calculator
Estimate VRAM usage and find the best GPU configuration for your model - inference or fine-tuning.
VRAM Breakdown
21.2GB
Model Weights16.0 GB75%
KV Cache0.5 GB3%
Activations3.2 GB15%
LoRA + Optimizer0.0 GB0%
Framework Overhead1.5 GB7%
GPU Requirements
GPU
VRAM / Card
Cards Needed
Total VRAM
Utilization
Action
GPU
VRAM
Card
Utilization
GeForce RTX 4090
24 GB
1x
88%
GeForce RTX 5090
32 GB
1x
66%
RTX 6000 Ada
48 GB
1x
44%
L40S PCIe
48 GB
1x
44%
A100-SXM4-80GB
80 GB
1x
27%
H100 80GB HBM3
80 GB
1x
27%
H200 141GB HBM3e
141 GB
1x
15%
B200 180GB HBM3e
180 GB
1x
12%