Home › Budget builds › under $500

Local LLM build under $500 — what actually fits

A tight budget buys a 12GB card (or nothing new) — does renting beat it?

Break-even calculator — enter your street price for the card & your electricity; we show hours-of-renting until renting beats buying. We deliberately ship no pre-filled market prices (no reliable dated source; policy).
Open calculator in budget mode →

What $500 maps to in hardware

Typical accelerators in this band: RTX 3060 12GB (launch-MSRP anchors, all Wikipedia, retrieved 2026-10-20: RTX 3090 $1,499 (launched 2020-09-24) · RTX 4090 $1,599 · RTX 5090 $1,999; MSRP ≠ today’s used price — that is why the box above is empty). Street prices change weekly: confirm on eBay/Amazon yourself; we link, never guess.

Models that fit this class at q4_k_m (8k context, GiB)

modelneedsmallest fit
Gemma 4 12B8.6RTX 3060 12GB
Ornith 1.5 9B6.8RTX 3060 12GB
Qwen3.5 9B6.8RTX 3060 12GB
Qwen3 8B6.8RTX 3060 12GB
Llama 3.1 8B6.6RTX 3060 12GB
Gemma 4 E4B5.6RTX 3060 12GB
LightOnOCR-3 4B3.6RTX 3060 12GB
Nemotron 3 Nano 4B3.1RTX 3060 12GB
MiniCPM5 2B2.4RTX 3060 12GB
Limite 1B Violetto1.3RTX 3060 12GB

Or skip hardware: what $500 of cloud time buys

instance$/hhours for $500
RunPod RTX 5090 32GB$0.99505
RunPod A100 80GB$1.59314
RunPod H100 SXM$3.49143

modelvram.com public table (self-stated check 2026-09-29, retrieved 2026-10-20). Partial re-verify 2026-10-20: Lambda A100 40GB $1.99/h CONFIRMED on lambda.ai/pricing (fetched directly); Lambda H100 rows ambiguous on-page ($3.99 vs $4.09 configs) → not adopted; RunPod & Vast pricing pages are JS-rendered, no extractable static figures — verify rates visually before spending.

FAQ

What can I run on a local LLM build under $500?

Roughly the 12–12GB VRAM class. That comfortably runs most 7–32B models at q4_K_M–q6_K with 8k context; see the fitted list above. Buy prices are user-entered — we don't guess market prices.

Would $500 be better spent renting cloud GPUs?

$500 buys about 505 hours of RTX 5090 (RunPod, $0.99/h) or 314 hours of A100 80GB (RunPod, $1.59/h) at the competitor-published rates we cite (check date 2026-09-29, retrieved 2026-10-20). If you need the model more than ~a few hundred hours per month, buying tends to win — use the break-even calculator.

Is a used GPU a good bet?

See used GPU break-even: MSRP anchors are sourced; street prices must be entered by you.