ailocalinference

Desk-side LLM iron

Pick a model, see which desk-side machines can actually hold it and how fast they decode. Throughput is derived from memory bandwidth and compute, not typed in by hand — the formula is published and applied identically to all 17 machines. Click a column header to sort.

Prices captured Aug 31, 2026

Machines that fit 18B active / 320 GB2 of 17
Cheapest that fitsMac Studio M3 Ultra · $9,499
Fastest decode that fitsMac Studio M5 Ultra · 28 t/s
Best $ per t/s ♛ crowned belowMac Studio M5 Ultra · $482
MachinePriceMemoryBW GB/sPrefill t/sDecode t/s ↓Batched t/st/s per 100WFits$ per t/sdBABuy
GPU only · GDDR7 · $8.5k launch, $15,499 on Amazon today
$15,499
$161/GB
96 GB
~88 usable
1.8k1.2k422187No—45
GPU only · median street $4.4–4.7k vs $1,999 MSRP
$4,400
$138/GB
32 GB
~29 usable
1.8k1.0k422187.3No—45
Complete box · $5,499/96GB · $9,499/256GB · 512GB late Oct, price TBD (~$13.5k est)
$13,500
$26/GB
512 GB
~384 usable
1.2k2502814610.4Yes$48235
GPU only · new $3.5k on Amazon, used ~$2.4k
$3,499
$146/GB
24 GB
~22 usable
1.0k807241255.3No—45
GPU only · new $1.46k on Amazon, used ~$800
$1,460
$61/GB
24 GB
~22 usable
960169221106.2No—45
GPU only · 48GB, blower, ROCm
$3,899
$81/GB
48 GB
~44 usable
864169201046.8No—40
Complete box · 512GB config, now prior-gen
$9,499
$19/GB
512 GB
~384 usable
81911719788.6Yes$50040
GPU only · 32GB workstation card
$1,700
$53/GB
32 GB
~29 usable
64013315785No—40
Laptop · 16-inch, high memory config
$4,500
$35/GB
128 GB
~96 usable
614125147310.8No—45
Add-in card · immature software stack
$1,400
$58/GB
24 GB
~22 usable
57616713684.3No—50
Add-in card · immature software stack
$1,399
$44/GB
32 GB
~29 usable
51227812624No—50
GPU only · 32GB Xe2-HPG workstation card
$1,300
$41/GB
32 GB
~29 usable
4566711455.8No—45
GPU only · 24GB — cheapest capacity per dollar here
$650
$27/GB
24 GB
~22 usable
4565611389.2No—45
Laptop · 18-core CPU / 20-core GPU config
$2,760
$43/GB
64 GB
~48 usable
307637367.8No—45
Complete box · $2,999 announced, $5,199 on Amazon (4TB)
$5,199
$41/GB
128 GB
~118 usable
273866314.3No—35
Complete box · same GB10 superchip as DGX Spark, $1.2k less
$3,999
$31/GB
128 GB
~118 usable
273866314.3No—35
Complete box · 48GB/512GB, the config Amazon stocks
$2,199
$46/GB
48 GB
~36 usable
273336227.5No—30

Reading the table

Decode t/sSingle-stream generation — the speed you feel. Memory-bandwidth-bound, so it tracks GB/s far more than TFLOPS.
Prefill t/sPrompt processing. Compute-bound, and heavily dependent on how mature the vendor's software stack is.
FitsWhether the weights plus KV-cache headroom clear usable memory. A "No" means the model will not load, whatever the other columns say.
$ per t/sPrice divided by decode speed — the honest value column. ♛ marks the lowest of any machine that fits the selected model.