can_i_run_it
Can I run it?
Will a given local LLM run on given hardware? Returns fit, the best quant that fits, theoretical tok/s, and real owner-measured tok/s where available.
輸入參數modelmxfp4contexttotal_bunifiedvram_gbactive_bhardwarekv_precisionbandwidth_gbps
recommend_quant
Recommend a quant
Which GGUF quantization to download for a model on given hardware: the full quant ladder with file size, max context, and tok/s for each, plus the recommended pick.
輸入參數modelmxfp4contexttotal_bunifiedvram_gbactive_bhardwarekv_precisionbandwidth_gbps
cheapest_hardware_for_model
Cheapest hardware for a model
The cheapest catalogued, buyable machine that runs a given model at Q4 with the requested context.
輸入參數modelmxfp4contexttotal_bactive_b
List the local LLM model classes the tools know about (params, dense/MoE, native context).
無需輸入參數。
list_hardware
List hardware
List the machines the tools know about (memory, bandwidth, price, buy link).
無需輸入參數。
cost_compare
Cost: buy vs rent vs API
Buy vs rent vs API cost to run a model locally: monthly/1y/3y totals, break-even months, and the energy cost per 1M tokens. Same math as /cost-calculator/.
輸入參數apikwhrenthourstdp_wtokenshardwareprice_usd
recommend_hardware
Recommend hardware
Ranked list of catalogued, buyable machines that run a model at the requested context, cheapest first, with an optional budget cap.
輸入參數modelmxfp4budgetcontexttotal_bactive_bkv_precision
get_used_gpu_prices
Used GPU prices
Current typical used-GPU prices for local-AI rigs (eBay Browse API median asking + hand-verified, monthly).
輸入參數gpu
compare_hardware
Compare hardware
Side-by-side memory, bandwidth, price, and (with a model) fit + tok/s for 2 to 4 machines.
輸入參數modelmxfp4contexttotal_bactive_bhardware必填kv_precision