estimate_vram
Does this LLM fit on this GPU?
GPU memory, number of GPUs, speed and rental cost to run an open LLM. Works for the models listed at https://studiotvai.com/api/models.json and any Hugging Face model id or link. Uses the real KV cache of each architecture (sliding window, hybrid linear attention, MLA).
gpumodel必填enginecontextweightskv_cachegpu_countconcurrent_requests