Jetson Llm Serve

nvidia/skills/skills/jetson-llm-serve

by nvidiacf5224d14250Apache-2.03.5K starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated today

Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

Instructions onlyDevOps & Cloud
  1. cf5224d14250Currentcommit cf5224dPublished Oct 8, 2026

Source and attribution

Source:nvidia/skillsinskills/jetson-llm-serveat commitcf5224d

License: Apache-2.0

Content belongs to its original authors. SourceWeft indexes it from a public repository.

Report or request removal