Jetson Speculative Decoding

nvidia/skills/skills/jetson-speculative-decoding

by nvidiacf5224d14250Apache-2.03.5K starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated today

Add EAGLE-3 or draft-model speculative decoding to a Jetson vLLM server when TPOT is the bottleneck.

Instructions onlyDevOps & Cloud

Only the file list is public. File contents are available once the skill is installed in a workspace.

PathSizeType
BENCHMARK.md3.3 KBtext/markdown
evals/evals.json6.4 KBapplication/json
skill-card.md3.6 KBtext/markdown
SKILL.md4.7 KBtext/markdown
skill.oms.sig4.5 KBtext/plain

Source and attribution

Source:nvidia/skillsinskills/jetson-speculative-decodingat commitcf5224d

License: Apache-2.0

Content belongs to its original authors. SourceWeft indexes it from a public repository.

Report or request removal