jetson-llm-serve
jetson-llm-serve is an agent skill published by nvidia. It lives in the NVIDIA/skills repository, which has 3,735 GitHub stars and is licensed under Apache-2.0; we last read it on 2026-09-16.
Serves vLLM or SGLang models on Jetson devices, utilizing upstream vLLM on Thor and Orin JetPack 7.2+ and NVIDIA-AI-IOT vLLM on older Orin devices.
Install
skills is a generic installer for any repository of Claude agent skills -- it reads NVIDIA/skills’s own structure rather than assuming one, the same way this page reads the skill’s own SKILL.md rather than assuming a format.
npx skills add NVIDIA/skills
What it connects to
Unverified means a mention in the skill’s own description, not a citation. A wrong claim here costs nothing to correct and nothing to trust yet.
Maintenance
Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.
Common questions about jetson-llm-serve
- What does jetson-llm-serve do?
- Serves vLLM or SGLang models on Jetson devices, utilizing upstream vLLM on Thor and Orin JetPack 7.2+ and NVIDIA-AI-IOT vLLM on older Orin devices.
- How do I install jetson-llm-serve?
- Run npx skills add NVIDIA/skills. The skills installer reads the repository’s own structure, so it works for any repository of agent skills.
- Who publishes jetson-llm-serve?
- nvidia.
- Is jetson-llm-serve maintained, and what licence does it use?
- Its repository has 3,735 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-26. The repository declares the Apache-2.0 licence.