Skip to content
InfratoApp
InfratoApp / Resources / Agent skills / tao-run-inference-service

tao-run-inference-service

tao-run-inference-service is an agent skill published by nvidia, listed under training models. It lives in the NVIDIA/skills repository, which has 3,735 GitHub stars and is licensed under Apache-2.0; we last read it on 2026-09-25.

Starts, queries, and stops a network-specific TAO inference microservice by delegating container execution to the appropriate platform. Handles container image resolution, job-payload JSON construction, and service registry interaction.

Install

skills is a generic installer for any repository of Claude agent skills -- it reads NVIDIA/skills’s own structure rather than assuming one, the same way this page reads the skill’s own SKILL.md rather than assuming a format.

npx skills add NVIDIA/skills

Maintenance

Stars
3735
State
listed
Licence
Apache-2.0
From the repository

Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container execution to the appropriate platform skill. Handles container image resolution, job-payload JSON construction, and the service registry. Use when the user wants to run inference on a TAO model checkpoint using a microservice container, deploy a TAO inference endpoint, or stop a running inference container.

tao-run-inference-service compared with similar skills

tao-run-inference-service compared with other skills for the same job, by publisher, what it does, repository stars and last update
SkillPublisherWhat it doesRepo starsLast update
tao-run-inference-service (this page)nvidiaStart, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice)…3,7352026-10-26
nemo-mbridge-mlm-bridge-training(same repository)nvidiaRun Megatron-LM (MLM) and Megatron Bridge training with mock or real data. Covers correlation testing, availa…3,7352026-10-26
nemotron-asr-finetune(same repository)nvidiaOrchestration skill for NVIDIA Nemotron Speech (Riva) / NeMo ASR domain and language adaptation. Given a goal…3,7352026-10-26
nemotron-customize(same repository)nvidiaPlan, configure, and chain repo-native Nemotron customization steps into single-step or multi-step pipelines:…3,7352026-10-26
nvflare-convert-huggingface(same repository)nvidiaConvert existing Hugging Face Transformers Trainer or TRL SFTTrainer training code into an NVFLARE federated…3,7352026-10-26
paidf-anomalygen(same repository)nvidiaFull PAIDF AnomalyGen pipeline — fine-tune on a new anomaly dataset, generate synthetic anomaly images (SDG),…3,7352026-10-26
tao-finetune-cosmos-embed(same repository)nvidiaCosmos-Embed1 video-text embedding for text-to-video retrieval, video-to-video search, semantic deduplication…3,7352026-10-26

Skills from the same repository first, then others for this job by repository stars. Figures are from each repository when we last read it.

Common questions about tao-run-inference-service

What does tao-run-inference-service do?
Starts, queries, and stops a network-specific TAO inference microservice by delegating container execution to the appropriate platform. Handles container image resolution, job-payload JSON construction, and service registry interaction.
How do I install tao-run-inference-service?
Run npx skills add NVIDIA/skills. The skills installer reads the repository’s own structure, so it works for any repository of agent skills.
Who publishes tao-run-inference-service?
nvidia.
Is tao-run-inference-service maintained, and what licence does it use?
Its repository has 3,735 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-26. The repository declares the Apache-2.0 licence.

More agent skills for training models

All training models entries →

Learn this on Infrato