kermt-pretrain-scratch
kermt-pretrain-scratch is an agent skill published by nvidia. It lives in the NVIDIA/skills repository, which has 3,735 GitHub stars and is licensed under Apache-2.0; we last read it on 2026-09-16.
Pretrains a KERMT model from scratch using a user-provided corpus, building a new vocabulary and starting with default model architecture. No initial checkpoint is loaded, and the model is randomly initialized.
Install
skills is a generic installer for any repository of Claude agent skills -- it reads NVIDIA/skills’s own structure rather than assuming one, the same way this page reads the skill’s own SKILL.md rather than assuming a format.
npx skills add NVIDIA/skills
Maintenance
Pretrain a fresh KERMT model from scratch on a user-provided corpus. Builds a new vocabulary from the corpus, instantiates the model architecture from defaults, and launches pretrain_ddp.py inside the kermt container (detached for long runs). Unlike kermt-continue-pretrain, no starting checkpoint is loaded — the model is randomly initialized.
Common questions about kermt-pretrain-scratch
- What does kermt-pretrain-scratch do?
- Pretrains a KERMT model from scratch using a user-provided corpus, building a new vocabulary and starting with default model architecture. No initial checkpoint is loaded, and the model is randomly initialized.
- How do I install kermt-pretrain-scratch?
- Run npx skills add NVIDIA/skills. The skills installer reads the repository’s own structure, so it works for any repository of agent skills.
- Who publishes kermt-pretrain-scratch?
- nvidia.
- Is kermt-pretrain-scratch maintained, and what licence does it use?
- Its repository has 3,735 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-26. The repository declares the Apache-2.0 licence.