Skip to content
InfratoApp
InfratoApp / Resources / Agent skills / kermt-add-cmim-pretrain

kermt-add-cmim-pretrain

kermt-add-cmim-pretrain is an agent skill published by nvidia. It lives in the NVIDIA/skills repository, which has 3,735 GitHub stars and is licensed under Apache-2.0; we last read it on 2026-09-16.

Converts a Grover_base checkpoint into a hybrid checkpoint by adding a randomly-initialized cMIM decoder and latent_dist, then continues pretraining on the user's corpus as a hybrid model. This process is equivalent to kermt-continue-pretrain with an initial checkpoint conversion step.

Install

skills is a generic installer for any repository of Claude agent skills -- it reads NVIDIA/skills’s own structure rather than assuming one, the same way this page reads the skill’s own SKILL.md rather than assuming a format.

npx skills add NVIDIA/skills

Maintenance

Stars
3735
State
listed
Licence
Apache-2.0
From the repository

Convert a grover_base checkpoint (encoder-only or encoder + vocab heads) into a hybrid checkpoint by adding a randomly-initialized cMIM decoder + latent_dist, then continue pretraining on the user's corpus as hybrid (vocab + contrast). Effectively kermt-continue-pretrain with a one-time ckpt-conversion step prepended.

Common questions about kermt-add-cmim-pretrain

What does kermt-add-cmim-pretrain do?
Converts a Grover_base checkpoint into a hybrid checkpoint by adding a randomly-initialized cMIM decoder and latent_dist, then continues pretraining on the user's corpus as a hybrid model. This process is equivalent to kermt-continue-pretrain with an initial checkpoint conversion step.
How do I install kermt-add-cmim-pretrain?
Run npx skills add NVIDIA/skills. The skills installer reads the repository’s own structure, so it works for any repository of agent skills.
Who publishes kermt-add-cmim-pretrain?
nvidia.
Is kermt-add-cmim-pretrain maintained, and what licence does it use?
Its repository has 3,735 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-26. The repository declares the Apache-2.0 licence.

Learn this on Infrato