Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
configs		configs
nanodiloco		nanodiloco
scripts		scripts
.gitignore		.gitignore
.python-version		.python-version
LICENSE		LICENSE
README.md		README.md
pyproject.toml		pyproject.toml
uv.lock		uv.lock

Repository files navigation

NanoDiloco

A minimalist & hackable torch implementation of DiLoCo: Distributed Low-Communication Training of Language Models.

modal run -m scripts.train_modal::small_single_node

About

A minimalist & hackable torch implementation of DiLoCo: Distributed Low-Communication Training of Language Models.

Report repository

Releases

No releases published

Packages

Contributors

Languages

Python 100.0%