Skip to content
#

repository-mining

Here are 35 public repositories matching this topic...

RepoCapsule is a Python toolkit for turning GitHub, local, and other text/code sources into clean JSONL corpora for LLM pre-training, fine-tuning, or RAG. It provides structure-aware chunking, robust Unicode decoding, pluggable quality/safety screening, and optional dataset card + deduplication support.

  • Updated Dec 7, 2025
  • Python

Improve this page

Add a description, image, and links to the repository-mining topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the repository-mining topic, visit your repo's landing page and select "manage topics."

Learn more