feat: advanced chunking methods#43

Merged

pingSubhajit merged 13 commits intorelease/v0.3.0from

feat/advanced-chunking-methods

Jan 26, 2026

Commits on Jan 21, 2026

feat: build architectural design for advanced chunking methods
sourabhrathourr
committed

Commits on Jan 22, 2026

feat: Implement token-based recursive chunking with `js-tiktoken` as the new default, removing word-based chunking and updating chunking configuration and documentation.
sourabhrathourr
committed
feat: Introduce pluggable chunker plugins including semantic, code, agentic, markdown, and hierarchical methods with CLI support.
sourabhrathourr
committed
chore: update .gitignore
sourabhrathourr
committed
lint: fix linter issues
sourabhrathourr
committed
feat: update chunking docs and add chunkers in install wizard
sourabhrathourr
committed
lint: fix linter issues
sourabhrathourr
committed
docs: update agent skills to introduce new chunking methods
sourabhrathourr
committed