-
Notifications
You must be signed in to change notification settings - Fork 736
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Document BatchingStrategy and enhance TokenCountBatching
This commit adds comprehensive documentation for the BatchingStrategy in vector stores and enhances the TokenCountBatchingStrategy class. Key changes: - Explain batching necessity due to embedding model thresholds - Describe BatchingStrategy interface and its purpose - Detail TokenCountBatchingStrategy default implementation - Provide guidance on using and customizing batching strategies - Note pre-configured vector stores with default strategy - Add new constructor for custom TokenCountEstimator in TokenCountBatchingStrategy - Implement null checks with Spring's Assert utility - Update docs with new customization options and code examples
- Loading branch information
1 parent
e29d38d
commit 4c8a6ee
Showing
2 changed files
with
131 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters