Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/add unstructured #32

Merged
merged 12 commits into from
Feb 14, 2024
Merged

Feat/add unstructured #32

merged 12 commits into from
Feb 14, 2024

Conversation

homanp
Copy link
Contributor

@homanp homanp commented Feb 12, 2024

What does this PR do?

Fixes #31 #30

@homanp homanp added the enhancement New feature or request label Feb 12, 2024
@homanp homanp self-assigned this Feb 12, 2024
@homanp
Copy link
Contributor Author

homanp commented Feb 12, 2024

@simjak I think we need to batch the encoder here. There are a whole lot more documents now to be encoded. Mind having a look?

homanp and others added 5 commits February 12, 2024 08:03
* feat: Embeddings pipeline improvements

* fix: Reranking

* fix: Pinecone delete

* feat: Added strategy option

* chore: Merging

* chore: Merging

* walkthrough

* chore: Merging

---------

Co-authored-by: Ismail Pelaseyed <homanp@gmail.com>
* fix: Weaviate fix

* chore: Change method name
@homanp homanp linked an issue Feb 13, 2024 that may be closed by this pull request
@homanp homanp merged commit 064dc32 into main Feb 14, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add Pydantic model for chunks. Add support for Unstructured IO
2 participants