Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unable to see collections after upload in Qdrant SaaS #8551

Open
5 tasks done
imdevopx opened this issue Sep 19, 2024 · 3 comments
Open
5 tasks done

unable to see collections after upload in Qdrant SaaS #8551

imdevopx opened this issue Sep 19, 2024 · 3 comments
Labels
👻 feat:rag Embedding related issue, like qdrant, weaviate, milvus, vector database.

Comments

@imdevopx
Copy link

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.8.2

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

VECTOR_STORE: qdrant
QDRANT_URL:
QDRANT_API_KEY:

Create Knowlodge > Import From File > upload Markdown or CSV file. (upload successful)

Check Qdrant collections in SaaS but it's empty.. instead seems it's in my local ./volumes/app/storage

means Qdrant not in used?

✔️ Expected Behavior

After upload file it will go to Qdrant collections or i misunderstood it?

❌ Actual Behavior

Empty Qdrant Collections

@dosubot dosubot bot added the 👻 feat:rag Embedding related issue, like qdrant, weaviate, milvus, vector database. label Sep 19, 2024
Copy link

dosubot bot commented Sep 19, 2024

The issue you're experiencing with empty Qdrant collections after uploading a file in Dify version 0.8.2 is due to the create method in the QdrantVector class not calling the add_texts method if the texts list is empty. This means that if no texts are provided, no data will be added to the collection.

Here's the relevant code snippet:

def create(self, texts: list[Document], embeddings: list[list[float]], **kwargs):
    if texts:
        # get embedding vector size
        vector_size = len(embeddings[0])
        # get collection name
        collection_name = self._collection_name
        # create collection
        self.create_collection(collection_name, vector_size)

        self.add_texts(texts, embeddings, **kwargs)

In this code, the add_texts method is only called if texts is not empty. If texts is empty, the method returns without adding any data to the collection [1].

To resolve this, ensure that the texts list passed to the create method contains Document objects with the necessary page_content and metadata attributes [1][2].

To continue talking to Dosu, mention @dosu.

@Anush008
Copy link

Hey @imdevopx. I was unable to reproduce the issue and the points loaded fine for me in the Qdrant collection.

Please look for any failure messages in your Dify Docker logs.

@imdevopx
Copy link
Author

hi @Anush008 hmmm there's no error on docker logs and the .md file upload actually went successful.. i'm just confused why the .md file i uploaded was in the ./volumes/app/storage path instead on my Qdrant collections:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
👻 feat:rag Embedding related issue, like qdrant, weaviate, milvus, vector database.
Projects
None yet
Development

No branches or pull requests

2 participants