Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Librechat RAG errors #36

Open
FrantaNautilus opened this issue Sep 28, 2024 · 0 comments
Open

Librechat RAG errors #36

FrantaNautilus opened this issue Sep 28, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@FrantaNautilus
Copy link

When I tried to submit a document to Librechat, I encountered error. harbor logs librechat gives the following output:

WARN[0000] The "HARBOR_WHISPER_VERSION" variable is not set. Defaulting to a blank string. 
WARN[0000] The "HARBOR_WHISPER_HOST_PORT" variable is not set. Defaulting to a blank string. 
harbor.librechat  | }
harbor.librechat  | 2024-09-28 17:21:06 info: [deleteNullOrEmptyConversations] Deleted 0 conversations and 0 messages
harbor.librechat  | 2024-09-28 17:21:11 warn: RAG API is either not running or not reachable at http://lc-rag:33892, you may experience errors with file uploads.
harbor.librechat  | 2024-09-28 17:21:11 info: No changes needed for 'USER' role permissions
harbor.librechat  | 2024-09-28 17:21:11 info: No changes needed for 'ADMIN' role permissions
harbor.librechat  | 2024-09-28 17:21:11 info: 
harbor.librechat  | Outdated Config version: 1.1.5
harbor.librechat  | Latest version: 1.1.7
harbor.librechat  | 
harbor.librechat  |       Check out the Config changelogs for the latest options and features added.
harbor.librechat  | 
harbor.librechat  |       https://www.librechat.ai/changelog
harbor.librechat  | 
harbor.librechat  | 
harbor.librechat  | 2024-09-28 17:21:11 info: Server listening on all interfaces at port 33891. Use http://localhost:33891 to access it
harbor.librechat  | 2024-09-28 17:21:50 error: Failed to fetch models from SGLang API
harbor.librechat  | The request either timed out or was unsuccessful. Error message:
harbor.librechat  |  Cannot read properties of undefined (reading 'status')
harbor.librechat  | 2024-09-28 17:21:59 error: Error embedding file Cannot read properties of undefined (reading 'status')
harbor.librechat  | 2024-09-28 17:21:59 error: [/files] Error processing file: Cannot read properties of undefined (reading 'status')

and looking into logs of the RAG container with I am getting:

Traceback (most recent call last):
  File "/app/main.py", line 46, in <module>
    from psql import PSQLDatabase, ensure_custom_id_index_on_embedding, pg_health_check
  File "/app/psql.py", line 3, in <module>
    from config import DSN, logger
  File "/app/config.py", line 5, in <module>
    import boto3
ModuleNotFoundError: No module named 'boto3'

This problem persists even after manual removal of containers and images and complete "reinstall" of Librechat using harbor. The problem seams to be caused by the RAG container, but I could not find if it is caused by the upstream image or configuration.


I am running harbor version 1.35, on Bluefin DX (Fedora Silverblue 40).

@av av added the bug Something isn't working label Sep 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants