Skip to content
This repository has been archived by the owner on Jan 5, 2025. It is now read-only.

TO DO Updated #179

Closed
wants to merge 4 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 13 additions & 5 deletions dj_backend_server/docs/todo.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,24 +2,32 @@

TODO list of tasks to be completed.

# PDF
### PDF

- Enable the "Delete" button and display a confirmation popup to remove the file (or folder), the corresponding database record, and any related data in the Vector Database.s
- Evaluate the necessity of the "Resync on PDF" feature; consider discontinuing it if not needed.
- Implement various statuses for PDF uploads, such as "Uploaded," "Parsed," "Successful," and "Failed."
- Display error messages if the upload job fails.
- Retrieve and possibly modify data from the Vector Database for review.
- When uploading a new PDF, check if the filename already exists and whether the hash is identical; if so, skip the upload.
- If the file exists but the hash differs when uploading a new PDF, delete the old data from the Vector Database (VD) and restart the job with the new file.
- Capture errors and warnings and log them into the database.

# WEBSITE
### WEBSITE

- Implement a "Resync on Website" feature.
- Investigate why PNG or other binary files are being parsed from a website.
- If a PDF or DOC file is discovered during parsing, push it to the database via the PDF Handler.
- Implement a Smart Resync feature.
- Investigate why the sync occasionally stops and implement a restart mechanism if this occurs.
- Determine why the pages that have been crawled are not being displayed from the database.
- Capture errors and warnings and log them into the database.

# CHAT
### CHAT

- Check why have localhost inside of JS and replace programatically with real URL.

# SERVER - DOCKER
### SERVER - DOCKER

- Implement NGINX to have a possibility to add SSL.
- Implement NGINX to have a possibility to add SSL.
- Move the website_data_sources directory to an external volume to facilitate mounting on larger data storage and to ensure data persistence after system restarts.
Loading