Skip to content
This repository has been archived by the owner on Jul 18, 2024. It is now read-only.

[v 1.2] [ISSUE 493] Add RecursiveUrlLoader operator and change Cnvrg website RAG to use this operator #494

Merged
merged 5 commits into from
Dec 20, 2023
Merged

Conversation

chaojun-zhang
Copy link
Contributor

What changes were proposed in this pull request?

  1. add RecursiveURLLoader operator
  2. change cnvrg crawer to use RecursiveUrlLoader and set max_depth to 2
  3. fix elasticsearch ingestion bug

Why are the changes needed?

How was this patch tested?

UT and notebook

Copy link

Thanks for opening a pull request!

Please open an issue for this pull request on Github Issues as well.

https://github.com/intel/e2eAIOK/issues

Pull Request Name format: [${VERSION_ID}][ISSUE-${ISSUES_ID}] ${detailed message}
ex: [v1.1][ISSUE-190] Add PR to issue link

Copy link
Contributor

@xuechendi xuechendi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, audio failing issue will be fixed in dockerfile later

@xuechendi xuechendi merged commit 6ea53f5 into intel:main Dec 20, 2023
3 of 4 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants