Update genai_cookbook site content with new agent sample app #32
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Prithvi Kannan <prithvi.kannan@databricks.com>
prithvikannan
changed the title
Signed-off-by: Prithvi Kannan <prithvi.kannan@databricks.com>
Signed-off-by: Prithvi Kannan <prithvi.kannan@databricks.com>
prithvikannan
commented
Oct 2, 2024
There was a problem hiding this comment.
change this up since the new agent code does not provide a B_quality_iteration/ folder. instead we just advise users to edit their earlier notebooks and use mlflow to compare
prithvikannan
commented
Oct 2, 2024
There was a problem hiding this comment.
change this up since the new agent code does not provide a B_quality_iteration/ folder. instead we just advise users to edit their earlier notebooks and use mlflow to compare
prithvikannan
commented
Oct 2, 2024
| @@ -24,9 +24,8 @@ You can find all of the sample code referenced throughout this section [here](ht | |||
| 3. Unity Catalog Schema where the output Delta Tables with the parsed/chunked documents and Vector Search indexes are stored, either: | |||
| - Write access to an existing [Unity Catalog](https://docs.databricks.com/en/data-governance/unity-catalog/index.html) and [Schema](https://docs.databricks.com/en/data-governance/unity-catalog/index.html#the-unity-catalog-object-model) | |||
| - Permissions to create a new Unity Catalog and Schema - the setup Notebook will do this for you | |||
| 4. A [**single-user**](https://docs.databricks.com/en/compute/configure.html#access-modes) cluster running [DBR 14.3+](https://docs.databricks.com/en/release-notes/runtime/index.html) with access to the internet | |||
There was a problem hiding this comment.
serverless works now
aravind-segu
approved these changes
Oct 2, 2024
| @@ -66,19 +66,17 @@ As a reminder, there are 3 types of potential fixes: | |||
| --> | |||
|
|
|||
| #### Instructions | |||
| For all types, you will use the [`B_quality_iteration/02_evaluate_fixes`](https://github.com/databricks/genai-cookbook/blob/main/rag_app_sample_code/B_quality_iteration/02_evaluate_fixes.py) Notebook to evaluate the resulting chain versus your baseline configuration (at first, this is your POC) and pick a "winner". This notebook will help you pick the winning experiment and deploy it to the Review App or a production-ready, scalable REST API. | |||
| Based on which type of fix you want to make, modify the [`00_global_config`](https://github.com/databricks/genai-cookbook/blob/v0.2.0/agent_app_sample_code/00_global_config.py), [`02_data_pipeline`](https://github.com/databricks/genai-cookbook/blob/v0.2.0/agent_app_sample_code/02_data_pipeline.py), or the [`03_agent_proof_of_concept`](https://github.com/databricks/genai-cookbook/blob/v0.2.0/agent_app_sample_code/03_agent_proof_of_concept.py). Use the [`05_evaluate_poc_quality`](https://github.com/databricks/genai-cookbook/blob/v0.2.0/agent_app_sample_code/05_evaluate_poc_quality.py) notebook to evaluate the resulting chain versus your baseline configuration (at first, this is your POC) and pick a "winner". This notebook will help you pick the winning experiment and deploy it to the Review App or a production-ready, scalable REST API. | |||
|
|
|||
| 1. Open the [`B_quality_iteration/02_evaluate_fixes`](https://github.com/databricks/genai-cookbook/blob/main/rag_app_sample_code/B_quality_iteration/02_evaluate_fixes.py) Notebook | |||
There was a problem hiding this comment.
Curious here, does this notebook also work with agents?
There was a problem hiding this comment.
i think it should in theory, but we felt that it was too heavy-weight for this cookbook. we are planning to drop the whole /rag_app_sample_code folder.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Related Issues/PRs
#xxxWhat changes are proposed in this pull request?
/agent_app_sample_codeat tagv0.2.0B_quality_iterationfolder to handhold iterationHow is this PR tested?