Adjustments and for lab01-lab03 and script adjustments for lab04#29
Merged
madiepev merged 22 commits intoMicrosoftLearning:mainfrom Feb 27, 2026
Merged
Adjustments and for lab01-lab03 and script adjustments for lab04#29madiepev merged 22 commits intoMicrosoftLearning:mainfrom
madiepev merged 22 commits intoMicrosoftLearning:mainfrom
Conversation
…nts, and update batch test script
Add agent responses JSON, refactor Bicep resources, enable hosted age…
Try/gpt41mini
Experiment
…d optimized-concise experiments
- Changed the model used in the trail guide agent to be configurable via the MODEL_NAME environment variable, defaulting to "gpt-4.1". - Updated the dataset name in the evaluation script to "trail-guide-evaluation-dataset_2" and adjusted the dataset path accordingly.
- Removed the `agent-responses.json` file as it is no longer needed. - Updated Bicep template to deploy model deployments on the AI account. - Modified `trail_guide_agent.py` to load environment variables directly from the `.env` file. - Enhanced `evaluate_agent.py` for better error handling and logging, including clearer output for evaluation results. - Updated dataset names and paths in `evaluate_agent.py` for consistency. - Improved the structure and readability of the evaluation process in `evaluate_agent.py`. - Simplified environment variable loading in test scripts (`interact_with_agent.py` and `run_batch_tests.py`).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Updated env references for trail_guide_agent.py, run_batch_tests.py and interact_with_agent.py.
Updated instructions to add model name and agents name within double quotes.
Updated script evaluate_agent.py to create the .txt file once the evaluation is finished.
Updated the workflow to read the evaluate_results.txt directly from the repo instead of re-running the evaluation (for current testing purposes).