Skip to content

Commit

Permalink
Update docs/evaluation/how_to_guides/compare_experiment_results.mdx
Browse files Browse the repository at this point in the history
Co-authored-by: Tanushree <87711021+tanushree-sharma@users.noreply.github.com>
  • Loading branch information
madams0013 and tanushree-sharma authored Feb 4, 2025
1 parent c8ec604 commit d27e759
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion docs/evaluation/how_to_guides/compare_experiment_results.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,10 @@ Click on the regressions or improvements buttons on the top of each column to fi

## Update baseline experiment

In order to track regressions, you need a baseline experiment against which to compare and a metric to measure.
In order to track regressions, you need to:
1. Select a baseline experiment against which to compare and a metric to measure. By default, the newest experiment is selected as the baseline.
2. Select feedback key (evaluation metric) you want to focus compare against. One will be assigned by default, but you can adjust as needed.
3. Configure whether a higher score is better for the selected feedback key. This preference will be stored.
The first experiment in your comparison will be used as the baseline by default, but you can change it from the dropdown at the top of the page.

You will also need to select which feedback key (evaluation metric) you want to focus on.
Expand Down

0 comments on commit d27e759

Please sign in to comment.