Skip to content
This repository has been archived by the owner on Sep 13, 2023. It is now read-only.

Commit

Permalink
Cleaned notebooks removing the stored output
Browse files Browse the repository at this point in the history
  • Loading branch information
Swiftyos committed Sep 4, 2023
1 parent b9be0f7 commit 009eeeb
Show file tree
Hide file tree
Showing 4 changed files with 71 additions and 1,004 deletions.
42 changes: 11 additions & 31 deletions benchmark/notebooks/LLM Score Experimentation.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "code",
"execution_count": 28,
"execution_count": null,
"id": "15386da8",
"metadata": {},
"outputs": [],
Expand All @@ -28,7 +28,7 @@
},
{
"cell_type": "code",
"execution_count": 18,
"execution_count": null,
"id": "e9d1c3a6",
"metadata": {},
"outputs": [],
Expand Down Expand Up @@ -96,7 +96,7 @@
},
{
"cell_type": "code",
"execution_count": 19,
"execution_count": null,
"id": "8ff9cd33",
"metadata": {},
"outputs": [],
Expand All @@ -123,7 +123,7 @@
},
{
"cell_type": "code",
"execution_count": 20,
"execution_count": null,
"id": "d0bfdce5",
"metadata": {},
"outputs": [],
Expand Down Expand Up @@ -203,7 +203,7 @@
},
{
"cell_type": "code",
"execution_count": 75,
"execution_count": null,
"id": "3de1d6d4",
"metadata": {},
"outputs": [],
Expand Down Expand Up @@ -276,7 +276,7 @@
},
{
"cell_type": "code",
"execution_count": 1,
"execution_count": null,
"id": "a5bf2f5c",
"metadata": {},
"outputs": [],
Expand All @@ -288,7 +288,7 @@
},
{
"cell_type": "code",
"execution_count": 82,
"execution_count": null,
"id": "1cd01a4c",
"metadata": {},
"outputs": [],
Expand All @@ -300,20 +300,10 @@
},
{
"cell_type": "code",
"execution_count": 72,
"execution_count": null,
"id": "72e6ac91",
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"REFERENCE: 66.5 6.0 0.0\n",
"RUBRIC: 65.0 4.0 0.0\n",
"QUESTION: 87.0 6.5 0.0\n"
]
}
],
"outputs": [],
"source": [
"# response3 - the worst one\n",
"print('REFERENCE:', reference_response_percentage, reference_response_scale, reference_response_binary)\n",
Expand All @@ -323,20 +313,10 @@
},
{
"cell_type": "code",
"execution_count": 83,
"execution_count": null,
"id": "a66014ee",
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"REFERENCE: 100.0 10.0 1.0\n",
"RUBRIC: 88.0 7.5 1.0\n",
"QUESTION: 87.0 7.5 1.0\n"
]
}
],
"outputs": [],
"source": [
"# reference_response - the best one\n",
"print('REFERENCE:', reference_response_ideal_percentage, reference_response_ideal_scale, reference_response_ideal_binary)\n",
Expand Down
86 changes: 15 additions & 71 deletions benchmark/notebooks/Visualization.ipynb

Large diffs are not rendered by default.

Loading

0 comments on commit 009eeeb

Please sign in to comment.