Skip to content

Commit 1ec718c

Browse files
[edit] validation sets
1 parent cef7bc8 commit 1ec718c

File tree

1 file changed

+9
-3
lines changed

1 file changed

+9
-3
lines changed

gradproject.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -353,9 +353,15 @@ Please submit two CSV files named `test_images_flooding-fire_predictions.csv`, a
353353

354354
#### **Topic 2 (NLP)**
355355

356-
<!-- NEEDS CHANGING -->
357-
358-
Here are the test sets for both tasks - `arena-validation-set-prompt-only.jsonl.gz`, `arena-validation-set-prompts-embeddings.npy`, and `arena-validation-set-topic-modeling.jsonl.gz`; all files are located in `data100-shared-readwrite/fa24_grad_project_data/nlp-chatbot-analysis_data` directory on Data 100 Datahub.
356+
Here are the test sets for both tasks:
357+
`arena-validation-set-prompt-and-responses.jsonl.gz`
358+
`arena-validation-set-prompts-embeddings.npy`
359+
`arena-validation-set-model_a_response-embeddings.npy`
360+
`arena-validation-set-model_b_response-embeddings.npy`
361+
`arena-validation-set-topic-modeling.jsonl.gz`
362+
All files are located in the `./validation-set` directory on Data 100 Datahub.
363+
364+
<!-- Here are the test sets for both tasks - `arena-validation-set-prompt-only.jsonl.gz`, `arena-validation-set-prompts-embeddings.npy`, and `arena-validation-set-topic-modeling.jsonl.gz`; all files are located in `data100-shared-readwrite/fa24_grad_project_data/nlp-chatbot-analysis_data` directory on Data 100 Datahub. -->
359365

360366
Submit a single CSV file with three columns named `question_id`, `winner`, `hardness_score` to the relevant<!-- [this](https://www.gradescope.com/courses/696886/assignments/4364990){:target="_blank"} --> Gradescope assignment.
361367

0 commit comments

Comments
 (0)