Skip to content

Commit a1a6fd6

Browse files
committed
excluded calculating with the first 200 papers
1 parent 6d88c7c commit a1a6fd6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/prompt_systematic_review/experiments/evaluate_human_agreement.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ def evaluate_human_agreement(inputFile="arxiv_papers_with_abstract.csv"):
4444
df["title"] = df["title"].apply(lambda x: process_paper_title(x))
4545

4646
# df = df.iloc[400:800]
47-
df_limited = df.copy() # .iloc[400:800]
47+
df_limited = df.copy().iloc[200:]
4848
df_limited["human_review"] = ~df_limited["title"].isin(blacklist["title"])
4949
keepables = ["highly relevant", "somewhat relevant", "neutral"]
5050

0 commit comments

Comments
 (0)