Skip to content

Commit 62e2d11

Browse files
authored
Update README.md
1 parent 0fcb4cf commit 62e2d11

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

benchmarks/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ We also briefly report the insertion times for the 2wikimultihopqa benchmark (~8
3939
|**Circlemind**| ~1.5|
4040

4141
### Run it yourself
42-
The scripts in this directory will generate and evaluate the 2wikimultihopqa datasets on a subsets of 51 and 101 queries with the same methodology as in the HippoRAG paper. In particular, we evaluate the retrieval capabilities of each method, mesauring the percentage of queries for which all the required evidence was retrieved. We preloaded the results so it is enough to run `evaluate.xx` to get the numbers. You can also run `create_dbs.xx` to regenerate the databases for the different methods.
42+
The scripts in this directory will generate and evaluate the 2wikimultihopqa datasets on a subsets of 51 and 101 queries with the same methodology as in the HippoRAG paper. In particular, we evaluate the retrieval capabilities of each method, mesauring the percentage of queries for which all the required evidence was retrieved. We preloaded the results so it is enough to run `evaluate_dbs.xx` to get the numbers. You can also run `create_dbs.xx` to regenerate the databases for the different methods.
4343
A couple of NOTES:
4444
- you will need to set an OPENAI_API_KEY;
4545
- LightRAG and GraphRAG could take a while (~1 hour) to process;

0 commit comments

Comments
 (0)