Update README.md

alopatenko · Nov 17, 2024 · b6874b7 · b6874b7
1 parent ebf07f9
commit b6874b7
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/README.md b/README.md
@@ -83,6 +83,7 @@ My view on LLM Evaluation: [Deck](LLMEvaluation.pdf), and [SF Big Analytics and
 ---
 ### Evaluation Software
 - [EleutherAI LLM Evaluation Harness ](https://github.com/EleutherAI/lm-evaluation-harness)
+- Eureka, Microsoft, A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings. [github](https://github.com/microsoft/eureka-ml-insights) Sep 2024 [arxiv](https://arxiv.org/abs/2409.10566)
 - [OpenAI Evals]( https://github.com/openai/evals)
 - [ConfidentAI DeepEval](https://github.com/confident-ai/deepeval)
 - [MTEB](https://huggingface.co/spaces/mteb/leaderboard)