π€ awesome-semantic-segmentation
-
Updated
May 8, 2021
#
evaluation
Here are 1,266 public repositories matching this topic...
πͺ’ Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. πYC W23
open-source playground monitoring analytics evaluation self-hosted ycombinator openai gpt hacktoberfest observability large-language-models llm prompt-engineering langchain llmops llama-index prompt-management llm-evaluation llm-observability
-
Updated
Dec 23, 2024 - TypeScript
Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
testing ci evaluation ci-cd pentesting cicd vulnerability-scanners prompts evaluation-framework red-teaming rag llm prompt-engineering llmops prompt-testing llm-eval llm-evaluation llm-evaluation-framework
-
Updated
Dec 24, 2024 - TypeScript
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
-
Updated
Dec 19, 2024 - Python
Python package for the evaluation of odometry and SLAM
benchmark robotics tum mapping metrics evaluation ros slam trajectory-analysis odometry trajectory ros2 kitti euroc trajectory-evaluation
-
Updated
Dec 15, 2024 - Python
Building a modern functional compiler from first principles. (http://dev.stephendiehl.com/fun/)
compiler functional-programming book lambda-calculus evaluation type-theory type pdf-book type-checking haskel type-system functional-language hindley-milner type-inference intermediate-representation
-
Updated
Jan 11, 2021 - Haskell
Klipse is a JavaScript plugin for embedding interactive code snippets in tech blogs.
react javascript ruby python scheme clojure lua clojurescript reactjs common-lisp ocaml brainfuck evaluation prolog codemirror-editor reasonml interactive-snippets code-evaluation klipse-plugin
-
Updated
Oct 1, 2024 - HTML
SuperCLUE: δΈζιη¨ε€§ζ¨‘εη»Όεζ§εΊε | A Benchmark for Foundation Models in Chinese
-
Updated
May 23, 2024
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
python open-source qa benchmarking ops pipeline analysis optimization evaluation embeddings automl document-parser rag llm retrieval-augmented-generation llm-ops llm-evaluation rag-evaluation
-
Updated
Dec 19, 2024 - Python
End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow
audio deep-learning tensorflow paper end-to-end evaluation cnn lstm speech-recognition rnn automatic-speech-recognition feature-vector data-preprocessing phonemes timit-dataset layer-normalization rnn-encoder-decoder chinese-speech-recognition
-
Updated
Mar 24, 2023 - Python
π§ Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 π
open-source playground monitoring analytics evaluation ycombinator openai gpt large-language-models llm prompt-engineering langchain llmops llama-index prompt-management llm-evaluation llm-observability agent-monitoring llm-cost
-
Updated
Dec 22, 2024 - TypeScript
A unified evaluation framework for large language models
benchmark evaluation prompt robustness adversarial-attacks large-language-models prompt-engineering chatgpt
-
Updated
Oct 28, 2024 - Python
An open-source visual programming environment for battle-testing prompts to LLMs.
-
Updated
Dec 20, 2024 - TypeScript
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
machine-learning monitoring evaluation experimentation jailbreak-detection autoevaluation root-cause-analysis prompt-engineering llmops openai-evals llm-prompting llm-eval llm-test hallucination-detection
-
Updated
Aug 18, 2024 - Python
π€ Evaluate: A library for easily evaluating machine learning models and datasets.
-
Updated
Sep 17, 2024 - Python
Avalanche: an End-to-End Library for Continual Learning based on PyTorch.
training library framework deep-learning metrics evaluation pytorch benchmarks strategies lifelong-learning continual-learning continualai
-
Updated
Oct 29, 2024 - Python
βοΈ π π π Evaluating state of the art in AI
python angularjs docker challenge machine-learning django ai reproducible-research leaderboard evaluation artificial-intelligence ai-challenges reproducibility evalai angular7
-
Updated
Sep 10, 2024 - Python
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
tracking machine-learning real-time computer-vision robotics evaluation evaluation-metrics multi-object-tracking kitti 3d-tracking 3d-multi-object-tracking 2d-mot-evaluation 3d-mot 3d-multi kitti-3d
-
Updated
Apr 3, 2024 - Python
Improve this page
Add a description, image, and links to the evaluation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the evaluation topic, visit your repo's landing page and select "manage topics."