Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.

LLM Prompt Test helps you test Large Language Models (LLMs) prompts to ensure they consistently meet your expectations.

The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

prompt-testing

Sample implementation demonstrating how to use Firebase Genkit with Promptfoo

Sample project demonstrates how to use Promptfoo, a test framework for evaluating the output of generative AI models

Community Plugin for Genkit to use Promptfoo

A collection of prompts that I use on a day-to-day basis for work and leisure.