Skip to content

Add support for LLM testing #112

@mkutz

Description

@mkutz

When testing the output of LLMs, outputs are not always deterministic and there can be multiple different, but still approved answers.
Also answers can differ on a low level (e.g. different formulations, filler words , etc.).

Maybe ApproveJ could support multiple approved values/files and allow fuzzy matching in an Approver.

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions