Skip to content

models Fluency Evaluator

github-actions[bot] edited this page May 17, 2024 · 1 revision

Fluency-Evaluator

Overview

Score range Integer [1-5]: where 1 is bad and 5 is good
What is this metric? Measures the grammatical proficiency of a generative AI's predicted answer.
How does it work? The fluency measure assesses the extent to which the generated text conforms to grammatical rules, syntactic structures, and appropriate vocabulary usage, resulting in linguistically correct responses.
When to use it? Use it when evaluating the linguistic correctness of the AI-generated text, ensuring that it adheres to proper grammatical rules, syntactic structures, and vocabulary usage in the generated responses.
What does it need as input? Question, Generated Answer

Version: 1

Tags

Preview hiddenlayerscanned

View in Studio: https://ml.azure.com/registries/azureml/models/Fluency-Evaluator/version/1

Properties

is-promptflow: True

is-evaluator: True

show-artifact: True

_default-display-file: ./evaluator/flow/prompt.jinja2

Clone this wiki locally