File tree Expand file tree Collapse file tree 3 files changed +6
-6
lines changed
eng/tools/ToolDescriptionEvaluator Expand file tree Collapse file tree 3 files changed +6
-6
lines changed Original file line number Diff line number Diff line change 1919 "type" : " process" ,
2020 "args" : [
2121 " build" ,
22- " ${workspaceFolder}/eng/tools/ToolDescriptionEvaluator/ToolDescriptionEvaluator.csproj" ,
22+ " ${workspaceFolder}/eng/tools/ToolDescriptionEvaluator/src/ ToolDescriptionEvaluator.csproj" ,
2323 " /property:GenerateFullPaths=true" ,
2424 " /consoleloggerparameters:NoSummary"
2525 ],
Original file line number Diff line number Diff line change @@ -284,8 +284,8 @@ dotnet format --include="tools/Azure.Mcp.Tools.Storage/**/*.cs"
284284./eng/scripts/Analyze-AOT-Compact.ps1
285285
286286# Tool description quality validation
287- pushd 'eng/tools/ToolDescriptionEvaluator'
288- dotnet run -- --validate --tool-description "Your command description" --prompt "user query"
287+ pushd 'eng/tools/ToolDescriptionEvaluator/src '
288+ dotnet run -- --validate --tool-description "Your command description" --prompt "user query" --test-single-tool 'your-tool-name'
289289popd
290290```
291291
Original file line number Diff line number Diff line change @@ -41,13 +41,13 @@ Or copy `.env.example` to `.env` and fill in your credentials.
4141
4242 ``` pwsh
4343 # For Azure MCP Server (default)
44- ./Run-ToolDescriptionEvaluator.ps1
44+ ./scripts/ Run-ToolDescriptionEvaluator.ps1
4545
4646 # For Fabric MCP Server
47- ./Run-ToolDescriptionEvaluator.ps1 -Server "Fabric"
47+ ./scripts/ Run-ToolDescriptionEvaluator.ps1 -Server "Fabric"
4848
4949 # For a specific server executable
50- ./Run-ToolDescriptionEvaluator.ps1 -ServerExe "./path/to/azmcp.exe"
50+ ./scripts/ Run-ToolDescriptionEvaluator.ps1 -ServerExe "./path/to/azmcp.exe"
5151 ```
5252
53534. Check if your tool ranks in the top 3 for the prompts (ideally #1) and with a score of at least `0.4`
You can’t perform that action at this time.
0 commit comments