Skip to content

Conversation

@samueljklee
Copy link
Contributor

Summary

  • Add new validate-examples recipe that automates validation of all example scripts
  • Discovers and runs all examples/[0-9][0-9]_*.py scripts
  • Runs pytest for examples/modules/router-orchestrator/ if tests exist

Features

  • skip_list parameter to skip specific examples (e.g., "12,19,20")
  • example_timeout parameter (default 300s)
  • cleanup parameter to remove generated files like is_prime.py
  • Formatted report output with failure details
  • CI-friendly exit codes (0 for pass, 1 for failure)
  • Uses parse_json: true pattern for proper JSON output handling

Usage

# Run all examples
amp recipe execute recipes/validate-examples.yaml

# Skip specific examples
amp recipe execute recipes/validate-examples.yaml --context skip_list="12,19,20"

# Custom timeout
amp recipe execute recipes/validate-examples.yaml --context example_timeout="600"

Test plan

  • Run recipe with default settings
  • Test skip_list parameter
  • Verify cleanup removes generated files
  • Check CI exit codes

🤖 Generated with Amplifier

Co-Authored-By: Amplifier 240397093+microsoft-amplifier@users.noreply.github.com

Add a new recipe that automates validation of all example scripts:
- Discovers and runs all examples/[0-9][0-9]_*.py scripts
- Runs pytest for examples/modules/router-orchestrator/ if tests exist
- Supports skip_list parameter to skip specific examples (e.g., "12,19,20")
- Configurable example_timeout (default 300s)
- Optional cleanup of generated files (is_prime.py, etc.)
- Formatted report output with failure details
- CI-friendly exit codes (0 for pass, 1 for failure)
- Uses parse_json: true pattern for proper JSON output handling

🤖 Generated with [Amplifier](https://github.com/microsoft/amplifier)

Co-Authored-By: Amplifier <240397093+microsoft-amplifier@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant