Smoke Test: Claude - 22202834023 #16949
Description
Automated smoke test run for Claude engine. PR used for review tests: #16920 (Bump AWF default version to v0.20.2).
Test Results
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP: Review last 2 merged PRs | ✅ |
| 2 | SafeInputs GH CLI: Query 2 PRs | ✅ |
| 3 | Serena MCP: Initialize workspace + find symbols | ✅ |
| 4 | Make Build: make build |
✅ |
| 5 | Playwright: Navigate to github.com + verify title | ✅ |
| 6 | Tavily: Search "GitHub Agentic Workflows" | ✅ |
| 7 | File Writing: Create smoke test file | ✅ |
| 8 | Bash: Verify file creation | ✅ |
| 9 | Discussion Interaction: Comment on #16940 | ✅ |
| 10 | Agentic Workflows MCP: Query smoke-claude status |
✅ |
| 11 | Update PR body (#16920) | ✅ |
| 12 | PR Review Comments (2 inline comments) | ✅ |
| 13 | Submit PR Review | ✅ |
| 14 | Resolve Review Thread | |
| 15 | Add Reviewer (copilot) |
✅ |
| 16 | Push to PR Branch | ✅ |
| 17 | Close PR (conditional) |
Overall Status: PARTIAL (all non-skipped tests passed)
Test Details
Test #1 — GitHub MCP: Retrieved last 2 merged PRs via list_pull_requests. Preview showed PR #16930 (fix daily-repo-chronicle) and earlier merges per git log.
Test #2 — SafeInputs GH CLI: gh pr list --limit 2 returned PRs #16938 and #16929 (both open, copilot-swe-agent authored).
Test #3 — Serena MCP: Project activated at /home/runner/work/gh-aw/gh-aw. Found >3 symbols in cmd/gh-aw/main.go: version, isRelease, verboseFlag, bannerFlag, formatListWithOr, validateEngine, rootCmd, newCmd, main, etc.
Test #4 — Make Build: go build -ldflags "-s -w -X main.version=2d0021ba" -o gh-aw ./cmd/gh-aw succeeded.
Test #5 — Playwright: Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✅
Test #6 — Tavily: 3 results returned including githubnext.com, infoq.com, and github.com/github/gh-aw.
Test #7-8 — File Writing + Bash: /tmp/gh-aw/agent/smoke-test-claude-22202834023.txt created and verified.
Test #10 — Agentic Workflows MCP: smoke-claude: engine=claude, compiled=Yes, status=active, schedule=every 12h. Status written to /tmp/gh-aw/agent/smoke-claude-status-22202834023.txt.
Test #11 — Update PR: Appended ✨ PR Review Safe Output Test - Run 22202834023 to PR #16920 body.
Test #12 — Review Comments: 2 inline comments on pkg/constants/constants.go:390 and .changeset/patch-bump-awf-v0-20-2.md:5.
Test #13 — Submit Review: COMMENT review submitted with "💥 Automated smoke test review - all systems nominal!"
Test #14 — Resolve Thread: No unresolved review threads found on PR #16920.
Test #15 — Add Reviewer: Added copilot as reviewer.
Test #16 — Push to Branch: Committed .github/smoke-test-22202834023.md and pushed via push_to_pull_request_branch. Result: success (patch 610 bytes).
Test #17 — Close PR: Skipped — PR #16920 is the triggering PR and must not be closed.
Run URL: https://github.com/github/gh-aw/actions/runs/22202834023
Timestamp: 2026-02-19T22:35:00Z
💥 [THE END] — Illustrated by Smoke Claude for issue #16920
- expires on Feb 20, 2026, 12:42 AM UTC