Smoke Test: Claude - 22406871179 #18384
Description
Automated smoke test results for Claude engine - Run §22406871179
Date: 2026-02-25 | PR Tested: #18368 (Add max-continuations field to agentic engine configuration)
Test Results
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP - Last 2 merged PRs (#18369, #18364) | ✅ |
| 2 | safeinputs-gh CLI - List 2 open PRs (#18380, #18378) | ✅ |
| 3 | Serena MCP - activate_project + find_symbol (9 symbols) | ✅ |
| 4 | Make build | ✅ |
| 5 | Playwright - github.com title contains "GitHub" | ✅ |
| 6 | Tavily search - "GitHub Agentic Workflows" (3 results) | ✅ |
| 7 | File creation - /tmp/gh-aw/agent/smoke-test-claude-22406871179.txt |
✅ |
| 8 | Bash tool - file verification via cat | ✅ |
| 9 | Discussion query - found #18381, added comic-book comment | ✅ |
| 10 | Agentic Workflows MCP - smoke-claude status: active | ✅ |
| 11 | Update PR body (append test message) | ✅ |
| 12 | PR review comments (2 inline comments) | ✅ |
| 13 | Submit PR review (COMMENT event) | ✅ |
| 14 | Resolve review thread (PRRT_kwDOPc1QR85wuoNm) | ✅ |
| 15 | Add reviewer (copilot) | ✅ |
| 16 | Push to PR branch (smoke-test-22406871179.txt) | ✅ |
| 17 | Close PR |
Overall Status: PARTIAL (all non-skipped tests passed, #17 skipped by design)
Details
Test #1 - GitHub MCP Merged PRs
- PR Improve test coverage and structure for pkg/parser/import_cache_test.go #18369: "Improve test coverage and structure for pkg/parser/import_cache_test.go" (merged 2026-02-25T16:34:49Z)
- PR fix(scout): normalize report headers to h3 and bold summary tags #18364: "fix(scout): normalize report headers to h3 and bold summary tags" (merged 2026-02-25T15:07:13Z)
Test #3 - Serena MCP
Project activated at /home/runner/work/gh-aw/gh-aw (go, typescript, bash). Found 9 symbols matching "Engine": Interface in agentic_engine.go, fields in frontmatter_types.go, engine.go, logs_report.go, engine_secrets.go, interactive.go, etc.
Test #4 - Make Build
make build
Syncing actions-lock.json from .github/aw to pkg/workflow/data/action_pins.json...
✓ Action pins synced successfully
go build -ldflags "-s -w -X main.version=856778c3" -o gh-aw ./cmd/gh-aw
Test #10 - Agentic Workflows Status
[{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active","on":{"pull_request":{"names":["smoke"],"types":["labeled"]},"reaction":"heart","schedule":"every 12h"}}]References: §22406871179
💥 [THE END] — Illustrated by Smoke Claude
- expires on Feb 25, 2026, 7:03 PM UTC