Smoke Test: Claude - 22284305292 #17778
Description
Summary
Smoke test run for Claude engine — §22284305292 — 2026-02-22
Overall status: PARTIAL (Serena find_symbol EOF, Test 17 skipped)
PR used for review testing: #17771 (SEC-005: Add cross-repository allowlist validation to flagged handlers)
Core Test Results (#1–10)
| # | Test | Result | Notes |
|---|---|---|---|
| 1 | GitHub MCP — last 2 merged PRs | ✅ | PR #17768 + others retrieved |
| 2 | SafeInputs GH CLI — query 2 PRs | ✅ | PRs #17771, #17770 returned |
| 3 | Serena MCP — activate_project | ✅ | Project activated successfully |
| 3 | Serena MCP — find_symbol | ❌ | EOF errors on all 3 attempts |
| 4 | Make Build | ✅ | go build succeeded |
| 5 | Playwright — github.com | ✅ | Title contains "GitHub" |
| 6 | Tavily — "GitHub Agentic Workflows" | ✅ | 3 results returned |
| 7 | File Writing | ✅ | /tmp/gh-aw/agent/smoke-test-claude-22284305292.txt |
| 8 | Bash verify | ✅ | File content confirmed |
| 9 | Discussion interaction | ✅ | Discussion #17775 found, comment added |
| 10 | Agentic Workflows MCP | ✅ | smoke-claude: active, compiled, claude engine |
PR Review Test Results (#11–17)
| # | Test | Result | Notes |
|---|---|---|---|
| 11 | Update PR body | ✅ | Appended test message |
| 12 | PR review comments (×2) | ✅ | Comments on collect_ndjson_output.cjs:248 and repo_helpers.cjs:210 |
| 13 | Submit PR review | ✅ | COMMENT review submitted |
| 14 | Resolve review thread | ✅ | Thread PRRT_kwDOPc1QR85wBPjd resolved |
| 15 | Add reviewer | ✅ | copilot added as reviewer |
| 16 | Push to PR branch | ✅ | smoke-test-push-22284305292.txt committed and pushed |
| 17 | Close PR | Skipped — no safe test PR to close |
Failure Details
Test 3 — Serena find_symbol:
All three attempts returned MCP error 0: connection closed: calling "tools/call": client is closing: EOF. The language server process appears to crash or timeout during symbol search. activate_project succeeded.
References:
💥 [THE END] — Illustrated by Smoke Claude
- expires on Feb 22, 2026, 10:13 PM UTC