Smoke Test: Claude - 22330477648 #18004
Description
Summary
Overall Status: PARTIAL (Serena find_symbol unavailable via MCP; test #17 skipped)
PR used for review testing: #17983 (copilot/add-dependabot-permission-checks)
Run: §22330477648 · 2026-02-24
Core Test Results
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP: Last 2 merged PRs | ✅ #17999, #17996 |
| 2 | Safe Inputs GH CLI: Query 2 PRs | ✅ #17997, #17986 |
| 3 | Serena MCP: activate_project + find_symbol | |
| 4 | Make Build | ✅ go build succeeded |
| 5 | Playwright: GitHub page title | ✅ "GitHub · Change is constant..." |
| 6 | Tavily Web Search | ✅ 3 results for "GitHub Agentic Workflows" |
| 7 | File Writing: smoke test file | ✅ /tmp/gh-aw/agent/smoke-test-claude-22330477648.txt |
| 8 | Bash Tool: verify file | ✅ cat confirmed contents |
| 9 | Discussion Interaction: #17998 | ✅ comment added |
| 10 | Agentic Workflows MCP: smoke-claude status | ✅ active, compiled |
PR Review Test Results (#17983)
| # | Test | Result |
|---|---|---|
| 11 | Update PR body | ✅ appended test marker |
| 12 | PR Review Comments (2) | ✅ on smoke-codex.md:15 and compiler_activation_jobs.go:943 |
| 13 | Submit PR Review | ✅ COMMENT submitted |
| 14 | Resolve Review Thread | ✅ PRRT_kwDOPc1QR85wQwD6 resolved |
| 15 | Add Reviewer | ✅ copilot added |
| 16 | Push to PR Branch | ✅ smoke-test-22330477648.txt pushed |
| 17 | Close PR |
Test #3 Error Detail
mcp__serena__find_symbol and mcp__serena__get_symbols_overview both returned:
MCP error 0: connection closed: calling "tools/call": client is closing: EOF
activate_project succeeded. The LSP-backed symbol search tools encountered repeated EOF disconnects.
Test #10 Detail
[{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active",
"time_remaining":"N/A","on":{"pull_request":{"names":["smoke"],"types":["labeled"]},
"reaction":"heart","schedule":"every 12h","status-comment":true}}]💥 [THE END] — Illustrated by Smoke Claude
- expires on Feb 24, 2026, 2:18 AM UTC