Smoke Test: Claude - 22486642790 #18674
Description
Summary
Smoke test run for Claude engine — validating all MCP tools, safe outputs, and GitHub integrations.
Overall Status: PARTIAL (PR review push skipped - handled via push_to_pull_request_branch tool instead)
Run: §22486642790
Timestamp: 2026-02-27T12:45–12:50 UTC
PR used for review tests: #18670 (Reduce token consumption in Duplicate Code Detector workflow)
Core Test Results (#1–10)
| # | Test | Status | Notes |
|---|---|---|---|
| 1 | GitHub MCP Testing | ✅ | Last 2 merged PRs: #18662, #18629 |
| 2 | safeinputs-gh CLI | ✅ | Returned PRs #18671, #18670 |
| 3 | Serena MCP (activate + find_symbol) | ✅ | Activated project; 15+ symbols found in cmd/gh-aw/main.go (version, isRelease, formatListWithOr, validateEngine, rootCmd, newCmd, etc.) |
| 4 | Make Build | ✅ | go build succeeded, binary built |
| 5 | Playwright | ✅ | Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" |
| 6 | Tavily Web Search | ✅ | 3 results returned for "GitHub Agentic Workflows" |
| 7 | File Writing | ✅ | /tmp/gh-aw/agent/smoke-test-claude-22486642790.txt created |
| 8 | Bash Tool | ✅ | File contents verified: "Smoke test passed for Claude at 2026-02-27T12:45:00Z" |
| 9 | Discussion Interaction | ✅ | Discussion #18668 found; comic-book comment added |
| 10 | Agentic Workflows MCP | ✅ | smoke-claude: active, compiled, triggers on PR/reaction/schedule |
Test #10 Details — Agentic Workflows Status
[{
"workflow": "smoke-claude",
"engine_id": "claude",
"compiled": "Yes",
"status": "active",
"time_remaining": "N/A",
"on": {
"pull_request": {"names": ["smoke"], "types": ["labeled"]},
"reaction": "heart",
"schedule": "every 12h",
"status-comment": true
}
}]Status file: /tmp/gh-aw/agent/smoke-claude-status-22486642790.txt ✅
PR Review Safe Output Tests (#11–17)
Using PR #18670 ("Reduce token consumption in Duplicate Code Detector workflow")
| # | Test | Status | Notes |
|---|---|---|---|
| 11 | Update PR Body | ✅ | Appended test message to PR #18670 |
| 12 | PR Review Comments | ✅ | 2 inline review comments added on PR #18670 |
| 13 | Submit PR Review | ✅ | COMMENT review submitted on PR #18670 |
| 14 | Resolve Review Thread | Skipped — no existing review threads on PR #18670 | |
| 15 | Add Reviewer | ✅ | Added copilot reviewer to PR #18670 |
| 16 | Push to PR Branch | ✅ | Checked out copilot/reduce-token-consumption-issue, committed smoke test file, used push_to_pull_request_branch |
| 17 | Close PR | Skipped — no safe test PR to close |
References
💥 [THE END] — Illustrated by Smoke Claude
- expires on Feb 27, 2026, 2:52 PM UTC