Smoke Test: Claude - 22467921105 #18600
Description
Test Results — Run §22467921105
Overall Status: PARTIAL (tests 16–17 skipped; all others passed)
PR used for review tests: #18592 (Fix "Copilot is not a user" error in compute_text.cjs)
Timestamp: 2026-02-27T00:58 UTC
Core Tests
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP — last 2 merged PRs (#18594, #18581) | ✅ |
| 2 | Safe Inputs GH CLI — pr list --limit 2 |
✅ |
| 3 | Serena MCP — activate project + find_symbol (11+ matches) | ✅ |
| 4 | Make Build — make build succeeded |
✅ |
| 5 | Playwright — github.com title contains "GitHub" | ✅ |
| 6 | Tavily Web Search — "GitHub Agentic Workflows" (3 results) | ✅ |
| 7 | File Writing — /tmp/gh-aw/agent/smoke-test-claude-22467921105.txt |
✅ |
| 8 | Bash Tool — file contents verified via cat | ✅ |
| 9 | Discussion Interaction — comment added to discussion #18595 | ✅ |
| 10 | Agentic Workflows MCP — smoke-claude: active, compiled=Yes | ✅ |
PR Review Tests (PR #18592)
| # | Test | Result |
|---|---|---|
| 11 | Update PR body (append) | ✅ |
| 12 | Create 2 PR review comments | ✅ |
| 13 | Submit PR review (COMMENT) | ✅ |
| 14 | Resolve review thread (PRRT_kwDOPc1QR85xE1tw) | ✅ |
| 15 | Add reviewer (copilot) | ✅ |
| 16 | Push to PR branch | main, not a PR branch |
| 17 | Close PR |
Details
- Merged PRs found: Add pre-filled PAT creation link for COPILOT_GITHUB_TOKEN to docs #18594 "Add pre-filled PAT creation link for COPILOT_GITHUB_TOKEN to docs", Get correct base branch for pull request comments #18581 "Get correct base branch for pull request comments"
- Open PRs found: fix: use gh pr checkout for fork PRs in pull_request events #18591, Fix "Copilot is not a user" error in compute_text.cjs for app-created PRs #18592, feat: add guard policies support #18589
- Serena symbols: 11 symbols matching "workflow" found across Go package and JS files
- Build output:
go build -ldflags "-s -w -X main.version=b42ace5" -o gh-aw ./cmd/gh-aw✓ - Playwright page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
- Discussion queried: [Auto-Triage] Auto-Triage Report — 2026-02-27 #18595 — [Auto-Triage] Auto-Triage Report — 2026-02-27
- Agentic workflow status:
smoke-claudeactive, compiled=Yes, triggers: PR labelsmoke, reactionheart, schedule every 12h - Smoke-claude status file:
/tmp/gh-aw/agent/smoke-claude-status-22467921105.txt✓
References:
💥 [THE END] — Illustrated by Smoke Claude
- expires on Feb 27, 2026, 3:01 AM UTC