-
Notifications
You must be signed in to change notification settings - Fork 245
Closed as not planned
Labels
Description
Smoke Test Summary — Run §22289205055
Overall Status: PARTIAL (core tests all passed; some PR review tests skipped)
Timestamp: 2026-02-23T00:58 UTC
PR Used for Review Tests: #17803 "🔔 Add CI trigger token support for PR and branch pushes"
Core Tests (#1–10)
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP: Last 2 merged PRs | ✅ #17798, #17794 found |
| 2 | SafeInputs GH CLI: Query 2 PRs | ✅ #17803, #17801 returned |
| 3 | Serena MCP: activate_project + find_symbol | ✅ Project activated; main symbols found (many) |
| 4 | Make Build: safeinputs-make build |
✅ Build succeeded (d744ebd) |
| 5 | Playwright: Navigate to github.com | ✅ Title contains "GitHub" |
| 6 | Tavily: Search "GitHub Agentic Workflows" | ✅ 3 results returned |
| 7 | File Writing: Create smoke test file | ✅ /tmp/gh-aw/agent/smoke-test-claude-22289205055.txt |
| 8 | Bash: Verify file creation | ✅ cat confirmed content |
| 9 | Discussion Interaction: Get latest + add comment | ✅ Discussion #17802; comic-book comment added |
| 10 | Agentic Workflows MCP: smoke-claude status |
✅ Active, compiled, engine: claude |
PR Review Safe Output Tests (#11–17)
| # | Test | Result |
|---|---|---|
| 11 | Update PR body | ✅ Appended test message to PR #17803 |
| 12 | PR Review Comments (2) | ✅ 2 comments on changeset.lock.yml l.1170 & ci-coach.lock.yml l.1156 |
| 13 | Submit PR Review | ✅ COMMENT review submitted |
| 14 | Resolve Review Thread | |
| 15 | Add Reviewer | ✅ copilot added as reviewer |
| 16 | Push to PR Branch | main, not PR branch tt |
| 17 | Close PR (conditional) |
Test Details
Test 3 — Serena find_symbol
- Project activated at
/home/runner/work/gh-aw/gh-aw - Languages detected: go, typescript, bash
find_symbolwith patternmainreturned many results including functions inscripts/lint_error_messages.go,internal/tools/generate-action-metadata/main.go, etc.
Test 4 — Make Build Output
Syncing actions-lock.json from .github/aw to pkg/workflow/data/action_pins.json... ✓
Syncing install-gh-aw.sh to actions/setup-cli/install.sh... ✓
go build -ldflags "-s -w -X main.version=d744ebd" -o gh-aw ./cmd/gh-aw
Test 10 — Agentic Workflows Status
{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active","time_remaining":"N/A"}Triggers: pull_request (labeled: smoke), reaction: heart, schedule: every 12h, status-comment: true
References: §22289205055
💥 [THE END] — Illustrated by Smoke Claude
- expires on Feb 23, 2026, 3:02 AM UTC
Reactions are currently unavailable