[observability] Observability Coverage Report - 2026-02-19

[github-actions[bot]]

Executive Summary

Over the last 7 days (ending 2026-02-19), I analyzed 17 workflow runs with complete run summaries available. AWF firewall observability is mostly healthy: 15 runs had firewall enabled and 14 of those included access.log artifacts (93.3% coverage). One firewall-enabled run is missing access.log, which is a critical gap for debugging network activity.

MCP gateway observability is currently blocked: 14 runs used MCP tooling, and none of those runs included a gateway.jsonl artifact (0% coverage). While rpc-messages.jsonl is present in each of those runs, the required gateway.jsonl file is missing, so tool-level telemetry is not available in the expected format.

Key Alerts and Anomalies

🔴 Critical Issues:

• Missing access.log for PR Triage Agent run 22171130204.
• Missing gateway.jsonl for all 14 MCP-enabled runs (see list below).

⚠️ Warnings:

• Five runs have legacy log layouts without run_summary.json, so they could not be fully assessed for observability coverage.

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log)	15	14	93.3%	⚠️
MCP Gateway (gateway.jsonl)	14	0	0%	🔴

📋 Detailed Run Analysis

Firewall-Enabled Runs

Workflow	Run ID	access.log	Entries	Allowed	Blocked	Status
Workflow Health Manager - Meta-Orchestrator	22172610317	✅	101	40	61	✅
Go Fan	22172332637	✅	87	35	52	✅
Auto-Triage Issues	22171285671	✅	50	28	22	✅
PR Triage Agent	22171130204	❌	0	0	0	🔴
CLI Version Checker	22171105579	✅	116	69	47	✅
AI Moderator	22170527772	✅	8	4	4	✅
AI Moderator	22169754259	✅	5	2	3	✅
Contribution Check	22169670548	✅	17	11	6	✅
GitHub Remote MCP Authentication Test	22169428601	✅	24	12	12	✅
Copilot PR Prompt Pattern Analysis	22169264376	✅	59	24	35	✅
Smoke Temporary ID	22169157807	✅	15	10	5	✅
Agent Container Smoke Test	22169157811	✅	13	9	4	✅
Changeset Generator	22169157848	✅	163	95	68	✅
Smoke Project	22169157850	✅	17	11	6	✅
Smoke Codex	22169157885	✅	52	24	28	✅

Missing Firewall Logs (access.log)

Workflow	Run ID	Date	Link
PR Triage Agent	22171130204	2026-02-19T06:28:36Z	§22171130204

MCP-Enabled Runs

Workflow	Run ID	gateway.jsonl	Entries	Servers	Tool Calls	Errors	Status
Workflow Health Manager - Meta-Orchestrator	22172610317	❌	n/a	n/a	n/a	n/a	🔴
Go Fan	22172332637	❌	n/a	n/a	n/a	n/a	🔴
Auto-Triage Issues	22171285671	❌	n/a	n/a	n/a	n/a	🔴
CLI Version Checker	22171105579	❌	n/a	n/a	n/a	n/a	🔴
AI Moderator	22170527772	❌	n/a	n/a	n/a	n/a	🔴
AI Moderator	22169754259	❌	n/a	n/a	n/a	n/a	🔴
Contribution Check	22169670548	❌	n/a	n/a	n/a	n/a	🔴
GitHub Remote MCP Authentication Test	22169428601	❌	n/a	n/a	n/a	n/a	🔴
Copilot PR Prompt Pattern Analysis	22169264376	❌	n/a	n/a	n/a	n/a	🔴
Smoke Temporary ID	22169157807	❌	n/a	n/a	n/a	n/a	🔴
Agent Container Smoke Test	22169157811	❌	n/a	n/a	n/a	n/a	🔴
Changeset Generator	22169157848	❌	n/a	n/a	n/a	n/a	🔴
Smoke Project	22169157850	❌	n/a	n/a	n/a	n/a	🔴
Smoke Codex	22169157885	❌	n/a	n/a	n/a	n/a	🔴

Missing Gateway Logs (gateway.jsonl)

Workflow	Run ID	Date	Link
Workflow Health Manager - Meta-Orchestrator	22172610317	2026-02-19T07:30:37Z	§22172610317
Go Fan	22172332637	2026-02-19T07:19:39Z	§22172332637
Auto-Triage Issues	22171285671	2026-02-19T06:35:10Z	§22171285671
CLI Version Checker	22171105579	2026-02-19T06:27:32Z	§22171105579
AI Moderator	22170527772	2026-02-19T06:01:53Z	§22170527772
AI Moderator	22169754259	2026-02-19T05:26:44Z	§22169754259
Contribution Check	22169670548	2026-02-19T05:22:53Z	§22169670548
GitHub Remote MCP Authentication Test	22169428601	2026-02-19T05:11:10Z	§22169428601
Copilot PR Prompt Pattern Analysis	22169264376	2026-02-19T05:03:17Z	§22169264376
Smoke Temporary ID	22169157807	2026-02-19T04:58:20Z	§22169157807
Agent Container Smoke Test	22169157811	2026-02-19T04:58:20Z	§22169157811
Changeset Generator	22169157848	2026-02-19T04:58:20Z	§22169157848
Smoke Project	22169157850	2026-02-19T04:58:20Z	§22169157850
Smoke Codex	22169157885	2026-02-19T04:58:20Z	§22169157885

Log Ingestion Gaps

The following runs were downloaded with legacy layouts and do not include run_summary.json, so observability coverage could not be fully evaluated:

• run-22169157860
• run-22169157871
• run-22169938124
• run-22170204483
• run-22171220068

🔍 Telemetry Quality Analysis

Firewall Log Quality

• Total access.log entries analyzed: 727
• Allowed requests: 374
• Blocked requests: 353 (48.6%)
• Most accessed domains: - (341), api.githubcopilot.com:443 (145), api.anthropic.com:443 (98)

Gateway Log Quality

• gateway.jsonl was not found in any MCP-enabled run, so tool-level telemetry quality metrics could not be computed.
• rpc-messages.jsonl artifacts are present across MCP-enabled runs, but they do not satisfy the gateway.jsonl requirement.

Healthy Runs Summary

• Firewall coverage healthy in 14 of 15 firewall-enabled runs.
• MCP gateway coverage healthy in 0 of 14 MCP-enabled runs.

Recommended Actions

1. Restore or add gateway.jsonl export to MCP gateway artifacts for all MCP-enabled workflows.
2. Fix the PR Triage Agent workflow to ensure sandbox/firewall/logs/access.log is always captured.
3. Update log ingestion to produce run_summary.json for legacy layouts or document their exclusion from observability reporting.

📊 Historical Trends

No historical baseline available in this dataset for week-over-week comparison.

References:

• §22171130204
• §22172610317
• §22172332637

AI generated by Daily Observability Report for AWF Firewall and MCP Gateway

• expires on Feb 20, 2026, 7:55 AM UTC

[github-actions[bot]]

This discussion was automatically closed because it expired on 2026-02-20T07:55:07.554Z.

Closed by Workflow