-
Notifications
You must be signed in to change notification settings - Fork 1
feat(ci): cache heavy test artifacts and compare trends #1192
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
@github-copilot review |
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
Quality Summary
|
🔍 Verification Summary
Unlinked (top 5)- Device registration publishes enough pre-keys and emits audit log (id: device-registration-publishes-enough-pre-keys-and-emits-audit-log) test:N/A impl:N/A formal:N/A - Invalid auth tag triggers audit violation for AES-GCM envelopes (id: invalid-auth-tag-triggers-audit-violation-for-aes-gcm-envelopes) test:N/A impl:N/A formal:N/A - Session rotation stays within forward secrecy thresholds (id: session-rotation-stays-within-forward-secrecy-thresholds) test:N/A impl:N/A formal:N/ALinked examples (up to 3)- Successful reservation (id: successful-reservation) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/b9988172d78022f9218ef0eda7dc4df2a7887c68/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/b9988172d78022f9218ef0eda7dc4df2a7887c68/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/b9988172d78022f9218ef0eda7dc4df2a7887c68/specs/formal/tla+/Inventory.tla) - Prevent negative stock (id: prevent-negative-stock) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/b9988172d78022f9218ef0eda7dc4df2a7887c68/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/b9988172d78022f9218ef0eda7dc4df2a7887c68/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/b9988172d78022f9218ef0eda7dc4df2a7887c68/specs/formal/tla+/Inventory.tla) - Idempotent by order id (id: idempotent-by-order-id) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/b9988172d78022f9218ef0eda7dc4df2a7887c68/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/b9988172d78022f9218ef0eda7dc4df2a7887c68/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/b9988172d78022f9218ef0eda7dc4df2a7887c68/specs/formal/tla+/Inventory.tla)Hit basis (tests/formal)- Test hits: title=3 id=0 tag=0 - Formal hits: title=0 id=3 tag=0Non-OK modules (top 5)- KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) - KvOnceImpl (log: artifacts/codex/KvOnceImpl.tlc.log.txt) - KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR adds caching and trend comparison capabilities to the CI Extended workflow, enabling reuse of heavy test artifacts (mutation/property/MBT results) during reruns and providing historical diff reporting.
Key Changes:
- Added cache restore/snapshot/store steps to
ci-extended.ymlwithsync-test-results.mjsCLI for managing.cache/test-results - Implemented
compare-test-trends.mjsto generate Markdown/JSON diff reports comparing current vs. baseline metrics, posted to Step Summary - Optimized mutation quick runs with
ignoreStatic: trueinstryker.conf.cjsand improvedrun-scoped.shto use mktemp workspaces with automatic cleanup
Reviewed Changes
Copilot reviewed 12 out of 13 changed files in this pull request and generated 1 comment.
Show a summary per file
| File | Description |
|---|---|
| tests/integration/integration-cli.test.ts | Updated test expectation to match revised error message wording |
| stryker.conf.cjs | Added eslint env/disable directives and ignoreStatic: true for faster mutation runs |
| src/cli/integration-cli.ts | Updated console message to clarify "no reports found" vs "directory missing" |
| scripts/pipelines/sync-test-results.mjs | New CLI for store/restore/snapshot/status operations on heavy test cache |
| scripts/pipelines/compare-test-trends.mjs | New script to diff baseline vs current metrics and output Markdown/JSON trend report |
| scripts/mutation/run-scoped.sh | Refactored temp file cleanup to handle directories; added mktemp workspace logic |
| docs/testing/integration-runtime-helpers.md | Added documentation for heavy test artifacts cache usage in CI Extended |
| docs/notes/issue-progress.md | Updated #1005 progress notes to reflect caching and trend comparison completion |
| docs/ci/phase2-ci-hardening-outline.md | Checked off caching/trend tasks; adjusted next action items |
| docs/ci/label-gating.md | Added guidance on cache restore/store workflow for reruns |
| docs/ci-policy.md | Extended policy documentation with cache rehydration steps and trend artifact details |
| .github/workflows/ci-extended.yml | Integrated cache restore/save, baseline snapshot, and trend comparison steps |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| mkdir -p "${STRYKER_TEMP_DIR}" | ||
| CMD+=("--tempDirName" "${STRYKER_TEMP_DIR}") | ||
| else | ||
| WORKSPACE_DIR=$(mktemp -d "${TMPDIR:-/tmp}/stryker-workspace-XXXXXX") |
Copilot
AI
Oct 28, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
[nitpick] The hardcoded fallback /tmp may not be portable across all systems. Consider using a more portable approach or documenting the assumption that /tmp exists.
| WORKSPACE_DIR=$(mktemp -d "${TMPDIR:-/tmp}/stryker-workspace-XXXXXX") | |
| # Find a suitable temp directory | |
| if [[ -n "${TMPDIR:-}" && -d "${TMPDIR}" && -w "${TMPDIR}" ]]; then | |
| TEMP_BASE="${TMPDIR}" | |
| elif [[ -n "${TEMP:-}" && -d "${TEMP}" && -w "${TEMP}" ]]; then | |
| TEMP_BASE="${TEMP}" | |
| elif [[ -n "${TMP:-}" && -d "${TMP}" && -w "${TMP}" ]]; then | |
| TEMP_BASE="${TMP}" | |
| elif [[ -d "/tmp" && -w "/tmp" ]]; then | |
| TEMP_BASE="/tmp" | |
| else | |
| echo "No suitable temporary directory found. Please set TMPDIR, TEMP, or TMP to a writable directory." >&2 | |
| exit 1 | |
| fi | |
| WORKSPACE_DIR=$(mktemp -d "${TEMP_BASE}/stryker-workspace-XXXXXX") |
Generate Artifacts PreviewGenerated at: 2025-11-05T08:34:06.914Z
|
CodeX Artifacts Summary
|
KvOnce Trace Validation
|
🔒 Security Analysis ReportSecurity Analysis ReportGenerated on: Tue Oct 28 04:43:37 UTC 2025 SBOM Summary
Component Types286 file components Licenses (top)Dependency Audit ResultsRecommendations
Generated by SBOM workflow |
|
Nightly 向けの heavy test trend アーカイブ要件を に整理しました。CI Extended follow-up の設計メモとして併せてご確認ください。 |
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
|
Nightly 向けの heavy test trend アーカイブ要件を |
🔍 Verification Summary
Unlinked (top 5)- Device registration publishes enough pre-keys and emits audit log (id: device-registration-publishes-enough-pre-keys-and-emits-audit-log) test:N/A impl:N/A formal:N/A - Invalid auth tag triggers audit violation for AES-GCM envelopes (id: invalid-auth-tag-triggers-audit-violation-for-aes-gcm-envelopes) test:N/A impl:N/A formal:N/A - Session rotation stays within forward secrecy thresholds (id: session-rotation-stays-within-forward-secrecy-thresholds) test:N/A impl:N/A formal:N/ALinked examples (up to 3)- Successful reservation (id: successful-reservation) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/844a4b69b46716aecec8c1d4f7dd9a931468461b/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/844a4b69b46716aecec8c1d4f7dd9a931468461b/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/844a4b69b46716aecec8c1d4f7dd9a931468461b/specs/formal/tla+/Inventory.tla) - Prevent negative stock (id: prevent-negative-stock) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/844a4b69b46716aecec8c1d4f7dd9a931468461b/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/844a4b69b46716aecec8c1d4f7dd9a931468461b/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/844a4b69b46716aecec8c1d4f7dd9a931468461b/specs/formal/tla+/Inventory.tla) - Idempotent by order id (id: idempotent-by-order-id) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/844a4b69b46716aecec8c1d4f7dd9a931468461b/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/844a4b69b46716aecec8c1d4f7dd9a931468461b/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/844a4b69b46716aecec8c1d4f7dd9a931468461b/specs/formal/tla+/Inventory.tla)Hit basis (tests/formal)- Test hits: title=3 id=0 tag=0 - Formal hits: title=0 id=3 tag=0Non-OK modules (top 5)- KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) - KvOnceImpl (log: artifacts/codex/KvOnceImpl.tlc.log.txt) - KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) |
CodeX Artifacts Summary
|
🔒 Security Analysis ReportSecurity Analysis ReportGenerated on: Tue Oct 28 05:24:50 UTC 2025 SBOM Summary
Component Types286 file components Licenses (top)Dependency Audit ResultsRecommendations
Generated by SBOM workflow |
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
🔍 Verification Summary
Unlinked (top 5)- Device registration publishes enough pre-keys and emits audit log (id: device-registration-publishes-enough-pre-keys-and-emits-audit-log) test:N/A impl:N/A formal:N/A - Invalid auth tag triggers audit violation for AES-GCM envelopes (id: invalid-auth-tag-triggers-audit-violation-for-aes-gcm-envelopes) test:N/A impl:N/A formal:N/A - Session rotation stays within forward secrecy thresholds (id: session-rotation-stays-within-forward-secrecy-thresholds) test:N/A impl:N/A formal:N/ALinked examples (up to 3)- Successful reservation (id: successful-reservation) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/a4f80ee1731e293dca4248f3fe9cb8327b7852e2/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/a4f80ee1731e293dca4248f3fe9cb8327b7852e2/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/a4f80ee1731e293dca4248f3fe9cb8327b7852e2/specs/formal/tla+/Inventory.tla) - Prevent negative stock (id: prevent-negative-stock) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/a4f80ee1731e293dca4248f3fe9cb8327b7852e2/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/a4f80ee1731e293dca4248f3fe9cb8327b7852e2/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/a4f80ee1731e293dca4248f3fe9cb8327b7852e2/specs/formal/tla+/Inventory.tla) - Idempotent by order id (id: idempotent-by-order-id) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/a4f80ee1731e293dca4248f3fe9cb8327b7852e2/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/a4f80ee1731e293dca4248f3fe9cb8327b7852e2/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/a4f80ee1731e293dca4248f3fe9cb8327b7852e2/specs/formal/tla+/Inventory.tla)Hit basis (tests/formal)- Test hits: title=3 id=0 tag=0 - Formal hits: title=0 id=3 tag=0Non-OK modules (top 5)- KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) - KvOnceImpl (log: artifacts/codex/KvOnceImpl.tlc.log.txt) - KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) |
CodeX Artifacts Summary
|
🔒 Security Analysis ReportSecurity Analysis ReportGenerated on: Tue Oct 28 07:15:25 UTC 2025 SBOM Summary
Component Types286 file components Licenses (top)Dependency Audit ResultsRecommendations
Generated by SBOM workflow |
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
|
🔍 Verification Summary
Unlinked (top 5)- Device registration publishes enough pre-keys and emits audit log (id: device-registration-publishes-enough-pre-keys-and-emits-audit-log) test:N/A impl:N/A formal:N/A - Invalid auth tag triggers audit violation for AES-GCM envelopes (id: invalid-auth-tag-triggers-audit-violation-for-aes-gcm-envelopes) test:N/A impl:N/A formal:N/A - Session rotation stays within forward secrecy thresholds (id: session-rotation-stays-within-forward-secrecy-thresholds) test:N/A impl:N/A formal:N/ALinked examples (up to 3)- Successful reservation (id: successful-reservation) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/5014bbd220d6cd1609da8976c062802b8cd0dacf/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/5014bbd220d6cd1609da8976c062802b8cd0dacf/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/5014bbd220d6cd1609da8976c062802b8cd0dacf/specs/formal/tla+/Inventory.tla) - Prevent negative stock (id: prevent-negative-stock) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/5014bbd220d6cd1609da8976c062802b8cd0dacf/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/5014bbd220d6cd1609da8976c062802b8cd0dacf/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/5014bbd220d6cd1609da8976c062802b8cd0dacf/specs/formal/tla+/Inventory.tla) - Idempotent by order id (id: idempotent-by-order-id) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/5014bbd220d6cd1609da8976c062802b8cd0dacf/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/5014bbd220d6cd1609da8976c062802b8cd0dacf/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/5014bbd220d6cd1609da8976c062802b8cd0dacf/specs/formal/tla+/Inventory.tla)Hit basis (tests/formal)- Test hits: title=3 id=0 tag=0 - Formal hits: title=0 id=3 tag=0Non-OK modules (top 5)- KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) - KvOnceImpl (log: artifacts/codex/KvOnceImpl.tlc.log.txt) - KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) |
CodeX Artifacts Summary
|
|
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
🔍 Verification Summary
Unlinked (top 5)- Device registration publishes enough pre-keys and emits audit log (id: device-registration-publishes-enough-pre-keys-and-emits-audit-log) test:N/A impl:N/A formal:N/A - Invalid auth tag triggers audit violation for AES-GCM envelopes (id: invalid-auth-tag-triggers-audit-violation-for-aes-gcm-envelopes) test:N/A impl:N/A formal:N/A - Session rotation stays within forward secrecy thresholds (id: session-rotation-stays-within-forward-secrecy-thresholds) test:N/A impl:N/A formal:N/ALinked examples (up to 3)- Successful reservation (id: successful-reservation) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/8aabf0c5e84e17e920ad874979c1442e56b2e590/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/8aabf0c5e84e17e920ad874979c1442e56b2e590/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/8aabf0c5e84e17e920ad874979c1442e56b2e590/specs/formal/tla+/Inventory.tla) - Prevent negative stock (id: prevent-negative-stock) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/8aabf0c5e84e17e920ad874979c1442e56b2e590/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/8aabf0c5e84e17e920ad874979c1442e56b2e590/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/8aabf0c5e84e17e920ad874979c1442e56b2e590/specs/formal/tla+/Inventory.tla) - Idempotent by order id (id: idempotent-by-order-id) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/8aabf0c5e84e17e920ad874979c1442e56b2e590/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/8aabf0c5e84e17e920ad874979c1442e56b2e590/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/8aabf0c5e84e17e920ad874979c1442e56b2e590/specs/formal/tla+/Inventory.tla)Hit basis (tests/formal)- Test hits: title=3 id=0 tag=0 - Formal hits: title=0 id=3 tag=0Non-OK modules (top 5)- KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) - KvOnceImpl (log: artifacts/codex/KvOnceImpl.tlc.log.txt) - KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) |
CodeX Artifacts Summary
|
🔒 Security Analysis ReportSecurity Analysis ReportGenerated on: Fri Oct 31 21:05:43 UTC 2025 SBOM Summary
Component Types286 file components Licenses (top)Dependency Audit ResultsRecommendations
Generated by SBOM workflow |
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
|
🔍 Verification Summary
Unlinked (top 5)- Device registration publishes enough pre-keys and emits audit log (id: device-registration-publishes-enough-pre-keys-and-emits-audit-log) test:N/A impl:N/A formal:N/A - Invalid auth tag triggers audit violation for AES-GCM envelopes (id: invalid-auth-tag-triggers-audit-violation-for-aes-gcm-envelopes) test:N/A impl:N/A formal:N/A - Session rotation stays within forward secrecy thresholds (id: session-rotation-stays-within-forward-secrecy-thresholds) test:N/A impl:N/A formal:N/ALinked examples (up to 3)- Successful reservation (id: successful-reservation) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/f0996f180827d619b713445196ab43e7ac451296/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/f0996f180827d619b713445196ab43e7ac451296/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/f0996f180827d619b713445196ab43e7ac451296/specs/formal/tla+/Inventory.tla) - Prevent negative stock (id: prevent-negative-stock) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/f0996f180827d619b713445196ab43e7ac451296/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/f0996f180827d619b713445196ab43e7ac451296/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/f0996f180827d619b713445196ab43e7ac451296/specs/formal/tla+/Inventory.tla) - Idempotent by order id (id: idempotent-by-order-id) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/f0996f180827d619b713445196ab43e7ac451296/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/f0996f180827d619b713445196ab43e7ac451296/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/f0996f180827d619b713445196ab43e7ac451296/specs/formal/tla+/Inventory.tla)Hit basis (tests/formal)- Test hits: title=3 id=0 tag=0 - Formal hits: title=0 id=3 tag=0Non-OK modules (top 5)- KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) - KvOnceImpl (log: artifacts/codex/KvOnceImpl.tlc.log.txt) - KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) |
CodeX Artifacts Summary
|
🔒 Security Analysis ReportSecurity Analysis ReportGenerated on: Wed Nov 5 01:56:50 UTC 2025 SBOM Summary
Component Types286 file components Licenses (top)Dependency Audit ResultsRecommendations
Generated by SBOM workflow |
|
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
🔍 Verification Summary
Unlinked (top 5)- Device registration publishes enough pre-keys and emits audit log (id: device-registration-publishes-enough-pre-keys-and-emits-audit-log) test:N/A impl:N/A formal:N/A - Invalid auth tag triggers audit violation for AES-GCM envelopes (id: invalid-auth-tag-triggers-audit-violation-for-aes-gcm-envelopes) test:N/A impl:N/A formal:N/A - Session rotation stays within forward secrecy thresholds (id: session-rotation-stays-within-forward-secrecy-thresholds) test:N/A impl:N/A formal:N/ALinked examples (up to 3)- Successful reservation (id: successful-reservation) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/70528d64e999b0052c8d95837e09d76c1b5e99ed/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/70528d64e999b0052c8d95837e09d76c1b5e99ed/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/70528d64e999b0052c8d95837e09d76c1b5e99ed/specs/formal/tla+/Inventory.tla) - Prevent negative stock (id: prevent-negative-stock) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/70528d64e999b0052c8d95837e09d76c1b5e99ed/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/70528d64e999b0052c8d95837e09d76c1b5e99ed/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/70528d64e999b0052c8d95837e09d76c1b5e99ed/specs/formal/tla+/Inventory.tla) - Idempotent by order id (id: idempotent-by-order-id) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/70528d64e999b0052c8d95837e09d76c1b5e99ed/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/70528d64e999b0052c8d95837e09d76c1b5e99ed/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/70528d64e999b0052c8d95837e09d76c1b5e99ed/specs/formal/tla+/Inventory.tla)Hit basis (tests/formal)- Test hits: title=3 id=0 tag=0 - Formal hits: title=0 id=3 tag=0Non-OK modules (top 5)- KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) - KvOnceImpl (log: artifacts/codex/KvOnceImpl.tlc.log.txt) - KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) |
CodeX Artifacts Summary
|
🔒 Security Analysis ReportSecurity Analysis ReportGenerated on: Wed Nov 5 01:59:56 UTC 2025 SBOM Summary
Component Types286 file components Licenses (top)Dependency Audit ResultsRecommendations
Generated by SBOM workflow |
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
|
🔍 Verification Summary
Unlinked (top 5)- Device registration publishes enough pre-keys and emits audit log (id: device-registration-publishes-enough-pre-keys-and-emits-audit-log) test:N/A impl:N/A formal:N/A - Invalid auth tag triggers audit violation for AES-GCM envelopes (id: invalid-auth-tag-triggers-audit-violation-for-aes-gcm-envelopes) test:N/A impl:N/A formal:N/A - Session rotation stays within forward secrecy thresholds (id: session-rotation-stays-within-forward-secrecy-thresholds) test:N/A impl:N/A formal:N/ALinked examples (up to 3)- Successful reservation (id: successful-reservation) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/0381d4af53b7ab5977502bf33428350c76f9ba3a/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/0381d4af53b7ab5977502bf33428350c76f9ba3a/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/0381d4af53b7ab5977502bf33428350c76f9ba3a/specs/formal/tla+/Inventory.tla) - Prevent negative stock (id: prevent-negative-stock) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/0381d4af53b7ab5977502bf33428350c76f9ba3a/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/0381d4af53b7ab5977502bf33428350c76f9ba3a/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/0381d4af53b7ab5977502bf33428350c76f9ba3a/specs/formal/tla+/Inventory.tla) - Idempotent by order id (id: idempotent-by-order-id) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/0381d4af53b7ab5977502bf33428350c76f9ba3a/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/0381d4af53b7ab5977502bf33428350c76f9ba3a/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/0381d4af53b7ab5977502bf33428350c76f9ba3a/specs/formal/tla+/Inventory.tla)Hit basis (tests/formal)- Test hits: title=3 id=0 tag=0 - Formal hits: title=0 id=3 tag=0Non-OK modules (top 5)- KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) - KvOnceImpl (log: artifacts/codex/KvOnceImpl.tlc.log.txt) - KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) |
CodeX Artifacts Summary
|
🔒 Security Analysis ReportSecurity Analysis ReportGenerated on: Wed Nov 5 02:07:30 UTC 2025 SBOM Summary
Component Types286 file components Licenses (top)Dependency Audit ResultsRecommendations
Generated by SBOM workflow |
|
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
🔍 Verification Summary
Unlinked (top 5)- Device registration publishes enough pre-keys and emits audit log (id: device-registration-publishes-enough-pre-keys-and-emits-audit-log) test:N/A impl:N/A formal:N/A - Invalid auth tag triggers audit violation for AES-GCM envelopes (id: invalid-auth-tag-triggers-audit-violation-for-aes-gcm-envelopes) test:N/A impl:N/A formal:N/A - Session rotation stays within forward secrecy thresholds (id: session-rotation-stays-within-forward-secrecy-thresholds) test:N/A impl:N/A formal:N/ALinked examples (up to 3)- Successful reservation (id: successful-reservation) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/e1370bffceb1c3c4c9cceebc58c1c86a94a18035/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/e1370bffceb1c3c4c9cceebc58c1c86a94a18035/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/e1370bffceb1c3c4c9cceebc58c1c86a94a18035/specs/formal/tla+/Inventory.tla) - Prevent negative stock (id: prevent-negative-stock) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/e1370bffceb1c3c4c9cceebc58c1c86a94a18035/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/e1370bffceb1c3c4c9cceebc58c1c86a94a18035/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/e1370bffceb1c3c4c9cceebc58c1c86a94a18035/specs/formal/tla+/Inventory.tla) - Idempotent by order id (id: idempotent-by-order-id) test: [traceability/inventory.trace.test.ts](https://github.com/itdojp/ae-framework/blob/e1370bffceb1c3c4c9cceebc58c1c86a94a18035/tests/traceability/inventory.trace.test.ts) impl: [domain/inventory.ts](https://github.com/itdojp/ae-framework/blob/e1370bffceb1c3c4c9cceebc58c1c86a94a18035/src/domain/inventory.ts) formal: [tla+/Inventory.tla](https://github.com/itdojp/ae-framework/blob/e1370bffceb1c3c4c9cceebc58c1c86a94a18035/specs/formal/tla+/Inventory.tla)Hit basis (tests/formal)- Test hits: title=3 id=0 tag=0 - Formal hits: title=0 id=3 tag=0Non-OK modules (top 5)- KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) - KvOnceImpl (log: artifacts/codex/KvOnceImpl.tlc.log.txt) - KvOnce (log: artifacts/codex/KvOnce.tlc.log.txt) - KvOnceRefinement (log: artifacts/codex/KvOnceRefinement.tlc.log.txt) |
CodeX Artifacts Summary
|
🔒 Security Analysis ReportSecurity Analysis ReportGenerated on: Wed Nov 5 08:35:34 UTC 2025 SBOM Summary
Component Types286 file components Licenses (top)Dependency Audit ResultsRecommendations
Generated by SBOM workflow |
背景
変更概要
.github/workflows/ci-extended.ymlに heavy テスト成果物の restore/snapshot/store とトレンド比較ステップを追加scripts/pipelines/sync-test-results.mjsを新規実装(store/restore/status/snapshot)scripts/pipelines/compare-test-trends.mjsを追加し、Step Summary +reports/heavy-test-trends.jsonを生成stryker.conf.cjsにignoreStaticを導入し quick ランを高速化、scripts/mutation/run-scoped.shを mktemp + 自動クリーンアップ対応docs/ci-policy.md,docs/ci/label-gating.md,docs/ci/phase2-ci-hardening-outline.md,docs/testing/integration-runtime-helpers.md,docs/notes/issue-progress.md)をキャッシュ運用に合わせて更新ログ
pnpm types:checkVITEST_POOL_STRATEGY=forks pnpm vitest run tests/integration/integration-cli.test.ts(MaxListenersExceededWarning は既存のvitest課題)node scripts/pipelines/sync-test-results.mjs --statusnode scripts/pipelines/compare-test-trends.mjspnpm lint(既存バックログにより失敗、stryker.conf.cjs の no-undef は解消済み)テスト
影響範囲
.cache/test-resultsとreports/heavy-test-trends.jsonロールバック
git revert HEADで巻き戻し可能。CI Extended ワークフロー変更が含まれるため revert 後に pipeline を再実行して影響確認する。関連Issue