Restore Report Links #364

AlexAxthelm · 2024-09-30T12:09:51Z

Updates test workflow to use new action to transfer files to/from Azure Blob storage for persistence.

Depends On:

Blob copy python actions#109

Closes #363

Note for reviewers: PA2024CH reports are being sent to a private blob store as of this PR (changed in #361) so only the GENERAL links work here.

github-actions · 2024-09-30T12:50:15Z

Docker build status

commit_time	git_sha	project_code	holdings_date	language	peer_group	report	summary	download_command	image
2024-10-09T18:12:24Z	`8801d19`,	GENERAL	2022Q4	EN	other	Report		`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports/rmi_pacta_2022q4_general-20241009T181514Z/EN/other/1/working_dir/50_Outputs/rmi_pacta_2022q4_general --destination rmi_pacta_2022q4_general-EN-other`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2022q4_general:20241009T181514Z`
2024-10-09T18:12:24Z	`8801d19`,	GENERAL	2023Q4	EN	other	Report		`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports/rmi_pacta_2023q4_general-20241009T181512Z/EN/other/1/working_dir/50_Outputs/rmi_pacta_2023q4_general --destination rmi_pacta_2023q4_general-EN-other`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_general:20241009T181512Z`
2024-10-09T18:12:24Z	`8801d19`,	PA2024CH	2023Q4	DE	bank	Report	Summary	`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports-private/rmi_pacta_2023q4_pa2024ch-20241009T181518Z/DE/bank/1/working_dir/50_Outputs/rmi_pacta_2023q4_pa2024ch --destination rmi_pacta_2023q4_pa2024ch-DE-bank`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_pa2024ch:20241009T181518Z`
2024-10-09T18:12:24Z	`8801d19`,	PA2024CH	2023Q4	DE	other	Report		`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports-private/rmi_pacta_2023q4_pa2024ch-20241009T181518Z/DE/other/1/working_dir/50_Outputs/rmi_pacta_2023q4_pa2024ch --destination rmi_pacta_2023q4_pa2024ch-DE-other`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_pa2024ch:20241009T181518Z`
2024-10-09T18:12:24Z	`8801d19`,	PA2024CH	2023Q4	EN	assetmanager	Report	Summary	`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports-private/rmi_pacta_2023q4_pa2024ch-20241009T181518Z/EN/assetmanager/1/working_dir/50_Outputs/rmi_pacta_2023q4_pa2024ch --destination rmi_pacta_2023q4_pa2024ch-EN-assetmanager`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_pa2024ch:20241009T181518Z`
2024-10-09T18:12:24Z	`8801d19`,	PA2024CH	2023Q4	EN	bank	Report	Summary	`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports-private/rmi_pacta_2023q4_pa2024ch-20241009T181518Z/EN/bank/1/working_dir/50_Outputs/rmi_pacta_2023q4_pa2024ch --destination rmi_pacta_2023q4_pa2024ch-EN-bank`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_pa2024ch:20241009T181518Z`
2024-10-09T18:12:24Z	`8801d19`,	PA2024CH	2023Q4	EN	insurance	Report	Summary	`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports-private/rmi_pacta_2023q4_pa2024ch-20241009T181518Z/EN/insurance/1/working_dir/50_Outputs/rmi_pacta_2023q4_pa2024ch --destination rmi_pacta_2023q4_pa2024ch-EN-insurance`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_pa2024ch:20241009T181518Z`
2024-10-09T18:12:24Z	`8801d19`,	PA2024CH	2023Q4	EN	other	Report		`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports-private/rmi_pacta_2023q4_pa2024ch-20241009T181518Z/EN/other/1/working_dir/50_Outputs/rmi_pacta_2023q4_pa2024ch --destination rmi_pacta_2023q4_pa2024ch-EN-other`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_pa2024ch:20241009T181518Z`
2024-10-09T18:12:24Z	`8801d19`,	PA2024CH	2023Q4	EN	pensionfund	Report	Summary	`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports-private/rmi_pacta_2023q4_pa2024ch-20241009T181518Z/EN/pensionfund/1/working_dir/50_Outputs/rmi_pacta_2023q4_pa2024ch --destination rmi_pacta_2023q4_pa2024ch-EN-pensionfund`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_pa2024ch:20241009T181518Z`
2024-10-09T18:12:24Z	`8801d19`,	PA2024CH	2023Q4	FR	bank	Report	Summary	`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports-private/rmi_pacta_2023q4_pa2024ch-20241009T181518Z/FR/bank/1/working_dir/50_Outputs/rmi_pacta_2023q4_pa2024ch --destination rmi_pacta_2023q4_pa2024ch-FR-bank`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_pa2024ch:20241009T181518Z`
2024-10-09T18:12:24Z	`8801d19`,	PA2024CH	2023Q4	FR	other	Report		`az storage copy --recursive --source https://pactadatadev.blob.core.windows.net/ghactions-workflow-transition-monitor-results-reports-private/rmi_pacta_2023q4_pa2024ch-20241009T181518Z/FR/other/1/working_dir/50_Outputs/rmi_pacta_2023q4_pa2024ch --destination rmi_pacta_2023q4_pa2024ch-FR-other`	`transitionmonitordockerregistry.azurecr.io/rmi_pacta_2023q4_pa2024ch:20241009T181518Z`
2024-10-09T18:12:24Z,	`8801d19`,								`"ghcr.io/rmi-pacta/workflow.transition.monitor:pr-364"`

See https://stackoverflow.com/a/78293397

jdhoffa

lgtm!

Updates to the build & Test workflow, following #364. Changes: - All Blob I/O is now handled through the new blob-copy action - References to GITHUB_ENV have been removed, using GITHUB_OUTPUT instead. (Reduces chances of overwriting a variable)

Trigger CI

49ab4e4

AlexAxthelm changed the title ~~Trigger CI~~ Restore Report Links Sep 30, 2024

AlexAxthelm added 27 commits September 30, 2024 15:09

Reduce Test suite

d4c05de

Use new az storage fs upload command

3fcbd66

Trigger CI

8b489c7

Get azcopy authenticaiton from az login

9b94288

Explicitly login with azcopy login

4e7f1e0

Authenticate with MSI + Client ID

0988daf

minimize test workflow

157d55b

Actually minimize test workflow

f09e1f1

Grant permissions

5d571f5

remove removed dep

f9f375a

Use AZCLI auth

de340b3

Add tenant ID

c19e92c

See https://stackoverflow.com/a/78293397

Install azcopy

67966c5

Explicity use azcopy, not az passthrough

78e3b86

Show path

0be1759

Use fullpath for azcopy command

93ecaa1

Logging

4a674ff

Use standard shell, not az action

4b4db36

Pass correct envvars to azcopy

7bb2e40

Use new action

bd4b56e

Show files

dbe13f7

fix: duplicate step ID

ca4cd58

Login in workflow

b6ec484

Fix: yaml indentation

8946729

Fix: yaml indentation

461bcd2

Trigger CI

642b415

Trigger CI

5c2607d

AlexAxthelm added 17 commits October 8, 2024 18:28

Overwrite existing blobs

cfefbad

Trigger CI

eeb3cad

Restore original build-pysh-private workflow

3bcfb0f

Use new upload action to upload results and reports.

12c3e12

Restore original Triggers

015233c

Trigger CI

a0e56d3

Use gh outputs, not env

96350b2

Remove handling for private report creation

2c049d1

Fix upload Path

8d2e851

Fix Report container URL

e9b31bd

DOn't append report URL to upload dir

60c0a03

Use updated action with log control

45e9cfb

Trigger CI

2744eda

Trigger CI

a16b4e7

Trigger CI

0444301

Trigger CI

47d5b16

Remove unused file

269b409

AlexAxthelm mentioned this pull request Oct 9, 2024

Blob copy python RMI-PACTA/actions#109

Merged

AlexAxthelm requested review from cjyetman and jdhoffa October 9, 2024 12:02

AlexAxthelm self-assigned this Oct 9, 2024

AlexAxthelm marked this pull request as ready for review October 9, 2024 12:03

jdhoffa previously approved these changes Oct 9, 2024

View reviewed changes

Update reference to action follow merge in that repo

8801d19

AlexAxthelm dismissed jdhoffa’s stale review via 8801d19 October 9, 2024 18:12

jdhoffa approved these changes Oct 9, 2024

View reviewed changes

AlexAxthelm merged commit e47e031 into main Oct 9, 2024
22 checks passed

AlexAxthelm deleted the ci/363-restore-report-links branch October 9, 2024 20:51

AlexAxthelm mentioned this pull request Oct 10, 2024

Updates to build & test workflow #366

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Restore Report Links #364

Restore Report Links #364

AlexAxthelm commented Sep 30, 2024 •

edited

Loading

github-actions bot commented Sep 30, 2024 •

edited

Loading

jdhoffa left a comment

Restore Report Links #364

Restore Report Links #364

Conversation

AlexAxthelm commented Sep 30, 2024 • edited Loading

github-actions bot commented Sep 30, 2024 • edited Loading

Docker build status

jdhoffa left a comment

Choose a reason for hiding this comment

AlexAxthelm commented Sep 30, 2024 •

edited

Loading

github-actions bot commented Sep 30, 2024 •

edited

Loading