Skip to content
This repository has been archived by the owner on Mar 29, 2024. It is now read-only.

[sync-recent-releases.sh] Populate archives.jenkins.io as mirror fallback #13

Merged
merged 4 commits into from
Mar 6, 2024

Conversation

dduportal
Copy link
Contributor

@dduportal dduportal commented Mar 6, 2024

As per jenkins-infra/helpdesk#3828 (comment), the download mirror fallback system was changed to use archives.jenkins.io.

This creates cases when, during a few minutes, a given file is advertised in the mirror system (because already copied by blobxfer) but not yet available in archives.jenkins.io. This is a blocker for security advisories.

This PR is a quick fix to ensure the blocker is removed: it ensures that the scripts syncs archives.jenkins.io once the bits are delivered on OSUOSL. It must be run as second because the source is OSUOSL.

The impact on the execution time varies from 25s to 2m20 based on our history: this will be greatly optimized in the future with 2 mains elements:

@dduportal dduportal marked this pull request as ready for review March 6, 2024 14:16
@daniel-beck
Copy link
Contributor

Note that to a degree it is also a problem during regular use, as the update site advertises plugins that may fail to download. So far, this has been in the range of seconds, but given how frequently the most actively maintained popular plugins release these days, times how long between announcement in JSON and availability, this could be a problem for administrators just periodically updating their plugins.

sync-recent-releases.sh Outdated Show resolved Hide resolved
sync-recent-releases.sh Outdated Show resolved Hide resolved
@dduportal
Copy link
Contributor Author

Note that to a degree it is also a problem during regular use, as the update site advertises plugins that may fail to download. So far, this has been in the range of seconds, but given how frequently the most actively maintained popular plugins release these days, times how long between announcement in JSON and availability, this could be a problem for administrators just periodically updating their plugins.

Absolutely. We (Jenkins infra team) are going to open an issue and track this subject as priority for March, as it has already created weird behavior during core releases (packages phase: not blocking, nothing unsafe, but annoyance)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants