Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Interface with EWMS [major] #125

Open
wants to merge 193 commits into
base: main
Choose a base branch
from
Open

Interface with EWMS [major] #125

wants to merge 193 commits into from

Conversation

ric-evans
Copy link
Member

@ric-evans ric-evans commented Dec 18, 2024

NOTES
To interface with EWMS:

  • send cluster requests to ewms
    • remove clientmanager -- or set as option? removed ✔️
    • remove ewms_sidecar ✔️
    • put s3 uploader in parallel container w/ skym server ✔️
  • update backlogger
    • who waits for whom? ewms or skyd? skyd requests first, init cont. waits on mqs ✔️
    • generate pre-signed s3 url, then: ✔️
      • EWMS REQ -> (ewms -> mqs reserve -> backlog -> mqs activate) -> (condor -> taskpilot(w/ init=s3))
      • K8S JOB(3) -> (mqs waiter -> skym server+s3uploader)
  • connect skyd abort w/ ewms abort ✔️
  • update "is complete" logic ✔️
  • status tracking ✔️

@ric-evans ric-evans added the enhancement New feature or request label Dec 18, 2024
@ric-evans ric-evans self-assigned this Dec 18, 2024
@ric-evans ric-evans marked this pull request as ready for review January 29, 2025 23:28
This was referenced Jan 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant