Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Draft: Arc runner computeenv #16750

Draft
wants to merge 26 commits into
base: dev
Choose a base branch
from
Draft

Draft: Arc runner computeenv #16750

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
3c2c67f
Update conditional-requirements.txt
maikenp Sep 1, 2023
54770d1
Update __init__.py
maikenp Sep 1, 2023
bffcef8
explicitly document default of multiple
bernt-matthias Aug 31, 2023
7b8f5b6
Merge remote-tracking branch 'upstream/dev' into dev
Sep 6, 2023
1dc557e
Adding new job runner - the ARC job runner
Sep 6, 2023
46a53a4
Merge branch 'pyarcrest-dep' into arc_job_runner
Sep 6, 2023
729c275
Update conditional-requirements.txt
maikenp Sep 7, 2023
3a29632
Reusable abstractions for dealing with pyarcrest. Applying https://gi…
Sep 8, 2023
75c07fd
Refactor XML parsing out of middle of arc job runner. Applying patch …
Sep 8, 2023
63d5002
Remove unused imports in arc runner. Applied patch from jmchilton htt…
Sep 8, 2023
c30b651
Fixed one job description omission related to executable. Removed une…
Sep 8, 2023
2a07bbc
linting
Sep 8, 2023
7c8f1fd
More linting
Sep 8, 2023
b6acefb
Refactored to remove need for internal job id mapping.
Sep 11, 2023
91a20f3
Refactoring and simplification. Especially for the ARC job descriptio…
Sep 13, 2023
88451b1
Fix last-minute change typo
Sep 13, 2023
dda0a0e
Forgot to also commit the changed arc_util.py
Sep 13, 2023
894cc9a
Remove unnecessary open mode parameters
Sep 13, 2023
bd1d30f
Remove comment - linting
Sep 13, 2023
678dd76
Hopefully fixed all linting errors now
Sep 13, 2023
83417f8
more linting of whitespace
Sep 13, 2023
75087af
More linting and some bugfix related to external job id
Sep 13, 2023
d1f2fb0
linting whitespace
Sep 13, 2023
140ef15
The ARC runner augmented to work with the tool_script.sh as executabl…
Sep 27, 2023
09ce2e2
Linting done
Sep 27, 2023
9acf29d
This version of the ARC job runner relies on pyarcrest 0.3
Sep 28, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions lib/galaxy/dependencies/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -210,6 +210,9 @@ def check_pbs_python(self):
def check_pykube(self):
return "galaxy.jobs.runners.kubernetes:KubernetesJobRunner" in self.job_runners or which("kubectl")

def check_pyarcrest(self):
return "galaxy.jobs.runners.arc:ArcRESTJobRunner" in self.job_runners

def check_chronos_python(self):
return "galaxy.jobs.runners.chronos:ChronosJobRunner" in self.job_runners

Expand Down
3 changes: 3 additions & 0 deletions lib/galaxy/dependencies/conditional-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,9 @@ chronos-python==1.2.1
# Kubernetes job runner
pykube==0.15.0

# ARC job runner
pyarcrest==0.3

# Synnefo / Pithos+ object store client
kamaki

Expand Down
Loading
Loading