Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Singularity tests - WIP #6

Closed
wants to merge 7 commits into from
Closed

Singularity tests - WIP #6

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
96b50b6
remove memlock on all nodes
sjpb Jul 5, 2023
b0c1dcc
set memlock unlimted in slurmd via entrypoint hack using ulimit
sjpb Jul 5, 2023
fb85321
use schedmd slurmd unitfile limits
sjpb Jul 5, 2023
c3b929d
don't use cgroups at all
sjpb Jul 5, 2023
a719f5d
add steveb-docker vm sshkey
sjpb Jul 6, 2023
850fe23
Merge branch 'kubernetes-fix-mpi' into temp
sjpb Jul 6, 2023
e432840
image adds apptainer and REMOVES mpitests/openmpi
sjpb Jul 6, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ ARG GOSU_VERSION=1.11
RUN set -ex \
&& yum makecache \
&& yum -y update \
&& yum -y install dnf-plugins-core \
&& yum -y install dnf-plugins-core epel-release \
&& yum config-manager --set-enabled powertools \
&& yum -y install \
wget \
Expand All @@ -35,11 +35,12 @@ RUN set -ex \
vim-enhanced \
http-parser-devel \
json-c-devel \
mpitests-openmpi \
# mpitests-openmpi \
pmix-devel \
hwloc \
hwloc-devel \
openssh-server \
apptainer \
&& yum clean all \
&& rm -rf /var/cache/yum

Expand Down
6 changes: 6 additions & 0 deletions docker-entrypoint.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -53,6 +53,12 @@ fi

if [ "$1" = "slurmd" ]
then
echo "---> Set shell resource limits ..."
ulimit -l unlimited
ulimit -s unlimited
ulimit -n 131072
ulimit -a

echo "---> Starting the MUNGE Authentication service (munged) ..."
gosu munge /usr/sbin/munged

Expand Down
3 changes: 2 additions & 1 deletion slurm-cluster-chart/files/authorized_keys
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,2 +1,3 @@
ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEx91hb5SMatDqPTpe63iOv34ddkR+PoeXf+86ET6v2y wtripp@LAPTOP-U9SBINHF
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCxXfcSTVZeiJrlLoGZxVCZGBOEdSejn/eqJo8uugfZLqXvFX2Mq/hvog0z2vccA1/7nX9DgsbG1R/2f8o1C2VPkURIFVfYcOc6+OK2PRYW/vgubqHIx0kkTxVhkCdbIPizHt4Fe7v27h+bAerLASv3xNThhX8dObCbEPyalwpFdRyOpUaW3jU8UDW2LfYqWYdd3KjRAVtS/0Xc6xkQ1ZHkpy0R2P9cMUbgXxpn011VF61uk4yO0qHa8lYqDRJVTmUcwGUQPbKmBWaKM14ltf/UQSvExPrAfUFIgHigJFo1aa8iIomt5XkZEfHSWkDiqKjoT+Lu2brU8xKwW3Vb5g9jfrZSM/xkXsw/YYarx4B/6f1dwSKF7rXinZflrQtuqBeg6Rscy2mhuByZPOUG8w9quicrYJHCMO68WwEQKSiG0C/BC5rsjtX08ice0Jngk8HlA95FZrXvxK5G6GIDeU7rG1V8NjpU8kn9K8J5xrlWKhuvxlkkDTdB8TZzH0UB4Eu4YhXoK/Zak0xY9zkIz1XPFRL8G8E0pWwf+dkuVlX2hsVBxAZpnaqa1vEj0lmuXUFbxCley18zgNf0ACDgMHb6sd2NxgadTi3rrSWk5sJhcGN7iT/DtwPovd6XmxQf+8ndiQwnJrBy1YrCpMWA4RWQngo7fSO3booC+Aleju1lmw== wtripp@LAPTOP-U9SBINHF
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCxXfcSTVZeiJrlLoGZxVCZGBOEdSejn/eqJo8uugfZLqXvFX2Mq/hvog0z2vccA1/7nX9DgsbG1R/2f8o1C2VPkURIFVfYcOc6+OK2PRYW/vgubqHIx0kkTxVhkCdbIPizHt4Fe7v27h+bAerLASv3xNThhX8dObCbEPyalwpFdRyOpUaW3jU8UDW2LfYqWYdd3KjRAVtS/0Xc6xkQ1ZHkpy0R2P9cMUbgXxpn011VF61uk4yO0qHa8lYqDRJVTmUcwGUQPbKmBWaKM14ltf/UQSvExPrAfUFIgHigJFo1aa8iIomt5XkZEfHSWkDiqKjoT+Lu2brU8xKwW3Vb5g9jfrZSM/xkXsw/YYarx4B/6f1dwSKF7rXinZflrQtuqBeg6Rscy2mhuByZPOUG8w9quicrYJHCMO68WwEQKSiG0C/BC5rsjtX08ice0Jngk8HlA95FZrXvxK5G6GIDeU7rG1V8NjpU8kn9K8J5xrlWKhuvxlkkDTdB8TZzH0UB4Eu4YhXoK/Zak0xY9zkIz1XPFRL8G8E0pWwf+dkuVlX2hsVBxAZpnaqa1vEj0lmuXUFbxCley18zgNf0ACDgMHb6sd2NxgadTi3rrSWk5sJhcGN7iT/DtwPovd6XmxQf+8ndiQwnJrBy1YrCpMWA4RWQngo7fSO3booC+Aleju1lmw== wtripp@LAPTOP-U9SBINHF
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXp0/qiVze73XKMGPrbV3rtotqCljPE8Hr1DubJGE/ZwiclRC6sOLg7iWxHMAo7TNYOCevNbienVetth72p4793aiMVc/5RqPdvU38dRjysHTI47rhLSVyHh9aTcZ8lOvQdA6NnNIl0qciLP3XJf4BzHRKEN+Jy21qdzHeEW4GYMq2hSr8iUfTctfSrjB+tJfPNbt7Tw7yiC5frrhs+wNve5PtLlC+TWZPPt4licMf/gR/Ppm/wabrE71purw7qe1g8hl9QX4ftKahiYI2VtQa45uObqHOjVNHAtJK249p3VtHnhc78OjuK7uv8ue/j2ox6U9YjrT5+XGqASlPh4Cgp8rT/zOzgj4wZ2p/pWPBfIrmx/8av51x8Rf1Kb7Zl/A4C9oURf77kB2Rcgou0hO/cwSAT/XuWFdW5zyrUrxnFKoFU6p5jK/yP7gxITURvclnV4kABvkIk3neOREuhwK8OwMvZpZUX8iQUHo+2nyy2YTerOD5kx6BToDK1iMK6YU= rocky@steveb-docker
7 changes: 5 additions & 2 deletions slurm-cluster-chart/files/slurm.conf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ JobCompType=jobcomp/filetxt
JobCompLoc=/var/log/slurm/jobcomp.log
#
# ACCOUNTING
JobAcctGatherType=jobacct_gather/linux
JobAcctGatherType=jobacct_gather/none
JobAcctGatherFrequency=30
#
AccountingStorageType=accounting_storage/slurmdbd
Expand All @@ -51,4 +51,7 @@ AccountingStoragePort=6819
MaxNodeCount=10
# PARTITIONS
PartitionName=all Default=yes Nodes=ALL
TreeWidth=65533
TreeWidth=65533

TaskPlugin=task/none
PropagateResourceLimitsExcept=MEMLOCK
2 changes: 2 additions & 0 deletions slurm-cluster-chart/templates/slurmd-deployment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,8 @@ spec:
- mountPath: /tempmounts/munge.key
name: munge-key-secret
subPath: munge.key
securityContext:
privileged: true
restartPolicy: Always
volumes:
- name: slurm-jobdir
Expand Down