Reproducer single node openshift (SNO)

[danpawlik]

This commit allows reproducer to create OpenShift cluster using Single Node OpenShift (SNO) feature.

[openshift-ci]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[softwarefactory-project-zuul]

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.

[softwarefactory-project-zuul]

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/5dc22fa6d6bf4c44bb15fb3bb7940af0

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 35m 59s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 09m 23s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 20m 19s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 7m 38s
❌ cifmw-pod-pre-commit FAILURE in 7m 51s
✔️ build-push-container-cifmw-client SUCCESS in 21m 07s
❌ cifmw-molecule-devscripts FAILURE in 10m 41s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 00s

[danpawlik]

Still WIP, there is an issue with ingress that raises few issues later.
Even export NODES_PLATFORM="none" does not help. Very helpful would be to make reverse engineering of a CI job that uses SNO_IPV4 scenario, but can not find it.

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/7e909c7819764fc3a6ece0e75bd495f0

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 41m 20s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 13m 20s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 26m 00s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 7m 55s
❌ cifmw-pod-pre-commit FAILURE in 7m 55s
✔️ build-push-container-cifmw-client SUCCESS in 15m 36s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 05s
✔️ cifmw-molecule-reproducer SUCCESS in 13m 42s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/58af74d994354186bc474744505368bc

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 39m 02s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 09m 32s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 23m 18s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 13s
❌ cifmw-pod-pre-commit FAILURE in 7m 53s
✔️ build-push-container-cifmw-client SUCCESS in 16m 41s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 43s
✔️ cifmw-molecule-reproducer SUCCESS in 14m 04s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/7b7fc5d03ff34d2cb09473f40f04bdaf

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 45m 19s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 10m 25s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 23m 43s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 7m 54s
❌ cifmw-pod-pre-commit FAILURE in 7m 57s
✔️ build-push-container-cifmw-client SUCCESS in 20m 16s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 03s
✔️ cifmw-molecule-reproducer SUCCESS in 14m 37s

[github-actions]

This PR is stale because it has been for over 15 days with no activity.
Remove stale label or comment or this will be closed in 7 days.

[danpawlik]

Seems PoC of SNO is almost working, without using reproducer or devscript role.
Example execution using nightly build:

cat << 'EOF' > pre.sh
sudo sed -i 's@metalink=https://mirrors.centos.org/metalink?repo=centos-baseos-$stream&arch=$basearch&protocol=https,http@baseurl=http://mirror.stream.centos.org/9-stream/
BaseOS/$basearch/os/@g' /etc/yum.repos.d/centos.repo

sudo sed -i 's@metalink=https://mirrors.centos.org/metalink?repo=centos-appstream-$stream&arch=$basearch&protocol=https,http@baseurl=http://mirror.stream.centos.org/9-stre
am/AppStream/$basearch/os/@g' /etc/yum.repos.d/centos.repo

sudo dnf update -y
sudo dnf install -y git make wget jq libvirt qemu-kvm tar
# https://github.com/openshift-metal3/dev-scripts/blob/master/agent/README.md
sudo setfacl -m u:qemu:rx /home/zuul
echo 'user = "+0"' | sudo tee -a /etc/libvirt/qemu.conf

# enable nested virt
sudo sed -i 's/#options kvm_intel nested=1/options kvm_intel nested=1/g' /etc/modprobe.d/kvm.conf

echo "Now reboot the host..."
sudo reboot
EOF

cat << 'EOF' > execute.sh
sudo swapoff -a

git clone https://github.com/openshift-metal3/dev-scripts /home/zuul/src/github.com/openshift-metal3/dev-scripts

# workaround for only 8 vcpus
sed -i 's/MASTER_VCPU=8/MASTER_VCPU=20/g' /home/zuul/src/github.com/openshift-metal3/dev-scripts/common.sh

# it should have: ci_token  pull_secret.json
cp -a ~/secrets/* /home/zuul/src/github.com/openshift-metal3/dev-scripts/


cat << 'EOL' > /home/zuul/src/github.com/openshift-metal3/dev-scripts/config_$(whoami).sh


#!/bin/bash

# OpenShift Container Platform configuration template
# Refer https://github.com/openshift-metal3/dev-scripts/blob/master/config_example.sh
#
set +x
export CI_TOKEN=$(cat /home/zuul/src/github.com/openshift-metal3/dev-scripts/ci_token)
set -x

if [ -z $CI_TOKEN ]; then
    echo "no ci token"
    exit 1
fi

export OPENSHIFT_RELEASE_TYPE="ga"
export OPENSHIFT_VERSION="4.18.3"
export CLUSTER_NAME="ocp"
export BASE_DOMAIN="openstack.lab"
export NTP_SERVERS="ntp.nask.pl"
export AGENT_E2E_TEST_SCENARIO=SNO_IPV4
export NUM_MASTERS=1
export NUM_WORKERS=0

export MASTER_VCPU=20
export MASTER_MEMORY=32000
EOL

curl -LO https://downloads-openshift-console.apps.ci.l2s4.p1.openshiftapps.com/amd64/linux/oc.tar
tar xaf oc.tar
sudo mv oc /usr/local/bin/

cd /home/zuul/src/github.com/openshift-metal3/dev-scripts/

echo "Now run `make agent`"
make agent
EOF

then:

pre.sh
# reboot

execute.sh

NOTE: if you are doing that on VM, make sure that the disk is not Virtio, but SCSI virtio. It will give you a lot more performance.

[softwarefactory-project-zuul]

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/ci-framework for 3129,519d08a00aa82c6404a460e73009cb5a9e919624

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ef6363362ce846a482cb8fe2ebb39cf2

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 47m 22s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 22m 18s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 46s
❌ cifmw-crc-podified-edpm-baremetal-minor-update RETRY_LIMIT in 26m 52s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 51s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 51s
❌ cifmw-pod-pre-commit FAILURE in 8m 55s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 30s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 42s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 40m 18s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 07s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/04285e97cfeb4e62b9ab2721782c1084

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 03m 38s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 20m 03s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 23m 13s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 51m 46s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 46s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 25s
❌ cifmw-pod-pre-commit FAILURE in 7m 55s
✔️ cifmw-molecule-devscripts SUCCESS in 11m 56s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 48s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 42m 41s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 22s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ce4784e9bd064ebfb7cdf571e64a14a3

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 19m 02s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 23m 32s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 24m 16s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 04m 48s
✔️ cifmw-pod-zuul-files SUCCESS in 5m 27s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 10m 36s
❌ cifmw-pod-pre-commit FAILURE in 10m 04s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 22s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 50s
❌ cifmw-molecule-libvirt_manager FAILURE in 12m 59s
✔️ cifmw-molecule-reproducer SUCCESS in 32m 02s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/9989bd6f434140da86f5e64bee999a00

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 08m 27s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 22m 07s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 28m 47s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 54m 59s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 49s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 58s
❌ cifmw-pod-pre-commit FAILURE in 8m 14s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 44s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 36s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 41m 18s
✔️ cifmw-molecule-networking_mapper SUCCESS in 5m 09s
✔️ cifmw-molecule-reproducer SUCCESS in 35m 36s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/a386dca847044655a941edc31173253a

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 15m 07s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 21m 20s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 31s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 02m 20s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 52s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 03s
❌ cifmw-pod-pre-commit FAILURE in 8m 37s
✔️ cifmw-molecule-devscripts SUCCESS in 11m 22s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 52s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 42m 03s
❌ cifmw-molecule-networking_mapper FAILURE in 5m 05s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 02s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/b3e0afb36ace4291860fe78cfe6fedca

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 05m 50s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 18m 50s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 23m 09s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 53m 18s
✔️ cifmw-pod-zuul-files SUCCESS in 5m 06s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 10m 37s
❌ cifmw-pod-pre-commit FAILURE in 9m 35s
✔️ cifmw-molecule-devscripts SUCCESS in 11m 46s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 40s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 42m 17s
❌ cifmw-molecule-networking_mapper FAILURE in 4m 54s
✔️ cifmw-molecule-reproducer SUCCESS in 14m 39s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e2746b6ce09740cbb5736bd8326c084c

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 10m 51s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 23m 16s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 26m 12s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 57m 45s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 40s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 01s
❌ cifmw-pod-pre-commit FAILURE in 8m 55s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 40s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 39s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 41m 39s
✔️ cifmw-molecule-reproducer SUCCESS in 14m 37s