Create updated Ubuntu ECP image/CI job

[willdunklin]

Adds a new ECP test image based on the ecp ubuntu20.04 runner

[willdunklin]

Just wanted to note that the CI approval is hanging since the fedora35-ecp-catalyst job was removed. I can add the job back into the PR but the Ubuntu image is meant to supplant the older fedora image.

[burlen]

20.04 is pretty out dated, since we are making the effort to update this why not use ubuntu 22.04 (already a year old). I've had to move to 22.04 in my development systems to get the latest ROCm release (needed for asynchrounous data transfer). Similarly I had to go to Fedora 37 to get the latest CUDA 12 release because of compiler bugs in 11. Also Fedroa 38 was released recently and official CUDA support expected to come in the next CUDA minor release.

[willdunklin]

@burlen
The image is based on the E4S runner image, which is related to the environments the ecp sdk will be ran in. The target HPC systems will be stuck on 20.04 for quite some time, so for the sake of this integration test, it might be best to stick with this version.

[burlen]

Feel free to merge this once Ryan is set

[willdunklin]

I've wrapped up the changes for this PR (@kwryankrattiger previously reviewed this with me, although another look would be appreciated).

One note is that I needed to use ADIOS2 2.8.3 for the tests to pass, see #133 for info about the failing tests. The Ubuntu image should have parity with the old Fedora one now.

[kwryankrattiger]

I think for this we also want to add --only dependencies

[willdunklin]

Ah, actually I think we want to remove the next line, considering this should also install an up to date lmod. Is the splitting between dependencies and the packages important for this script?

[kwryankrattiger]

I think this is okay.