Automated Tests for Galaxy on Kubernetes Stacks

Galaxy on GKE deployed via GalaxyKubeMan (AnVIL)

Deployment Testing

Twice a day, GalaxyKubeMan (GKM) is deployed on GKE, mimicking an AnVIL deployment. The purpose of these tests is to provide reasonable confidence that Galaxy is launchable on the AnVIL everyday.

Below is a plot summarizing successful deployments and GKM install times. Click here or on the image for more details.

Tool Testing

After each successful deployment, automated tool tests are also run against the instance. These serve as an end-to-end-like test for Galaxy, providing confidence that Galaxy is not only launchable but functional. These tests cycle on a weekly basis through the entire suite of tools installed by default on AnVIL, providing reasonable confidence that the tools encountered by most users remain functional, and automating the detection and reporting of tools breaking.

Latest tool tests for each chunk:

Chunk ID	Tool List	Latest report	Previous report
0	Toolset	Mon Sep 23 00:51:54 2024	Mon Sep 16 00:51:53 2024
1	Toolset	Mon Sep 23 12:51:18 2024	Mon Sep 16 12:50:34 2024
2	Toolset	Tue Sep 24 00:49:59 2024	Tue Sep 17 00:43:02 2024
3	Toolset	Tue Sep 24 12:50:48 2024	Tue Sep 17 12:50:30 2024
4	Toolset	Wed Sep 25 00:50:20 2024	Wed Sep 18 00:54:43 2024
5	Toolset	Wed Sep 25 12:53:06 2024	Wed Sep 18 12:50:02 2024
6	Toolset	Thu Sep 26 00:49:28 2024	Thu Sep 19 00:49:15 2024
7	Toolset	Thu Sep 26 12:51:06 2024	Thu Sep 19 12:49:37 2024
8	Toolset	Fri Sep 27 00:49:59 2024	Fri Sep 20 00:48:57 2024
9	Toolset	Fri Sep 27 12:50:43 2024	Fri Sep 20 12:50:45 2024
10	Toolset	Sat Sep 28 00:49:51 2024	Sat Sep 21 00:47:27 2024
11	Toolset	Sat Sep 28 12:48:01 2024	Sat Sep 21 12:46:15 2024
12	Toolset	Sun Sep 22 00:52:44 2024	Sun Sep 15 00:52:44 2024
13	Toolset	Sun Sep 22 12:48:24 2024	Sun Sep 15 12:47:00 2024