Skip to content

Commit 82bcdad

Browse files
committed
[uss_qualifier] verify that SCD subscriptions can be mutated and deleted on every DSS of a deployment
1 parent 10121f9 commit 82bcdad

File tree

4 files changed

+253
-72
lines changed

4 files changed

+253
-72
lines changed

monitoring/uss_qualifier/scenarios/astm/utm/dss/fragments/sub/sync.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,12 @@ This test step fragment validates that subscriptions are properly synchronized a
77
If the previously created or mutated subscription cannot be found at a DSS, either one of the instances at which the subscription was created or the one that was queried,
88
may be failing to implement **[astm.f3548.v21.DSS0210,1a](../../../../../../requirements/astm/f3548/v21.md)**.
99

10+
## 🛑 Subscription returned by a secondary DSS is valid and correct check
11+
12+
When queried for a subscription that was created via another DSS, a DSS instance is expected to provide a valid subscription.
13+
14+
If it does not, it might be in violation of **[astm.f3548.v21.DSS0005,5](../../../../../../requirements/astm/f3548/v21.md)**.
15+
1016
## 🛑 Propagated subscription contains the correct USS base URL check
1117

1218
If the subscription returned by a DSS to which the subscription was synchronized to does not contain the correct USS base URL,

monitoring/uss_qualifier/scenarios/astm/utm/dss/synchronization/subscription_synchronization.md

Lines changed: 61 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -52,12 +52,6 @@ Verify that the subscription returned by the DSS under test is properly formatte
5252

5353
Query the created subscription at every DSS provided in `dss_instances`.
5454

55-
#### 🛑 Subscription returned by a secondary DSS is valid and correct check
56-
57-
When queried for a subscription that was created via another DSS, a DSS instance is expected to provide a valid subscription.
58-
59-
If it does not, it might be in violation of **[astm.f3548.v21.DSS0005,5](../../../../../requirements/astm/f3548/v21.md)**.
60-
6155
#### [Subscription is synchronized](../fragments/sub/sync.md)
6256

6357
Confirm that the subscription that was just created is properly synchronized across all DSS instances.
@@ -74,10 +68,10 @@ Verify that the subscription returned by every DSS is correctly formatted and co
7468

7569
Verify that the version of the subscription returned by every DSS is as expected.
7670

77-
### Mutate subscription test step
71+
### Mutate subscription broadcast test step
7872

79-
This test step mutates the previously created subscription to verify that the DSS reacts properly: notably, it checks that the subscription version is updated,
80-
including for changes that are not directly visible, such as changing the subscription's footprint.
73+
This test step mutates the previously created subscription, by accessing the primary DSS, to verify that the update is propagated to all other DSSes.
74+
Notably, it checks that the subscription version is updated, including for changes that are not directly visible, such as changing the subscription's footprint.
8175

8276
#### [Update subscription](../fragments/sub/crud/update.md)
8377

@@ -95,12 +89,6 @@ Verify that the version of the subscription returned by the DSS has been updated
9589

9690
Query the updated subscription at every DSS provided in `dss_instances`.
9791

98-
#### 🛑 Subscription returned by a secondary DSS is valid and correct check
99-
100-
When queried for a subscription that was mutated via another DSS, a DSS instance is expected to provide a valid subscription.
101-
102-
If it does not, it might be in violation of **[astm.f3548.v21.DSS0005,5](../../../../../requirements/astm/f3548/v21.md)**.
103-
10492
#### [Subscription is synchronized](../fragments/sub/sync.md)
10593

10694
Confirm that the subscription that was just mutated is properly synchronized across all DSS instances.
@@ -117,9 +105,38 @@ Verify that the subscription returned by every DSS is correctly formatted and co
117105

118106
Verify that the version of the subscription returned by every DSS is as expected.
119107

120-
### Delete subscription test step
108+
### Mutate subscription on secondaries test step
109+
110+
This test step attempts to mutate the subscription on every secondary DSS instance (that is, instances through which the subscription has not been created) to confirm that such mutations are properly propagated to every DSS.
111+
112+
#### [Update subscription](../fragments/sub/crud/update.md)
113+
114+
Confirm that the subscription can be mutated on a secondary DSS.
115+
116+
#### [Subscription is synchronized](../fragments/sub/sync.md)
117+
118+
Confirm that the subscription that was just mutated is properly synchronized across all DSS instances.
119+
120+
#### [Get subscription](../fragments/sub/crud/read.md)
121+
122+
Confirms that the subscription that was just mutated can be retrieved from any DSS, and that it has the expected content.
123+
124+
#### [Validate subscription](../fragments/sub/validate/correctness.md)
125+
126+
Verify that the subscription returned by the DSS is properly formatted and contains the correct content.
127+
128+
#### [Validate version is updated by mutation](../fragments/sub/validate/mutated.md)
129+
130+
Verify that the version of the subscription returned by the DSS the subscription was mutated through has been updated.
131+
132+
#### [Validate new version is synced](../fragments/sub/validate/non_mutated.md)
121133

122-
Attempt to delete the subscription in various ways and ensure that the DSS reacts properly.
134+
Verify that the new version of the subscription has been propagated.
135+
136+
### Delete subscription on primary test step
137+
138+
Attempt to delete the subscription that was created on the primary DSS through the primary DSS in various ways,
139+
and ensure that the DSS reacts properly.
123140

124141
This also checks that the subscription data returned by a successful deletion is correct.
125142

@@ -144,4 +161,31 @@ Attempt to query and search for the deleted subscription in various ways
144161
If a DSS returns a subscription that was previously successfully deleted from the primary DSS,
145162
either one of the primary DSS or the DSS that returned the subscription is in violation of **[astm.f3548.v21.DSS0210,1a](../../../../../requirements/astm/f3548/v21.md)**.
146163

164+
### Delete subscriptions on secondaries test step
165+
166+
Attempt to delete subscriptions that were created through the primary DSS via the secondary DSS instances.
167+
168+
#### [Delete subscription](../fragments/sub/crud/delete.md)
169+
170+
Confirms that a subscription can be deleted from a secondary DSS
171+
172+
#### [Validate subscription](../fragments/sub/validate/correctness.md)
173+
174+
Verify that the subscription returned by the DSS via the deletion is properly formatted and contains the correct content.
175+
176+
#### [Validate version](../fragments/sub/validate/non_mutated.md)
177+
178+
Verify that the version of the subscription returned by the DSS is as expected
179+
180+
#### 🛑 Secondary DSS should not return the deleted subscription check
181+
182+
If a DSS returns a subscription that was previously successfully deleted from the primary DSS,
183+
either one of the primary DSS or the DSS that returned the subscription is in violation of **[astm.f3548.v21.DSS0210,1a](../../../../../requirements/astm/f3548/v21.md)**.
184+
185+
#### 🛑 Primary DSS should not return the deleted subscription check
186+
187+
If the primary DSS returns a subscription that was previously successfully deleted from a secondary DSS,
188+
either one of the secondary or primary DSS is in violation of **[astm.f3548.v21.DSS0210,1a](../../../../../requirements/astm/f3548/v21.md)**.
189+
190+
147191
## [Cleanup](../clean_workspace.md)

0 commit comments

Comments
 (0)