Skip to content

Commit bfcc4f4

Browse files
committed
[uss_qualifier] extract fragments for scenarios injecting flights
1 parent 8b2401f commit bfcc4f4

File tree

10 files changed

+81
-79
lines changed

10 files changed

+81
-79
lines changed
Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
# Flight injection test step fragment
2+
3+
This test step fragment documents the injection of test flights.
4+
5+
In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps.
6+
7+
## 🛑 Successful injection check
8+
9+
Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test.
10+
11+
**[astm.f3411.v19.NET0500](../../../../../requirements/astm/f3411/v19.md)** requires a Service Provider to provide a persistently supported test instance of their implementation.
12+
This check will fail if the flight was not successfully injected.
13+
14+
## 🛑 Identifiable flights check
15+
16+
This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data.
17+
18+
## Valid flight check
19+
20+
TODO: Validate injected flights, especially to make sure they contain the specified injection IDs
21+
22+
Per **[interuss.automated_testing.rid.injection.UpsertTestResult](../../../../../requirements/interuss/automated_testing/rid/injection.md)**, the NetRID Service Provider under test should only make valid modifications to the injected flights. This includes:
23+
* A flight with the specified injection ID must be returned.
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# Service provider polling test step fragment
2+
3+
uss_qualifier acts as a Display Provider to query Service Providers under test in this step.
4+
5+
## ⚠️ ISA query check
6+
7+
**[interuss.f3411.dss_endpoints.SearchISAs](../../../../../requirements/interuss/f3411/dss_endpoints.md)** requires a USS providing a DSS instance to implement the DSS endpoints of the OpenAPI specification. If uss_qualifier is unable to query the DSS for ISAs, this check will fail.
8+
9+
## ⚠️ Successful flight details query check
10+
11+
**[astm.f3411.v19.NET0710,2](../../../../../requirements/astm/f3411/v19.md)** and **[astm.f3411.v19.NET0340](../../../../../requirements/astm/f3411/v19.md) require a Service Provider to implement the GET flight details endpoint. This check will fail if uss_qualifier cannot query that endpoint (specified in the ISA present in the DSS) successfully.
12+
13+
## [Flight presence checks](../display_data_evaluator_flight_presence.md)

monitoring/uss_qualifier/scenarios/astm/netrid/v19/nominal_behavior.md

Lines changed: 2 additions & 30 deletions
Original file line numberDiff line numberDiff line change
@@ -28,42 +28,18 @@ If specified, uss_qualifier will act as a Display Provider and check a DSS insta
2828

2929
## Nominal flight test case
3030

31-
### Injection test step
31+
### [Injection test step](./fragments/flight_injection.md)
3232

3333
In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps.
3434

35-
#### 🛑 Successful injection check
36-
37-
Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test.
38-
39-
**[astm.f3411.v19.NET0500](../../../../requirements/astm/f3411/v19.md)** requires a Service Provider to provide a persistently supported test instance of their implementation.
40-
This check will fail if the flight was not successfully injected.
41-
42-
#### Valid flight check
43-
44-
TODO: Validate injected flights, especially to make sure they contain the specified injection IDs
45-
46-
Per **[interuss.automated_testing.rid.injection.UpsertTestResult](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the NetRID Service Provider under test should only make valid modifications to the injected flights. This includes:
47-
* A flight with the specified injection ID must be returned.
48-
49-
#### 🛑 Identifiable flights check
50-
51-
This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data.
52-
53-
### Service Provider polling test step
35+
### [Service Provider polling test step](./fragments/sp_polling.md)
5436

5537
If a DSS was provided to this test scenario, uss_qualifier acts as a Display Provider to query Service Providers under test in this step.
5638

57-
#### ⚠️ ISA query check
58-
59-
**[interuss.f3411.dss_endpoints.SearchISAs](../../../../requirements/interuss/f3411/dss_endpoints.md)** requires a USS providing a DSS instance to implement the DSS endpoints of the OpenAPI specification. If uss_qualifier is unable to query the DSS for ISAs, this check will fail.
60-
6139
#### ⚠️ Area too large check
6240

6341
**[astm.f3411.v19.NET0250](../../../../requirements/astm/f3411/v19.md)** requires that a NetRID Service Provider rejects a request for a very large view area with a diagonal greater than *NetMaxDisplayAreaDiagonal*. If such a large view is requested and a 413 error code is not received, then this check will fail.
6442

65-
#### [Flight presence checks](./display_data_evaluator_flight_presence.md)
66-
6743
#### ⚠️ Flights data format check
6844

6945
**[astm.f3411.v19.NET0710,1](../../../../requirements/astm/f3411/v19.md)** and **[astm.f3411.v19.NET0340](../../../../requirements/astm/f3411/v19.md)** require a Service Provider to implement the P2P portion of the OpenAPI specification. This check will fail if the response to the /flights endpoint does not validate against the OpenAPI-specified schema.
@@ -82,10 +58,6 @@ This implies that any recent position outside the area must be either preceded o
8258

8359
(This check validates NET0270 b and c).
8460

85-
#### ⚠️ Successful flight details query check
86-
87-
**[astm.f3411.v19.NET0710,2](../../../../requirements/astm/f3411/v19.md)** and **[astm.f3411.v19.NET0340](../../../../requirements/astm/f3411/v19.md)** require a Service Provider to implement the GET flight details endpoint. This check will fail if uss_qualifier cannot query that endpoint (specified in the ISA present in the DSS) successfully.
88-
8961
#### ⚠️ Flight details data format check
9062

9163
**[astm.f3411.v19.NET0710,2](../../../../requirements/astm/f3411/v19.md)** and **[astm.f3411.v19.NET0340](../../../../requirements/astm/f3411/v19.md)** require a Service Provider to implement the P2P portion of the OpenAPI specification. This check will fail if the response to the flight details endpoint does not validate against the OpenAPI-specified schema.
Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,24 @@
1+
# Flight injection test step fragment
2+
3+
This test step fragment documents the injection of test flights.
4+
5+
In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps.
6+
7+
## 🛑 Successful injection check
8+
9+
Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test.
10+
11+
**[astm.f3411.v22a.NET0500](../../../../../requirements/astm/f3411/v22a.md)** requires a Service Provider to provide a persistently supported test instance of their implementation.
12+
This check will fail if the flight was not successfully injected.
13+
14+
## 🛑 Identifiable flights check
15+
16+
This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data.
17+
18+
19+
## Valid flight check
20+
21+
TODO: Validate injected flights, especially to make sure they contain the specified injection IDs
22+
23+
Per **[interuss.automated_testing.rid.injection.UpsertTestResult](../../../../../requirements/interuss/automated_testing/rid/injection.md)**, the NetRID Service Provider under test should only make valid modifications to the injected flights. This includes:
24+
* A flight with the specified injection ID must be returned.
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# Service provider polling test step fragment
2+
3+
uss_qualifier acts as a Display Provider to query Service Providers under test in this step.
4+
5+
## ⚠️ ISA query check
6+
7+
**[interuss.f3411.dss_endpoints.SearchISAs](../../../../../requirements/interuss/f3411/dss_endpoints.md)** requires a USS providing a DSS instance to implement the DSS endpoints of the OpenAPI specification. If uss_qualifier is unable to query the DSS for ISAs, this check will fail.
8+
9+
## ⚠️ Successful flight details query check
10+
11+
**[astm.f3411.v22a.NET0710,2](../../../../../requirements/astm/f3411/v22a.md)** and **[astm.f3411.v22a.NET0340](../../../../../requirements/astm/f3411/v22a.md) require a Service Provider to implement the GET flight details endpoint. This check will fail if uss_qualifier cannot query that endpoint (specified in the ISA present in the DSS) successfully.
12+
13+
## [Flight presence checks](../display_data_evaluator_flight_presence.md)

monitoring/uss_qualifier/scenarios/astm/netrid/v22a/misbehavior.md

Lines changed: 1 addition & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -24,20 +24,7 @@ A [`DSSInstanceResource`](../../../../resources/astm/f3411/dss.py) is required f
2424

2525
## Unauthenticated requests test case
2626

27-
### Injection test step
28-
29-
In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps.
30-
31-
#### 🛑 Successful injection check
32-
33-
Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test.
34-
35-
**[astm.f3411.v22a.NET0500](../../../../requirements/astm/f3411/v22a.md)** requires a Service Provider to provide a persistently supported test instance of their implementation.
36-
This check will fail if the flight was not successfully injected.
37-
38-
#### 🛑 Identifiable flights check
39-
40-
This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data.
27+
### [Injection test step](./fragments/flight_injection.md)
4128

4229
### Unauthenticated requests test step
4330

monitoring/uss_qualifier/scenarios/astm/netrid/v22a/nominal_behavior.md

Lines changed: 2 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -28,42 +28,16 @@ If specified, uss_qualifier will act as a Display Provider and check a DSS insta
2828

2929
## Nominal flight test case
3030

31-
### Injection test step
31+
### [Injection test step](./fragments/flight_injection.md)
3232

33-
In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps.
34-
35-
#### 🛑 Successful injection check
36-
37-
Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test.
38-
39-
**[astm.f3411.v22a.NET0500](../../../../requirements/astm/f3411/v22a.md)** requires a Service Provider to provide a persistently supported test instance of their implementation.
40-
This check will fail if the flight was not successfully injected.
41-
42-
#### Valid flight check
43-
44-
TODO: Validate injected flights, especially to make sure they contain the specified injection IDs
45-
46-
Per **[interuss.automated_testing.rid.injection.UpsertTestResult](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the NetRID Service Provider under test should only make valid modifications to the injected flights. This includes:
47-
* A flight with the specified injection ID must be returned.
48-
49-
#### 🛑 Identifiable flights check
50-
51-
This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data.
52-
53-
### Service Provider polling test step
33+
### [Service Provider polling test step](./fragments/sp_polling.md)
5434

5535
If a DSS was provided to this test scenario, uss_qualifier acts as a Display Provider to query Service Providers under test in this step.
5636

57-
#### ⚠️ ISA query check
58-
59-
**[interuss.f3411.dss_endpoints.SearchISAs](../../../../requirements/interuss/f3411/dss_endpoints.md)** requires a USS providing a DSS instance to implement the DSS endpoints of the OpenAPI specification. If uss_qualifier is unable to query the DSS for ISAs, this check will fail.
60-
6137
#### ⚠️ Area too large check
6238

6339
**[astm.f3411.v22a.NET0250](../../../../requirements/astm/f3411/v22a.md)** requires that a NetRID Service Provider rejects a request for a very large view area with a diagonal greater than *NetMaxDisplayAreaDiagonal*. If such a large view is requested and a 413 error code is not received, then this check will fail.
6440

65-
#### [Flight presence checks](./display_data_evaluator_flight_presence.md)
66-
6741
#### ⚠️ Flights data format check
6842

6943
**[astm.f3411.v22a.NET0710,1](../../../../requirements/astm/f3411/v22a.md)** and **[astm.f3411.v22a.NET0340](../../../../requirements/astm/f3411/v22a.md)** requires a Service Provider to implement the P2P portion of the OpenAPI specification. This check will fail if the response to the /flights endpoint does not validate against the OpenAPI-specified schema.
@@ -82,10 +56,6 @@ This implies that any recent position outside the area must be either preceded o
8256

8357
(This check validates NET0270 b and c).
8458

85-
#### ⚠️ Successful flight details query check
86-
87-
**[astm.f3411.v22a.NET0710,2](../../../../requirements/astm/f3411/v22a.md)** and **[astm.f3411.v22a.NET0340](../../../../requirements/astm/f3411/v22a.md) require a Service Provider to implement the GET flight details endpoint. This check will fail if uss_qualifier cannot query that endpoint (specified in the ISA present in the DSS) successfully.
88-
8959
#### ⚠️ Flight details data format check
9060

9161
**[astm.f3411.v22a.NET0710,2](../../../../requirements/astm/f3411/v22a.md)** and **[astm.f3411.v22a.NET0340](../../../../requirements/astm/f3411/v22a.md) require a Service Provider to implement the P2P portion of the OpenAPI specification. This check will fail if the response to the flight details endpoint does not validate against the OpenAPI-specified schema.

monitoring/uss_qualifier/suites/astm/netrid/f3411_22a.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -550,7 +550,7 @@
550550
<tr>
551551
<td><a href="../../../requirements/interuss/automated_testing/rid/injection.md">UpsertTestResult</a></td>
552552
<td>TODO</td>
553-
<td><a href="../../../scenarios/astm/netrid/v22a/nominal_behavior.md">ASTM NetRID nominal behavior</a></td>
553+
<td><a href="../../../scenarios/astm/netrid/v22a/misbehavior.md">ASTM NetRID SP clients misbehavior handling</a><br><a href="../../../scenarios/astm/netrid/v22a/nominal_behavior.md">ASTM NetRID nominal behavior</a></td>
554554
</tr>
555555
<tr>
556556
<td><a href="../../../requirements/interuss/automated_testing/rid/injection.md">UpsertTestSuccess</a></td>

monitoring/uss_qualifier/suites/uspace/network_identification.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -546,7 +546,7 @@
546546
<tr>
547547
<td><a href="../../requirements/interuss/automated_testing/rid/injection.md">UpsertTestResult</a></td>
548548
<td>TODO</td>
549-
<td><a href="../../scenarios/astm/netrid/v22a/nominal_behavior.md">ASTM NetRID nominal behavior</a></td>
549+
<td><a href="../../scenarios/astm/netrid/v22a/misbehavior.md">ASTM NetRID SP clients misbehavior handling</a><br><a href="../../scenarios/astm/netrid/v22a/nominal_behavior.md">ASTM NetRID nominal behavior</a></td>
550550
</tr>
551551
<tr>
552552
<td><a href="../../requirements/interuss/automated_testing/rid/injection.md">UpsertTestSuccess</a></td>

monitoring/uss_qualifier/suites/uspace/required_services.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -969,7 +969,7 @@
969969
<tr>
970970
<td><a href="../../requirements/interuss/automated_testing/rid/injection.md">UpsertTestResult</a></td>
971971
<td>TODO</td>
972-
<td><a href="../../scenarios/astm/netrid/v22a/nominal_behavior.md">ASTM NetRID nominal behavior</a></td>
972+
<td><a href="../../scenarios/astm/netrid/v22a/misbehavior.md">ASTM NetRID SP clients misbehavior handling</a><br><a href="../../scenarios/astm/netrid/v22a/nominal_behavior.md">ASTM NetRID nominal behavior</a></td>
973973
</tr>
974974
<tr>
975975
<td><a href="../../requirements/interuss/automated_testing/rid/injection.md">UpsertTestSuccess</a></td>

0 commit comments

Comments
 (0)