diff --git a/monitoring/uss_qualifier/scenarios/astm/netrid/v19/fragments/flight_injection.md b/monitoring/uss_qualifier/scenarios/astm/netrid/v19/fragments/flight_injection.md new file mode 100644 index 0000000000..3999d15c94 --- /dev/null +++ b/monitoring/uss_qualifier/scenarios/astm/netrid/v19/fragments/flight_injection.md @@ -0,0 +1,23 @@ +# Flight injection test step fragment + +This test step fragment documents the injection of test flights. + +In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps. + +## 🛑 Successful injection check + +Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test. + +**[astm.f3411.v19.NET0500](../../../../../requirements/astm/f3411/v19.md)** requires a Service Provider to provide a persistently supported test instance of their implementation. +This check will fail if the flight was not successfully injected. + +## 🛑 Identifiable flights check + +This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data. + +## Valid flight check + +TODO: Validate injected flights, especially to make sure they contain the specified injection IDs + +Per **[interuss.automated_testing.rid.injection.UpsertTestResult](../../../../../requirements/interuss/automated_testing/rid/injection.md)**, the NetRID Service Provider under test should only make valid modifications to the injected flights. This includes: +* A flight with the specified injection ID must be returned. diff --git a/monitoring/uss_qualifier/scenarios/astm/netrid/v19/fragments/sp_polling.md b/monitoring/uss_qualifier/scenarios/astm/netrid/v19/fragments/sp_polling.md new file mode 100644 index 0000000000..0aa93ad6db --- /dev/null +++ b/monitoring/uss_qualifier/scenarios/astm/netrid/v19/fragments/sp_polling.md @@ -0,0 +1,13 @@ +# Service provider polling test step fragment + +uss_qualifier acts as a Display Provider to query Service Providers under test in this step. + +## ⚠️ ISA query check + +**[interuss.f3411.dss_endpoints.SearchISAs](../../../../../requirements/interuss/f3411/dss_endpoints.md)** requires a USS providing a DSS instance to implement the DSS endpoints of the OpenAPI specification. If uss_qualifier is unable to query the DSS for ISAs, this check will fail. + +## ⚠️ Successful flight details query check + +**[astm.f3411.v19.NET0710,2](../../../../../requirements/astm/f3411/v19.md)** and **[astm.f3411.v19.NET0340](../../../../../requirements/astm/f3411/v19.md) require a Service Provider to implement the GET flight details endpoint. This check will fail if uss_qualifier cannot query that endpoint (specified in the ISA present in the DSS) successfully. + +## [Flight presence checks](../display_data_evaluator_flight_presence.md) diff --git a/monitoring/uss_qualifier/scenarios/astm/netrid/v19/nominal_behavior.md b/monitoring/uss_qualifier/scenarios/astm/netrid/v19/nominal_behavior.md index 5cf14bec10..10194dda8c 100644 --- a/monitoring/uss_qualifier/scenarios/astm/netrid/v19/nominal_behavior.md +++ b/monitoring/uss_qualifier/scenarios/astm/netrid/v19/nominal_behavior.md @@ -28,42 +28,18 @@ If specified, uss_qualifier will act as a Display Provider and check a DSS insta ## Nominal flight test case -### Injection test step +### [Injection test step](./fragments/flight_injection.md) In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps. -#### 🛑 Successful injection check - -Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test. - -**[astm.f3411.v19.NET0500](../../../../requirements/astm/f3411/v19.md)** requires a Service Provider to provide a persistently supported test instance of their implementation. -This check will fail if the flight was not successfully injected. - -#### Valid flight check - -TODO: Validate injected flights, especially to make sure they contain the specified injection IDs - -Per **[interuss.automated_testing.rid.injection.UpsertTestResult](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the NetRID Service Provider under test should only make valid modifications to the injected flights. This includes: -* A flight with the specified injection ID must be returned. - -#### 🛑 Identifiable flights check - -This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data. - -### Service Provider polling test step +### [Service Provider polling test step](./fragments/sp_polling.md) If a DSS was provided to this test scenario, uss_qualifier acts as a Display Provider to query Service Providers under test in this step. -#### ⚠️ ISA query check - -**[interuss.f3411.dss_endpoints.SearchISAs](../../../../requirements/interuss/f3411/dss_endpoints.md)** requires a USS providing a DSS instance to implement the DSS endpoints of the OpenAPI specification. If uss_qualifier is unable to query the DSS for ISAs, this check will fail. - #### ⚠️ Area too large check **[astm.f3411.v19.NET0250](../../../../requirements/astm/f3411/v19.md)** requires that a NetRID Service Provider rejects a request for a very large view area with a diagonal greater than *NetMaxDisplayAreaDiagonal*. If such a large view is requested and a 413 error code is not received, then this check will fail. -#### [Flight presence checks](./display_data_evaluator_flight_presence.md) - #### ⚠️ Flights data format check **[astm.f3411.v19.NET0710,1](../../../../requirements/astm/f3411/v19.md)** and **[astm.f3411.v19.NET0340](../../../../requirements/astm/f3411/v19.md)** require a Service Provider to implement the P2P portion of the OpenAPI specification. This check will fail if the response to the /flights endpoint does not validate against the OpenAPI-specified schema. @@ -82,10 +58,6 @@ This implies that any recent position outside the area must be either preceded o (This check validates NET0270 b and c). -#### ⚠️ Successful flight details query check - -**[astm.f3411.v19.NET0710,2](../../../../requirements/astm/f3411/v19.md)** and **[astm.f3411.v19.NET0340](../../../../requirements/astm/f3411/v19.md)** require a Service Provider to implement the GET flight details endpoint. This check will fail if uss_qualifier cannot query that endpoint (specified in the ISA present in the DSS) successfully. - #### ⚠️ Flight details data format check **[astm.f3411.v19.NET0710,2](../../../../requirements/astm/f3411/v19.md)** and **[astm.f3411.v19.NET0340](../../../../requirements/astm/f3411/v19.md)** require a Service Provider to implement the P2P portion of the OpenAPI specification. This check will fail if the response to the flight details endpoint does not validate against the OpenAPI-specified schema. diff --git a/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/fragments/flight_injection.md b/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/fragments/flight_injection.md new file mode 100644 index 0000000000..b4f4a767c4 --- /dev/null +++ b/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/fragments/flight_injection.md @@ -0,0 +1,24 @@ +# Flight injection test step fragment + +This test step fragment documents the injection of test flights. + +In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps. + +## 🛑 Successful injection check + +Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test. + +**[astm.f3411.v22a.NET0500](../../../../../requirements/astm/f3411/v22a.md)** requires a Service Provider to provide a persistently supported test instance of their implementation. +This check will fail if the flight was not successfully injected. + +## 🛑 Identifiable flights check + +This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data. + + +## Valid flight check + +TODO: Validate injected flights, especially to make sure they contain the specified injection IDs + +Per **[interuss.automated_testing.rid.injection.UpsertTestResult](../../../../../requirements/interuss/automated_testing/rid/injection.md)**, the NetRID Service Provider under test should only make valid modifications to the injected flights. This includes: +* A flight with the specified injection ID must be returned. diff --git a/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/fragments/sp_polling.md b/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/fragments/sp_polling.md new file mode 100644 index 0000000000..bb6e50a6ef --- /dev/null +++ b/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/fragments/sp_polling.md @@ -0,0 +1,13 @@ +# Service provider polling test step fragment + +uss_qualifier acts as a Display Provider to query Service Providers under test in this step. + +## ⚠️ ISA query check + +**[interuss.f3411.dss_endpoints.SearchISAs](../../../../../requirements/interuss/f3411/dss_endpoints.md)** requires a USS providing a DSS instance to implement the DSS endpoints of the OpenAPI specification. If uss_qualifier is unable to query the DSS for ISAs, this check will fail. + +## ⚠️ Successful flight details query check + +**[astm.f3411.v22a.NET0710,2](../../../../../requirements/astm/f3411/v22a.md)** and **[astm.f3411.v22a.NET0340](../../../../../requirements/astm/f3411/v22a.md) require a Service Provider to implement the GET flight details endpoint. This check will fail if uss_qualifier cannot query that endpoint (specified in the ISA present in the DSS) successfully. + +## [Flight presence checks](../display_data_evaluator_flight_presence.md) diff --git a/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/misbehavior.md b/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/misbehavior.md index f66c40f0c3..8d7653a7eb 100644 --- a/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/misbehavior.md +++ b/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/misbehavior.md @@ -24,20 +24,7 @@ A [`DSSInstanceResource`](../../../../resources/astm/f3411/dss.py) is required f ## Unauthenticated requests test case -### Injection test step - -In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps. - -#### 🛑 Successful injection check - -Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test. - -**[astm.f3411.v22a.NET0500](../../../../requirements/astm/f3411/v22a.md)** requires a Service Provider to provide a persistently supported test instance of their implementation. -This check will fail if the flight was not successfully injected. - -#### 🛑 Identifiable flights check - -This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data. +### [Injection test step](./fragments/flight_injection.md) ### Unauthenticated requests test step diff --git a/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/nominal_behavior.md b/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/nominal_behavior.md index 068a27e2ec..4e4688844c 100644 --- a/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/nominal_behavior.md +++ b/monitoring/uss_qualifier/scenarios/astm/netrid/v22a/nominal_behavior.md @@ -28,42 +28,16 @@ If specified, uss_qualifier will act as a Display Provider and check a DSS insta ## Nominal flight test case -### Injection test step +### [Injection test step](./fragments/flight_injection.md) -In this step, uss_qualifier injects a single nominal flight into each SP under test, usually with a start time in the future. Each SP is expected to queue the provided telemetry and later simulate that telemetry coming from an aircraft at the designated timestamps. - -#### 🛑 Successful injection check - -Per **[interuss.automated_testing.rid.injection.UpsertTestSuccess](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the injection attempt of the valid flight should succeed for every NetRID Service Provider under test. - -**[astm.f3411.v22a.NET0500](../../../../requirements/astm/f3411/v22a.md)** requires a Service Provider to provide a persistently supported test instance of their implementation. -This check will fail if the flight was not successfully injected. - -#### Valid flight check - -TODO: Validate injected flights, especially to make sure they contain the specified injection IDs - -Per **[interuss.automated_testing.rid.injection.UpsertTestResult](../../../../requirements/interuss/automated_testing/rid/injection.md)**, the NetRID Service Provider under test should only make valid modifications to the injected flights. This includes: -* A flight with the specified injection ID must be returned. - -#### 🛑 Identifiable flights check - -This particular test requires each flight to be uniquely identifiable by its 2D telemetry position; the same (lat, lng) pair may not appear in two different telemetry points, even if the two points are in different injected flights. This should generally be achieved by injecting appropriate data. - -### Service Provider polling test step +### [Service Provider polling test step](./fragments/sp_polling.md) If a DSS was provided to this test scenario, uss_qualifier acts as a Display Provider to query Service Providers under test in this step. -#### ⚠️ ISA query check - -**[interuss.f3411.dss_endpoints.SearchISAs](../../../../requirements/interuss/f3411/dss_endpoints.md)** requires a USS providing a DSS instance to implement the DSS endpoints of the OpenAPI specification. If uss_qualifier is unable to query the DSS for ISAs, this check will fail. - #### ⚠️ Area too large check **[astm.f3411.v22a.NET0250](../../../../requirements/astm/f3411/v22a.md)** requires that a NetRID Service Provider rejects a request for a very large view area with a diagonal greater than *NetMaxDisplayAreaDiagonal*. If such a large view is requested and a 413 error code is not received, then this check will fail. -#### [Flight presence checks](./display_data_evaluator_flight_presence.md) - #### ⚠️ Flights data format check **[astm.f3411.v22a.NET0710,1](../../../../requirements/astm/f3411/v22a.md)** and **[astm.f3411.v22a.NET0340](../../../../requirements/astm/f3411/v22a.md)** requires a Service Provider to implement the P2P portion of the OpenAPI specification. This check will fail if the response to the /flights endpoint does not validate against the OpenAPI-specified schema. @@ -82,10 +56,6 @@ This implies that any recent position outside the area must be either preceded o (This check validates NET0270 b and c). -#### ⚠️ Successful flight details query check - -**[astm.f3411.v22a.NET0710,2](../../../../requirements/astm/f3411/v22a.md)** and **[astm.f3411.v22a.NET0340](../../../../requirements/astm/f3411/v22a.md) require a Service Provider to implement the GET flight details endpoint. This check will fail if uss_qualifier cannot query that endpoint (specified in the ISA present in the DSS) successfully. - #### ⚠️ Flight details data format check **[astm.f3411.v22a.NET0710,2](../../../../requirements/astm/f3411/v22a.md)** and **[astm.f3411.v22a.NET0340](../../../../requirements/astm/f3411/v22a.md) require a Service Provider to implement the P2P portion of the OpenAPI specification. This check will fail if the response to the flight details endpoint does not validate against the OpenAPI-specified schema. diff --git a/monitoring/uss_qualifier/suites/astm/netrid/f3411_22a.md b/monitoring/uss_qualifier/suites/astm/netrid/f3411_22a.md index ca7e03fcd7..044ad1b9d1 100644 --- a/monitoring/uss_qualifier/suites/astm/netrid/f3411_22a.md +++ b/monitoring/uss_qualifier/suites/astm/netrid/f3411_22a.md @@ -550,7 +550,7 @@ UpsertTestResult TODO - ASTM NetRID nominal behavior + ASTM NetRID SP clients misbehavior handling
ASTM NetRID nominal behavior UpsertTestSuccess diff --git a/monitoring/uss_qualifier/suites/uspace/network_identification.md b/monitoring/uss_qualifier/suites/uspace/network_identification.md index fed28dc075..90f5229b2d 100644 --- a/monitoring/uss_qualifier/suites/uspace/network_identification.md +++ b/monitoring/uss_qualifier/suites/uspace/network_identification.md @@ -546,7 +546,7 @@ UpsertTestResult TODO - ASTM NetRID nominal behavior + ASTM NetRID SP clients misbehavior handling
ASTM NetRID nominal behavior UpsertTestSuccess diff --git a/monitoring/uss_qualifier/suites/uspace/required_services.md b/monitoring/uss_qualifier/suites/uspace/required_services.md index 1a19da1b8b..08a021cc06 100644 --- a/monitoring/uss_qualifier/suites/uspace/required_services.md +++ b/monitoring/uss_qualifier/suites/uspace/required_services.md @@ -969,7 +969,7 @@ UpsertTestResult TODO - ASTM NetRID nominal behavior + ASTM NetRID SP clients misbehavior handling
ASTM NetRID nominal behavior UpsertTestSuccess