You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The goal of this issue is to set up a test flow to verify success or failure. The success of the test will be determined based on the results of the workflow execution, clearly distinguishing between success and failure.
Current System State
A Runner has been implemented under the testing package to execute tests and deliver results. This component handles the running of workflows and manages their success or failure based on the provided configurations.
Proposed Changes
To improve the test flow and verification, the following modifications are suggested:
Test Success Verification (Basic Example)
kind: testports:
out:
- name: subport: in
If the sub workflow does not respond with an error, the test is considered successful. If an error is returned, the test is considered failed.
The sub workflow connected to out[0] is executed, and the result is checked to determine the success of the test.
The validation node connected to out[1] receives [index, value] as inputs. Here, index represents the position of value in the frame, and value defines the payload of the packet to verify. Initially, index is set to -1, and value holds the result of the sub workflow execution.
If the validation node fails, an error response is returned, and the test is considered failed.
Additional Information
In order to improve test reliability, it may be beneficial to add more detailed error handling, providing better context for failure scenarios. Additionally, implementing logging for the Runner could enhance the visibility of the test flow, making it easier to debug issues and track the success or failure of individual components within the workflow.
The text was updated successfully, but these errors were encountered:
Objective
The goal of this issue is to set up a test flow to verify success or failure. The success of the test will be determined based on the results of the workflow execution, clearly distinguishing between success and failure.
Current System State
A
Runner
has been implemented under thetesting
package to execute tests and deliver results. This component handles the running of workflows and manages their success or failure based on the provided configurations.Proposed Changes
To improve the test flow and verification, the following modifications are suggested:
Test Success Verification (Basic Example)
If the
sub
workflow does not respond with an error, the test is considered successful. If an error is returned, the test is considered failed.Test Success Verification (Extended Example)
The
sub
workflow connected toout[0]
is executed, and the result is checked to determine the success of the test.The validation node connected to
out[1]
receives[index, value]
as inputs. Here,index
represents the position ofvalue
in the frame, andvalue
defines the payload of the packet to verify. Initially,index
is set to-1
, andvalue
holds the result of thesub
workflow execution.If the validation node fails, an error response is returned, and the test is considered failed.
Additional Information
In order to improve test reliability, it may be beneficial to add more detailed error handling, providing better context for failure scenarios. Additionally, implementing logging for the
Runner
could enhance the visibility of the test flow, making it easier to debug issues and track the success or failure of individual components within the workflow.The text was updated successfully, but these errors were encountered: