Conformance Testing Software

Location

The test suite can be found in the "Code" section of the repository.

Operating Environment

Hardware/Virtual Machine

• 2 CPU/vCPU
• Minimum 2GB recommended
• Minimum 50GB storage (dependent on expected log level, report volume, and retention policy)

Operating System

• Ubuntu 24.04 LTS is recommended.
• Other versions of Linux should also work, but have not been tested.

Installation

• Prerequisites
• Test Suite

Configuration

• Test Configuration
• Lab Configuration
• Launch Configuration
• Run Configuration (Optional)

Man Pages

• validate
  • The validate command is used before running the test suite to validate the various info and config files used as input by the test suite.
• main
  • The main command is used to execute the test suite.
• gen-report
  • The gen-report command can be used after a test campaign to generate an additional report, such as in a different format, or with more or less detail.

Output

The launch_config file specifies the directory path where all output from the test campaign will be stored. This output includes everything needed to audit the test campaign at a later date:

• all info files used: lab_info.yaml, test_info.yaml
• all config files used: launch_config.yaml, lab_config.yaml, test_config.yaml, run_config.yaml
• all logs
• all packet capture files
• all console output
• all report files in the configured format(s):
  • PDF and DOCX: summary or detailed reports for humans
  • XML(JUnitXML): for CI/CD integration
  • JSON & CSV: for data analysis