Skip to content

Commit

Permalink
Include a TAP 'To do' (aka expected failures) column
Browse files Browse the repository at this point in the history
  • Loading branch information
@pcolby
pcolby committed Jan 10, 2025
1 parent aad0192 commit e19cb9f
Show file tree
Hide file tree
Showing 6 changed files with 125 additions and 125 deletions.
70 changes: 35 additions & 35 deletions .github/workflows/expected/default.md
View file
Original file line number Diff line number Diff line change
@@ -1,35 +1,35 @@
| Test result | Passed | Failed | Skipped | Test name |
|:------------------------|-------:|-------:|--------:|:-------------------------|
| :heavy_check_mark: pass | 5 | 0 | 0 | bml.log |
| :heavy_check_mark: pass | 6 | 0 | 0 | bt_cmd.log |
| :x: fail | 320 | 5 | 0 | bt_core.log |
| :x: fail | 3 | 110 | 0 | bt_edit.log |
| :heavy_check_mark: pass | 95 | 0 | 0 | bt_gst.log |
| :heavy_check_mark: pass | 15 | 0 | 0 | bt_ic.log |
| :heavy_check_mark: pass | 16684 | 0 | 182 | TestAbstractCommand |
| :heavy_check_mark: pass | 6062 | 0 | 192 | TestAbstractPokitService |
| :heavy_check_mark: pass | 4042 | 0 | 0 | TestCalibrateCommand |
| :heavy_check_mark: pass | 2330 | 0 | 48 | TestCalibrationService |
| :heavy_check_mark: pass | 13406 | 0 | 0 | TestDataLoggerService |
| :heavy_check_mark: pass | 22328 | 0 | 48 | TestDeviceCommand |
| :heavy_check_mark: pass | 3614 | 0 | 0 | TestDeviceInfoService |
| :heavy_check_mark: pass | 13168 | 0 | 96 | TestDsoCommand |
| :heavy_check_mark: pass | 11486 | 0 | 0 | TestDsoService |
| :heavy_check_mark: pass | 2084 | 0 | 0 | TestFlashLedCommand |
| :heavy_check_mark: pass | 756 | 0 | 0 | TestGenericAccessService |
| :heavy_check_mark: pass | 4234 | 0 | 48 | TestInfoCommand |
| :heavy_check_mark: pass | 10944 | 0 | 48 | TestLoggerFetchCommand |
| :heavy_check_mark: pass | 5644 | 0 | 0 | TestLoggerStartCommand |
| :heavy_check_mark: pass | 1550 | 0 | 0 | TestLoggerStopCommand |
| :heavy_check_mark: pass | 11460 | 0 | 48 | TestMeterCommand |
| :heavy_check_mark: pass | 14820 | 0 | 0 | TestMultimeterService |
| :heavy_check_mark: pass | 10956 | 0 | 96 | TestPokitDevice |
| :heavy_check_mark: pass | 5094 | 0 | 0 | TestPokitDiscoveryAgent |
| :heavy_check_mark: pass | 12104 | 0 | 0 | TestPokitMeter |
| :heavy_check_mark: pass | 17978 | 0 | 0 | TestPokitPro |
| :heavy_check_mark: pass | 10508 | 0 | 96 | TestPokitProducts |
| :heavy_check_mark: pass | 64598 | 0 | 48 | TestScanCommand |
| :heavy_check_mark: pass | 2796 | 0 | 0 | TestSetNameCommand |
| :heavy_check_mark: pass | 2670 | 0 | 0 | TestSetTorchCommand |
| :heavy_check_mark: pass | 2672 | 0 | 96 | TestStatusCommand |
| :heavy_check_mark: pass | 16940 | 0 | 6 | TestStatusService |
| Test result | Passed | Failed | Skipped | To do | Test name |
|:------------------------|-------:|-------:|--------:|------:|:-------------------------|
| :heavy_check_mark: pass | 5 | 0 | 0 | 0 | bml.log |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | bt_cmd.log |
| :x: fail | 320 | 5 | 0 | 0 | bt_core.log |
| :x: fail | 3 | 110 | 0 | 0 | bt_edit.log |
| :heavy_check_mark: pass | 95 | 0 | 0 | 0 | bt_gst.log |
| :heavy_check_mark: pass | 15 | 0 | 0 | 0 | bt_ic.log |
| :heavy_check_mark: pass | 16684 | 0 | 182 | 0 | TestAbstractCommand |
| :heavy_check_mark: pass | 6062 | 0 | 192 | 0 | TestAbstractPokitService |
| :heavy_check_mark: pass | 4042 | 0 | 0 | 0 | TestCalibrateCommand |
| :heavy_check_mark: pass | 2330 | 0 | 48 | 0 | TestCalibrationService |
| :heavy_check_mark: pass | 13406 | 0 | 0 | 0 | TestDataLoggerService |
| :heavy_check_mark: pass | 22328 | 0 | 48 | 0 | TestDeviceCommand |
| :heavy_check_mark: pass | 3614 | 0 | 0 | 0 | TestDeviceInfoService |
| :heavy_check_mark: pass | 13168 | 0 | 96 | 0 | TestDsoCommand |
| :heavy_check_mark: pass | 11486 | 0 | 0 | 0 | TestDsoService |
| :heavy_check_mark: pass | 2084 | 0 | 0 | 0 | TestFlashLedCommand |
| :heavy_check_mark: pass | 756 | 0 | 0 | 0 | TestGenericAccessService |
| :heavy_check_mark: pass | 4234 | 0 | 48 | 258 | TestInfoCommand |
| :heavy_check_mark: pass | 10944 | 0 | 48 | 0 | TestLoggerFetchCommand |
| :heavy_check_mark: pass | 5644 | 0 | 0 | 0 | TestLoggerStartCommand |
| :heavy_check_mark: pass | 1550 | 0 | 0 | 0 | TestLoggerStopCommand |
| :heavy_check_mark: pass | 11460 | 0 | 48 | 0 | TestMeterCommand |
| :heavy_check_mark: pass | 14820 | 0 | 0 | 0 | TestMultimeterService |
| :heavy_check_mark: pass | 10956 | 0 | 96 | 0 | TestPokitDevice |
| :heavy_check_mark: pass | 5094 | 0 | 0 | 0 | TestPokitDiscoveryAgent |
| :heavy_check_mark: pass | 12104 | 0 | 0 | 0 | TestPokitMeter |
| :heavy_check_mark: pass | 17978 | 0 | 0 | 0 | TestPokitPro |
| :heavy_check_mark: pass | 10508 | 0 | 96 | 0 | TestPokitProducts |
| :heavy_check_mark: pass | 64598 | 0 | 48 | 0 | TestScanCommand |
| :heavy_check_mark: pass | 2796 | 0 | 0 | 0 | TestSetNameCommand |
| :heavy_check_mark: pass | 2670 | 0 | 0 | 0 | TestSetTorchCommand |
| :heavy_check_mark: pass | 2672 | 0 | 96 | 0 | TestStatusCommand |
| :heavy_check_mark: pass | 16940 | 0 | 6 | 0 | TestStatusService |
50 changes: 25 additions & 25 deletions .github/workflows/expected/path.md
View file
Original file line number Diff line number Diff line change
@@ -1,25 +1,25 @@
| Test result | Passed | Failed | Skipped | Test name |
|:------------------------|-------:|-------:|--------:|:-------------------------|
| :heavy_check_mark: pass | 116 | 0 | 26 | TestAbstractCommand |
| :heavy_check_mark: pass | 52 | 0 | 0 | TestAbstractPokitService |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestCalibrateCommand |
| :heavy_check_mark: pass | 20 | 0 | 0 | TestCalibrationService |
| :heavy_check_mark: pass | 186 | 0 | 0 | TestDataLoggerService |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestDeviceCommand |
| :heavy_check_mark: pass | 28 | 0 | 0 | TestDeviceInfoService |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestDsoCommand |
| :heavy_check_mark: pass | 174 | 0 | 0 | TestDsoService |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestFlashLedCommand |
| :heavy_check_mark: pass | 36 | 0 | 0 | TestGenericAccessService |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestInfoCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestLoggerFetchCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestLoggerStartCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestLoggerStopCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestMeterCommand |
| :heavy_check_mark: pass | 248 | 0 | 0 | TestMultimeterService |
| :heavy_check_mark: pass | 94 | 0 | 0 | TestPokitDevice |
| :heavy_check_mark: pass | 90 | 0 | 0 | TestPokitDiscoveryAgent |
| :heavy_check_mark: pass | 490 | 0 | 0 | TestScanCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestSetNameCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | TestStatusCommand |
| :heavy_check_mark: pass | 78 | 0 | 0 | TestStatusService |
| Test result | Passed | Failed | Skipped | To do | Test name |
|:------------------------|-------:|-------:|--------:|------:|:-------------------------|
| :heavy_check_mark: pass | 116 | 0 | 26 | 0 | TestAbstractCommand |
| :heavy_check_mark: pass | 52 | 0 | 0 | 0 | TestAbstractPokitService |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestCalibrateCommand |
| :heavy_check_mark: pass | 20 | 0 | 0 | 0 | TestCalibrationService |
| :heavy_check_mark: pass | 186 | 0 | 0 | 0 | TestDataLoggerService |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestDeviceCommand |
| :heavy_check_mark: pass | 28 | 0 | 0 | 0 | TestDeviceInfoService |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestDsoCommand |
| :heavy_check_mark: pass | 174 | 0 | 0 | 0 | TestDsoService |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestFlashLedCommand |
| :heavy_check_mark: pass | 36 | 0 | 0 | 0 | TestGenericAccessService |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestInfoCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestLoggerFetchCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestLoggerStartCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestLoggerStopCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestMeterCommand |
| :heavy_check_mark: pass | 248 | 0 | 0 | 0 | TestMultimeterService |
| :heavy_check_mark: pass | 94 | 0 | 0 | 0 | TestPokitDevice |
| :heavy_check_mark: pass | 90 | 0 | 0 | 0 | TestPokitDiscoveryAgent |
| :heavy_check_mark: pass | 490 | 0 | 0 | 0 | TestScanCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestSetNameCommand |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | TestStatusCommand |
| :heavy_check_mark: pass | 78 | 0 | 0 | 0 | TestStatusService |
8 changes: 4 additions & 4 deletions summary.gawk
View file
Original file line number Diff line number Diff line change
Expand Up @@ -63,14 +63,14 @@ function setTestName(name) {
END {
nameDashes = "-"
while (length(nameDashes) < maxNameLength) nameDashes = nameDashes "-"
printf "| Test result | Passed | Failed | Skipped | %-*s |\n", maxNameLength, "Test name"
printf "|:------------------------|-------:|-------:|--------:|:%*s-|\n", maxNameLength, nameDashes
printf "| Test result | Passed | Failed | Skipped | To do | %-*s |\n", maxNameLength, "Test name"
printf "|:------------------------|-------:|-------:|--------:|------:|:%*s-|\n", maxNameLength, nameDashes
PROCINFO["sorted_in"] = "@ind_str_asc"
for (name in tests) {
printf "| %-18s %4s | %6u | %6u | %7u | %-*s |\n",
printf "| %-18s %4s | %6u | %6u | %7u | %5u | %-*s |\n",
(tests[name]["fail"]) ? ":x:" : ":heavy_check_mark:",
(tests[name]["fail"]) ? "fail" : "pass",
tests[name]["pass"], tests[name]["fail"], tests[name]["skip"],
tests[name]["pass"], tests[name]["fail"], tests[name]["skip"], tests[name]["xfail"],
maxNameLength, name
}
}
16 changes: 8 additions & 8 deletions test/buzztrax-7856445010/expected.md
View file
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
| Test result | Passed | Failed | Skipped | Test name |
|:------------------------|-------:|-------:|--------:|:------------|
| :heavy_check_mark: pass | 5 | 0 | 0 | bml.log |
| :heavy_check_mark: pass | 6 | 0 | 0 | bt_cmd.log |
| :x: fail | 320 | 5 | 0 | bt_core.log |
| :x: fail | 3 | 110 | 0 | bt_edit.log |
| :heavy_check_mark: pass | 95 | 0 | 0 | bt_gst.log |
| :heavy_check_mark: pass | 15 | 0 | 0 | bt_ic.log |
| Test result | Passed | Failed | Skipped | To do | Test name |
|:------------------------|-------:|-------:|--------:|------:|:------------|
| :heavy_check_mark: pass | 5 | 0 | 0 | 0 | bml.log |
| :heavy_check_mark: pass | 6 | 0 | 0 | 0 | bt_cmd.log |
| :x: fail | 320 | 5 | 0 | 0 | bt_core.log |
| :x: fail | 3 | 110 | 0 | 0 | bt_edit.log |
| :heavy_check_mark: pass | 95 | 0 | 0 | 0 | bt_gst.log |
| :heavy_check_mark: pass | 15 | 0 | 0 | 0 | bt_ic.log |
56 changes: 28 additions & 28 deletions test/dokit-12703848093/expected.md
View file
Original file line number Diff line number Diff line change
@@ -1,28 +1,28 @@
| Test result | Passed | Failed | Skipped | Test name |
|:------------------------|-------:|-------:|--------:|:-------------------------|
| :heavy_check_mark: pass | 13884 | 0 | 0 | TestAbstractCommand |
| :heavy_check_mark: pass | 4970 | 0 | 192 | TestAbstractPokitService |
| :heavy_check_mark: pass | 3916 | 0 | 0 | TestCalibrateCommand |
| :heavy_check_mark: pass | 1910 | 0 | 48 | TestCalibrationService |
| :heavy_check_mark: pass | 9500 | 0 | 0 | TestDataLoggerService |
| :heavy_check_mark: pass | 22202 | 0 | 48 | TestDeviceCommand |
| :heavy_check_mark: pass | 3026 | 0 | 0 | TestDeviceInfoService |
| :heavy_check_mark: pass | 13042 | 0 | 96 | TestDsoCommand |
| :heavy_check_mark: pass | 7832 | 0 | 0 | TestDsoService |
| :heavy_check_mark: pass | 1958 | 0 | 0 | TestFlashLedCommand |
| :heavy_check_mark: pass | 4108 | 0 | 48 | TestInfoCommand |
| :heavy_check_mark: pass | 10818 | 0 | 48 | TestLoggerFetchCommand |
| :heavy_check_mark: pass | 5518 | 0 | 0 | TestLoggerStartCommand |
| :heavy_check_mark: pass | 1424 | 0 | 0 | TestLoggerStopCommand |
| :heavy_check_mark: pass | 11334 | 0 | 48 | TestMeterCommand |
| :heavy_check_mark: pass | 9612 | 0 | 0 | TestMultimeterService |
| :heavy_check_mark: pass | 8982 | 0 | 96 | TestPokitDevice |
| :heavy_check_mark: pass | 3204 | 0 | 0 | TestPokitDiscoveryAgent |
| :heavy_check_mark: pass | 12104 | 0 | 0 | TestPokitMeter |
| :heavy_check_mark: pass | 17978 | 0 | 0 | TestPokitPro |
| :heavy_check_mark: pass | 10508 | 0 | 96 | TestPokitProducts |
| :heavy_check_mark: pass | 54308 | 0 | 48 | TestScanCommand |
| :heavy_check_mark: pass | 2670 | 0 | 0 | TestSetNameCommand |
| :heavy_check_mark: pass | 2670 | 0 | 0 | TestSetTorchCommand |
| :heavy_check_mark: pass | 2546 | 0 | 96 | TestStatusCommand |
| :heavy_check_mark: pass | 15302 | 0 | 6 | TestStatusService |
| Test result | Passed | Failed | Skipped | To do | Test name |
|:------------------------|-------:|-------:|--------:|------:|:-------------------------|
| :heavy_check_mark: pass | 13884 | 0 | 0 | 0 | TestAbstractCommand |
| :heavy_check_mark: pass | 4970 | 0 | 192 | 0 | TestAbstractPokitService |
| :heavy_check_mark: pass | 3916 | 0 | 0 | 0 | TestCalibrateCommand |
| :heavy_check_mark: pass | 1910 | 0 | 48 | 0 | TestCalibrationService |
| :heavy_check_mark: pass | 9500 | 0 | 0 | 0 | TestDataLoggerService |
| :heavy_check_mark: pass | 22202 | 0 | 48 | 0 | TestDeviceCommand |
| :heavy_check_mark: pass | 3026 | 0 | 0 | 0 | TestDeviceInfoService |
| :heavy_check_mark: pass | 13042 | 0 | 96 | 0 | TestDsoCommand |
| :heavy_check_mark: pass | 7832 | 0 | 0 | 0 | TestDsoService |
| :heavy_check_mark: pass | 1958 | 0 | 0 | 0 | TestFlashLedCommand |
| :heavy_check_mark: pass | 4108 | 0 | 48 | 258 | TestInfoCommand |
| :heavy_check_mark: pass | 10818 | 0 | 48 | 0 | TestLoggerFetchCommand |
| :heavy_check_mark: pass | 5518 | 0 | 0 | 0 | TestLoggerStartCommand |
| :heavy_check_mark: pass | 1424 | 0 | 0 | 0 | TestLoggerStopCommand |
| :heavy_check_mark: pass | 11334 | 0 | 48 | 0 | TestMeterCommand |
| :heavy_check_mark: pass | 9612 | 0 | 0 | 0 | TestMultimeterService |
| :heavy_check_mark: pass | 8982 | 0 | 96 | 0 | TestPokitDevice |
| :heavy_check_mark: pass | 3204 | 0 | 0 | 0 | TestPokitDiscoveryAgent |
| :heavy_check_mark: pass | 12104 | 0 | 0 | 0 | TestPokitMeter |
| :heavy_check_mark: pass | 17978 | 0 | 0 | 0 | TestPokitPro |
| :heavy_check_mark: pass | 10508 | 0 | 96 | 0 | TestPokitProducts |
| :heavy_check_mark: pass | 54308 | 0 | 48 | 0 | TestScanCommand |
| :heavy_check_mark: pass | 2670 | 0 | 0 | 0 | TestSetNameCommand |
| :heavy_check_mark: pass | 2670 | 0 | 0 | 0 | TestSetTorchCommand |
| :heavy_check_mark: pass | 2546 | 0 | 96 | 0 | TestStatusCommand |
| :heavy_check_mark: pass | 15302 | 0 | 6 | 0 | TestStatusService |
Loading

0 comments on commit e19cb9f

Please sign in to comment.