Zarhus #1129

m-iwanicki · 2025-10-10T15:02:30Z

robot -L TRACE -b cmd_logs.txt -v rte_ip:127.0.0.1 -v config:qemu -v snipeit:no \
    -v boot_dts_from_ipxe_shell:True \
    -v dts_ipxe_link:https://boot.dasharo.com/dts/dts-rc.ipxe \
    -v features:encryption,otab \
    -v zarhus_wic_gz_file:../yocto/zarhus/zarhus-base-image-genericx86-64.rootfs.wic.gz \
    -v zarhus_swu_file:../yocto/zarhus/zarhus-swu-image-genericx86-64.rootfs.swu \
    zarhus-x86/zarhus.robot

Results:

==============================================================================
Zarhus
==============================================================================
ZHS001.206 Make sure that cukinia tests pass                          | PASS |
------------------------------------------------------------------------------
ZHS002.206 Make sure that update works :: Make sure that update vi... | PASS |
------------------------------------------------------------------------------
ZHS003.206 Make sure that failed update rollbacks to working slot ... | PASS |
------------------------------------------------------------------------------
ZHS004.206 Make sure that rollback works :: Make sure that `otab r... | PASS |
------------------------------------------------------------------------------
Zarhus                                                                | PASS |
4 tests, 4 passed, 0 failed
==============================================================================

log.html

On hardware:

robot -L TRACE -b cmd_logs.txt -v rte_ip:192.168.10.168 -v config:odroid-h4-plus -v snipeit:no \
    -v boot_dts_from_ipxe_shell:True \
    -v dts_ipxe_link:https://boot.dasharo.com/dts/dts-rc.ipxe \
    -v features:encryption,otab \
    -v zarhus_wic_gz_file:../yocto/zarhus/zarhus-base-image-genericx86-64.rootfs.wic.gz \
    -v target_device:nvme0n1 -t "ZHS001*" zarhus-x86/zarhus.robot

==============================================================================
Zarhus
==============================================================================
ZHS001.206 Make sure that cukinia tests pass                          | PASS |
------------------------------------------------------------------------------
Zarhus                                                                | PASS |
1 test, 1 passed, 0 failed
==============================================================================

log.html

robot -L TRACE -b command_log.txt -v rte_ip:192.168.10.168 -v config:odroid-h4-plus -v snipeit:no \
    -v boot_dts_from_ipxe_shell:True \
    -v dts_ipxe_link:https://boot.dasharo.com/dts/dts-rc.ipxe \
    -v features:encryption,otab \
    -v zarhus_bootstrap_file:../yocto/zarhus-dtrpb/bootstrap.img \
    zarhus-x86/zarhus-provisioning-preparation.robot

==============================================================================
Zarhus-Provisioning-Preparation
==============================================================================
ZPBP001.101 Make sure that network boot is disabled :: Make sure t... | PASS |
------------------------------------------------------------------------------
ZPBP002.101 Make sure that BIOS boot medium is locked :: Make sure... | PASS |
------------------------------------------------------------------------------
ZPBP003.101 Make sure that SMM BIOS write protection is enabled ::... | PASS |
------------------------------------------------------------------------------
ZPBP004.101 Make sure that Intel ME is HAP disabled :: Make sure t... | PASS |
------------------------------------------------------------------------------
ZPBP005.101 Make sure that OptionROM loading is disabled :: Make s... | PASS |
------------------------------------------------------------------------------
ZPBP006.206 Make sure that zarhus status returns expected initial ... | PASS |
------------------------------------------------------------------------------
ZPBP006.206 Make sure that Secure Boot is in Setup Mode :: Make su... | FAIL |
'Installed:      ✗ sbctl is not installed
Setup Mode:     ✗ Enabled
Secure Boot:    ✗ Disabled
Vendor Keys:    none' does not match 'Setup Mode:*Enabled'
------------------------------------------------------------------------------
Zarhus-Provisioning-Preparation                                       | FAIL |
7 tests, 6 passed, 1 failed
==============================================================================

After fix:

==============================================================================
ZPBP006.206 Make sure that zarhus status returns expected initial ... | PASS |
------------------------------------------------------------------------------
ZPBP006.206 Make sure that Secure Boot is in Setup Mode :: Make su... | PASS |
Secure Boot is in Setup Mode
------------------------------------------------------------------------------
Zarhus-Provisioning-Preparation                                       | PASS |
2 tests, 2 passed, 0 failed
==============================================================================

And second fix later to change ZPBP006 -> ZPBP007

Couldn't test zarhus-provisioning.robot as Suite preparation fails in Setup ZPB keyword, Should Contain ${status} Boot Guard: Enabled to be exact. For some reason capsule update doesn't work.

On QEMU:

==============================================================================
Zarhus-Provisioning
==============================================================================
ZPB001.206 Make sure that cukinia tests pass                          | PASS |
------------------------------------------------------------------------------
Zarhus-Provisioning                                                   | PASS |
1 test, 1 passed, 0 failed
==============================================================================

lib/zarhus-lib.robot

docs/zarhus-tests.md

lib/zarhus-provision-lib.robot

lib/zarhus-lib.robot

os-config/206-credentials.py

lib/usb-hid-msc-lib.robot

zarhus-x86/zarhus-provisioning-preparation.robot

lib/zarhus-lib.robot

lib/QemuMonitor.py

docs/zarhus-tests.md

lib/zarhus-provision-lib.robot

lib/zarhus-lib.robot

3mkusiak

Contentwise looks good to me, small nitpicks for now. I'll proceed to running tests.

docs/zarhus-tests.md

lib/usb-hid-msc-lib.robot

docs/zarhus-tests.md

3mkusiak · 2025-10-21T14:54:55Z

Tested provisioning box on hardware, details below

HW PROV.BOX

All tests have passed beside one

(venv) mkusiak in ~/Development/dts/open-source-firmware-validation on zarhus ● λ robot -L TRACE -b command_log.txt -v rte_ip:192.168.10.168 -v config:odroid-h4-plus -v snipeit:no -v boot_dts_from_ipxe_shell:True \
    -v dts_ipxe_link:https://boot.dasharo.com/dts/dts-rc.ipxe \
    -v features:encryption,otab \
    -v zarhus_bootstrap_file:"$bootstrap" \
    zarhus-x86/zarhus-provisioning-preparation.robot
==============================================================================
Zarhus-Provisioning-Preparation                                               
==============================================================================
ZPBP001.101 Make sure that network boot is disabled :: Make sure t... | PASS |
------------------------------------------------------------------------------
ZPBP002.101 Make sure that BIOS boot medium is locked :: Make sure... | PASS |
------------------------------------------------------------------------------
ZPBP003.101 Make sure that SMM BIOS write protection is enabled ::... | PASS |
------------------------------------------------------------------------------
ZPBP004.101 Make sure that Intel ME is HAP disabled :: Make sure t... | PASS |
------------------------------------------------------------------------------
ZPBP005.101 Make sure that OptionROM loading is disabled :: Make s... | PASS |
------------------------------------------------------------------------------
ZPBP006.206 Make sure that zarhus status returns expected initial ... | FAIL |
low != high
------------------------------------------------------------------------------
ZPBP007.206 Make sure that Secure Boot is in Setup Mode :: Make su... | PASS |
Secure Boot is in Setup Mode
------------------------------------------------------------------------------
Zarhus-Provisioning-Preparation                                       | FAIL |
7 tests, 6 passed, 1 failed
==============================================================================
Debug:   /home/mkusiak/Development/dts/open-source-firmware-validation/command_log.txt
Output:  /home/mkusiak/Development/dts/open-source-firmware-validation/output.xml
Log:     /home/mkusiak/Development/dts/open-source-firmware-validation/log.html
Report:  /home/mkusiak/Development/dts/open-source-firmware-validation/report.html

One of the tests failed due to improper state of power LED, this is a known issue.

Will proceed to test zarhus os.

3mkusiak · 2025-10-22T08:52:41Z

Hardware ZarhusOS tests pass

ZarhusOS HW

==============================================================================
Zarhus                                                                        
==============================================================================
ZHS001.206 Make sure that cukinia tests pass                          | PASS |
------------------------------------------------------------------------------
Zarhus                                                                | PASS |
1 test, 1 passed, 0 failed
==============================================================================
Debug:   /home/mkusiak/Development/dts/open-source-firmware-validation/command_log.txt
Output:  /home/mkusiak/Development/dts/open-source-firmware-validation/output.xml
Log:     /home/mkusiak/Development/dts/open-source-firmware-validation/log.html
Report:  /home/mkusiak/Development/dts/open-source-firmware-validation/report.html

Will try qemu next

3mkusiak · 2025-10-22T10:32:34Z

Rerun full test set this time, all tests do pass.

ZarhusOS full scope HW

==============================================================================
Zarhus                                                                        
==============================================================================
ZHS001.206 Make sure that cukinia tests pass                          | PASS |
------------------------------------------------------------------------------
ZHS002.206 Make sure that update works :: Make sure that update vi... | PASS |
------------------------------------------------------------------------------
ZHS003.206 Make sure that failed update rollbacks to working slot ... | PASS |
------------------------------------------------------------------------------
ZHS004.206 Make sure that rollback works :: Make sure that `otab r... | PASS |
------------------------------------------------------------------------------
Zarhus                                                                | PASS |
4 tests, 4 passed, 0 failed
==============================================================================
Debug:   /home/mkusiak/Development/dts/open-source-firmware-validation/command_log.
Output:  /home/mkusiak/Development/dts/open-source-firmware-validation/output.xml
Log:     /home/mkusiak/Development/dts/open-source-firmware-validation/log.html
Report:  /home/mkusiak/Development/dts/open-source-firmware-validation/report.html

Skipping doing tests on QEMU, waste of time if hardware works.

docs/zarhus-tests.md

3mkusiak

LGTM

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

…or Zarhus Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

Used to run commands and check if they succeeded Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

Example on Dasharo v0.9.1 on ODROID-H4+: ``` Enable SMM BIOS write [X] protection ``` Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

3mkusiak · 2025-10-23T12:40:13Z

Rebased on top of develop. Waiting for checks to complete.

m-iwanicki self-assigned this Oct 10, 2025

m-iwanicki force-pushed the zarhus branch 2 times, most recently from 81e1101 to d980f3a Compare October 14, 2025 17:12

iwanicki92 reviewed Oct 14, 2025

View reviewed changes

docs/zarhus-tests.md Outdated Show resolved Hide resolved

docs/zarhus-tests.md Outdated Show resolved Hide resolved

iwanicki92 reviewed Oct 14, 2025

View reviewed changes

lib/zarhus-provision-lib.robot Show resolved Hide resolved

m-iwanicki force-pushed the zarhus branch 3 times, most recently from eb5b7b8 to 7bbb1c9 Compare October 15, 2025 16:53

m-iwanicki marked this pull request as ready for review October 15, 2025 16:53

m-iwanicki force-pushed the zarhus branch 6 times, most recently from c35aab7 to c02c919 Compare October 15, 2025 17:57

iwanicki92 reviewed Oct 19, 2025

View reviewed changes

lib/zarhus-lib.robot Outdated Show resolved Hide resolved

m-iwanicki force-pushed the zarhus branch 2 times, most recently from ee3d0b4 to 2114774 Compare October 20, 2025 07:34

3mkusiak reviewed Oct 21, 2025

View reviewed changes

docs/zarhus-tests.md Outdated Show resolved Hide resolved

docs/zarhus-tests.md Outdated Show resolved Hide resolved

lib/usb-hid-msc-lib.robot Show resolved Hide resolved

3mkusiak reviewed Oct 21, 2025

View reviewed changes

docs/zarhus-tests.md Show resolved Hide resolved

m-iwanicki force-pushed the zarhus branch from 2114774 to 821849f Compare October 21, 2025 15:41

3mkusiak requested changes Oct 22, 2025

View reviewed changes

docs/zarhus-tests.md Outdated Show resolved Hide resolved

docs/zarhus-tests.md Show resolved Hide resolved

docs/zarhus-tests.md Outdated Show resolved Hide resolved

m-iwanicki force-pushed the zarhus branch 2 times, most recently from d10cc63 to 39daed0 Compare October 23, 2025 08:46

3mkusiak approved these changes Oct 23, 2025

View reviewed changes

lib: QemuMonitor: Allow adding removable and writable USB

275f9d1

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

m-iwanicki added 14 commits October 23, 2025 14:38

lib: QemuMonitor: Add keyword to remove added USB

f0f4663

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

dts-lib: move checkpoint keywords to separate lib so it can be used f…

55f24aa

…or Zarhus Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

zarhus-lib: Add basic keywords for OS preparation and credentials

4cb36c3

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

lib: network: make Send File To DUT work on OS without root access

16b70e0

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

lib: terminal: Add Execute Command In Terminal Should Succeed keyword

f20e094

Used to run commands and check if they succeeded Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

zarhus-x86: zarhus.robot: add cukinia test and couple update tests

6ddfa37

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

docs: zarhus-tests: Add documentation related to Zarhus OS testing

d1e59d7

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

lib: network: add 'Send File To DUT Directly' keyword

97d31c9

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

lib: menus.py: Add 'OptionROM Execution Policy' option

167f1bf

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

lib: options-lib_uefi-setup-menu: fix Get UEFI Option Documentation

2686f11

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

lib: usb-hid-msc-lib: add keyword to return first USB stick

7bd58ea

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

lib/bios/menus.py: SMM BIOS write protection is split in 2 lines

46801bc

Example on Dasharo v0.9.1 on ODROID-H4+: ``` Enable SMM BIOS write [X] protection ``` Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

lib: zarhus-provision-lib: Add keywords to use with ZPB

c7994ad

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

zarhus: zarhus-provisioning: Add tests for preparation and cukinia

fcc1987

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

3mkusiak force-pushed the zarhus branch from 39daed0 to fcc1987 Compare October 23, 2025 12:39

3mkusiak merged commit fcc1987 into develop Oct 23, 2025
2 checks passed

3mkusiak deleted the zarhus branch October 23, 2025 12:46

Uh oh!

Uh oh!

Zarhus #1129

Zarhus #1129

Uh oh!

Conversation

m-iwanicki commented Oct 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

3mkusiak left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

3mkusiak commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

3mkusiak commented Oct 22, 2025

Uh oh!

3mkusiak commented Oct 22, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

3mkusiak left a comment

Choose a reason for hiding this comment

Uh oh!

3mkusiak commented Oct 23, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

m-iwanicki commented Oct 10, 2025 •

edited

Loading

3mkusiak commented Oct 21, 2025 •

edited

Loading