New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[tests] add new implementation for test case runner #275

Merged

sequencer merged 76 commits into master from testplan

Aug 1, 2023

Contributor

Avimitin commented Jul 29, 2023

This PR includes the below changes:

Add new mill build.sc for test cases
Add new script to generate test cases ELF file and configs.
Allow emulator to accept emulator config, test configs and runtime configs.

sequencer and others added 30 commits

July 28, 2023 20:13


          [build system] add hardfloat to dependency

84f0793


          [test] add vector fpsmoke.asm


          [cosim] support floating point

28af600


          [rtl] add LaneFloat

2f8e95c


          [rtl] connect float unit.

ef2b571

- add tests
- handling of responses from multi-cycle execution units
- add decode for float


          [build system] WIP refactor test builder

52ecde1


          [build system] refactor tests build out

f2c9f21


          [build system] added codegen json files

d81356f


          [build system] fixed mlir config files


          [test] add new script to generate test artifacts

429630e

This script will compile all the tests into elf binaries,
append the elf binary path to the corresponding test config file,
and pack them into a single tarball.

Signed-off-by: Avimitin <dev@avimit.in>


          [test] add new github workflow to handle generating test artifacts

11fc33b

Signed-off-by: Avimitin <dev@avimit.in>


          [rtl] fix parameter initialization when fpuEnable set to false

6fd7f29

Signed-off-by: Avimitin <dev@avimit.in>


          [build system] remove float module parameter in config

ac3fc58

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] add script to generate test artifacts

9748e4f

Signed-off-by: Avimitin <dev@avimit.in>


          [build system] implement test case runner

8d8ebc1

This commit add new object `verilatorEmulator` to generate cross product among emulator config, test config and runtime config.

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] disable server initialization when running script

79b1d30

Signed-off-by: Avimitin <dev@avimit.in>


          [test] add nix derivation for tests output

ae358e0

Signed-off-by: Avimitin <dev@avimit.in>


          [nix] add new build target test-artifact

f8589d9

Signed-off-by: Avimitin <dev@avimit.in>


          [test] use nix to build the codegen binary

09804ba

Signed-off-by: Avimitin <dev@avimit.in>


          [nix] move vector test case into overlay to have nix cache

73ce56d

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] re-package riscv-vector-test to have clean include dir

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] allow mill to read include path from environment

9ad3bed

Signed-off-by: Avimitin <dev@avimit.in>


          [chore] ignore ammonite cache directory

b2a6822

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] drop codegen generator compilation in mill

95b7a67

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] drop usage for submodule codegen in nix

c326308

Signed-off-by: Avimitin <dev@avimit.in>


          [nix] add missing dependency for test shell

cc2f6d1

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] use the new test case runner

db8f487

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] pack all the artifact in nix instead of in ammonite

8e0e3b5

Signed-off-by: Avimitin <dev@avimit.in>


          [nix] fill up all missing dependencies in test shell

43ba02d

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] replace the release workflow with only artifact upload progress

ef46edf

Signed-off-by: Avimitin <dev@avimit.in>

Avimitin and others added 27 commits

July 30, 2023 03:32


          [ci] use double quote to escape bash syntax

98e0d29

Signed-off-by: Avimitin <dev@avimit.in>


          [doc] update Test secion in root readme

8fd0623

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] add more env setup in testcase shellHook

debba59

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] add readme

Signed-off-by: Avimitin <dev@avimit.in>


          [doc] add document for ci and script

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] resolve all tests instead of only mlir

bda55b9

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] use nix cache in generate matrix job

ea31266


          [ci] remove gen-test-elf workflow and rewrite the elf generate script

92819bb

Artifacts in GitHub action are only retained for 5 days,
which is not ideal to use as a persistant storage.
So this commit remove all the previous implementation
and just let the script compile all the test in local machine.

With nix store, these tests will not compile everytime you enter the shell.

Signed-off-by: Avimitin <dev@avimit.in>


          [nix] replace the testcase derivation implementation

d6e4f31

The old implemention is impure and slow.

Signed-off-by: Avimitin <dev@avimit.in>


          [nix] split shell into testcase-bootstrap and testcase

f3e9a39

This can not only exploit the nix store to cache testcase for us,
but also avoid fish user having incompatible shell hook.

Signed-off-by: Avimitin <dev@avimit.in>


          [nix] add rvv-testcase into nixpkgs

39764ad

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] fixed passed.txt format

e2a1b4e

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] fix test case directory variable reference

55f22a4

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] fix github shell escape

7dd6a5f

Signed-off-by: Avimitin <dev@avimit.in>


          [doc] update document to the latest implementation

b2ab67a

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] move buddy main.S into mlir directory

1370c5b

Signed-off-by: Avimitin <dev@avimit.in>


          [buddy] remove buddy-opt header

ce4bcd9

Signed-off-by: Avimitin <dev@avimit.in>


          [buddy] add main.S as source into all test config

7f44674

Signed-off-by: Avimitin <dev@avimit.in>


          [buddy] add main.S into link sources to fix the illegal instruction i…

6a4557a

…ssue

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] add single test case builder

57044da

Signed-off-by: Avimitin <dev@avimit.in>


          [docs] update readme to latest implementation

19f881c

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] bump rvv-testcase to latest version

24a058a

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] filter source file to avoid compiling unexpected files

c7fe200

Signed-off-by: Avimitin <dev@avimit.in>


          [tests] let rvv-testcase use the local test source

31e72cf

This can avoid updating sha256 everytime.

Signed-off-by: Avimitin <dev@avimit.in>


          [nix] use env to setup environment variable

fb3771f

This can help increase portability across multiple shell.

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] fix passed format

bff45de

Signed-off-by: Avimitin <dev@avimit.in>


          [ci] remove test result and perf result report

c2ee64d

Signed-off-by: Avimitin <dev@avimit.in>

sequencer force-pushed the testplan branch from 7812b38 to c2ee64d Compare

August 1, 2023 04:18

sequencer merged commit 8d32c49 into master

17 of 18 checks passed

sequencer deleted the testplan branch

August 1, 2023 04:18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet