Skip to content

Commit

Permalink
Update README.md (#1544)
Browse files Browse the repository at this point in the history 
Co-authored-by: thomhurst <30480171_thomhurst@users.noreply.github.com>
  • Loading branch information
@github-actions
github-actions[bot] and thomhurst authored Jan 12, 2025
1 parent 698a711 commit 60ee7d9
Showing 1 changed file with 48 additions and 48 deletions.
96 changes: 48 additions & 48 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -258,12 +258,12 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|------------- |-----------:|---------:|----------:|
| Build_TUnit | 1,165.9 ms | 34.94 ms | 100.80 ms |
| Build_NUnit | 950.1 ms | 43.81 ms | 129.19 ms |
| Build_xUnit | 846.1 ms | 15.87 ms | 13.25 ms |
| Build_MSTest | 933.9 ms | 29.41 ms | 85.32 ms |
| Method | Mean | Error | StdDev | Median |
|------------- |-----------:|---------:|----------:|-----------:|
| Build_TUnit | 1,044.9 ms | 44.52 ms | 125.58 ms | 998.0 ms |
| Build_NUnit | 1,018.9 ms | 35.37 ms | 103.73 ms | 1,013.1 ms |
| Build_xUnit | 921.1 ms | 30.58 ms | 90.17 ms | 891.5 ms |
| Build_MSTest | 878.6 ms | 24.58 ms | 70.53 ms | 866.0 ms |



Expand All @@ -282,10 +282,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|------------- |--------:|---------:|---------:|
| Build_TUnit | 1.848 s | 0.0367 s | 0.0361 s |
| Build_NUnit | 1.509 s | 0.0217 s | 0.0203 s |
| Build_xUnit | 1.507 s | 0.0140 s | 0.0124 s |
| Build_MSTest | 1.604 s | 0.0253 s | 0.0237 s |
| Build_TUnit | 1.808 s | 0.0357 s | 0.0367 s |
| Build_NUnit | 1.467 s | 0.0148 s | 0.0131 s |
| Build_xUnit | 1.485 s | 0.0238 s | 0.0222 s |
| Build_MSTest | 1.544 s | 0.0142 s | 0.0125 s |



Expand All @@ -304,10 +304,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|------------- |--------:|---------:|---------:|
| Build_TUnit | 2.121 s | 0.0497 s | 0.1457 s |
| Build_NUnit | 1.783 s | 0.0485 s | 0.1429 s |
| Build_xUnit | 1.796 s | 0.0480 s | 0.1416 s |
| Build_MSTest | 1.826 s | 0.0414 s | 0.1221 s |
| Build_TUnit | 1.783 s | 0.0341 s | 0.0303 s |
| Build_NUnit | 1.476 s | 0.0188 s | 0.0167 s |
| Build_xUnit | 1.480 s | 0.0204 s | 0.0180 s |
| Build_MSTest | 1.521 s | 0.0196 s | 0.0184 s |


### Scenario: A single test that completes instantly (including spawning a new process and initialising the test framework)
Expand All @@ -325,13 +325,13 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev | Median |
|---------- |------------:|----------:|----------:|------------:|
| TUnit_AOT | 85.86 ms | 5.466 ms | 15.77 ms | 79.19 ms |
| TUnit | 573.40 ms | 11.460 ms | 27.68 ms | 568.00 ms |
| NUnit | 937.00 ms | 45.051 ms | 132.13 ms | 892.35 ms |
| xUnit | 1,115.14 ms | 38.401 ms | 113.23 ms | 1,088.85 ms |
| MSTest | 952.49 ms | 35.788 ms | 104.96 ms | 925.03 ms |
| Method | Mean | Error | StdDev |
|---------- |----------:|----------:|----------:|
| TUnit_AOT | 79.26 ms | 1.562 ms | 2.694 ms |
| TUnit | 526.39 ms | 10.462 ms | 24.454 ms |
| NUnit | 751.41 ms | 15.014 ms | 17.873 ms |
| xUnit | 757.84 ms | 14.838 ms | 12.390 ms |
| MSTest | 653.67 ms | 7.298 ms | 6.827 ms |



Expand All @@ -350,11 +350,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|---------- |------------:|----------:|----------:|
| TUnit_AOT | 43.99 ms | 0.875 ms | 2.552 ms |
| TUnit | 845.21 ms | 16.452 ms | 21.963 ms |
| NUnit | 1,300.81 ms | 18.977 ms | 17.751 ms |
| xUnit | 1,333.45 ms | 11.043 ms | 9.222 ms |
| MSTest | 1,162.28 ms | 19.299 ms | 18.053 ms |
| TUnit_AOT | 46.98 ms | 0.936 ms | 2.450 ms |
| TUnit | 893.03 ms | 17.395 ms | 29.064 ms |
| NUnit | 1,388.56 ms | 15.223 ms | 14.239 ms |
| xUnit | 1,439.61 ms | 17.600 ms | 15.602 ms |
| MSTest | 1,233.05 ms | 19.929 ms | 18.642 ms |



Expand All @@ -373,11 +373,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|---------- |------------:|----------:|----------:|
| TUnit_AOT | 59.43 ms | 1.812 ms | 5.344 ms |
| TUnit | 877.14 ms | 16.757 ms | 30.640 ms |
| NUnit | 1,316.26 ms | 22.904 ms | 21.424 ms |
| xUnit | 1,334.89 ms | 15.685 ms | 13.905 ms |
| MSTest | 1,149.05 ms | 17.676 ms | 16.534 ms |
| TUnit_AOT | 59.62 ms | 1.932 ms | 5.698 ms |
| TUnit | 835.03 ms | 16.602 ms | 21.588 ms |
| NUnit | 1,272.54 ms | 11.026 ms | 10.313 ms |
| xUnit | 1,313.92 ms | 14.510 ms | 12.863 ms |
| MSTest | 1,130.86 ms | 10.583 ms | 9.382 ms |


### Scenario: A test that takes 50ms to execute, repeated 100 times (including spawning a new process and initialising the test framework)
Expand All @@ -397,11 +397,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|---------- |------------:|----------:|----------:|
| TUnit_AOT | 248.3 ms | 17.16 ms | 50.60 ms |
| TUnit | 643.8 ms | 20.72 ms | 61.09 ms |
| NUnit | 13,860.8 ms | 264.86 ms | 552.85 ms |
| xUnit | 14,339.6 ms | 280.09 ms | 512.16 ms |
| MSTest | 14,312.4 ms | 282.04 ms | 522.78 ms |
| TUnit_AOT | 242.5 ms | 12.94 ms | 37.74 ms |
| TUnit | 803.8 ms | 22.39 ms | 65.30 ms |
| NUnit | 14,070.6 ms | 278.80 ms | 408.66 ms |
| xUnit | 14,382.8 ms | 253.74 ms | 379.78 ms |
| MSTest | 14,446.8 ms | 283.31 ms | 525.13 ms |



Expand All @@ -418,13 +418,13 @@ AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev | Median |
|---------- |------------:|----------:|----------:|------------:|
| TUnit_AOT | 77.78 ms | 1.531 ms | 2.292 ms | 76.58 ms |
| TUnit | 894.12 ms | 17.797 ms | 19.042 ms | 895.22 ms |
| NUnit | 6,465.10 ms | 20.557 ms | 19.229 ms | 6,465.28 ms |
| xUnit | 6,522.98 ms | 22.652 ms | 18.916 ms | 6,527.20 ms |
| MSTest | 6,420.03 ms | 3.617 ms | 3.020 ms | 6,419.86 ms |
| Method | Mean | Error | StdDev |
|---------- |------------:|----------:|----------:|
| TUnit_AOT | 78.70 ms | 1.553 ms | 2.126 ms |
| TUnit | 919.82 ms | 17.937 ms | 22.029 ms |
| NUnit | 6,486.41 ms | 16.518 ms | 15.451 ms |
| xUnit | 6,599.70 ms | 43.612 ms | 40.794 ms |
| MSTest | 6,477.08 ms | 30.653 ms | 28.673 ms |



Expand All @@ -443,11 +443,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|---------- |-----------:|---------:|---------:|
| TUnit_AOT | 125.6 ms | 2.99 ms | 8.83 ms |
| TUnit | 911.2 ms | 18.04 ms | 25.28 ms |
| NUnit | 7,490.0 ms | 18.83 ms | 16.69 ms |
| xUnit | 7,542.3 ms | 18.59 ms | 17.39 ms |
| MSTest | 7,429.9 ms | 17.72 ms | 16.57 ms |
| TUnit_AOT | 128.0 ms | 2.88 ms | 8.50 ms |
| TUnit | 914.5 ms | 17.85 ms | 21.25 ms |
| NUnit | 7,522.3 ms | 28.45 ms | 26.61 ms |
| xUnit | 7,568.9 ms | 22.75 ms | 20.17 ms |
| MSTest | 7,445.8 ms | 25.07 ms | 22.23 ms |



0 comments on commit 60ee7d9

Please sign in to comment.