Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: install same vitest version across packages #6306

Merged
merged 1 commit into from
Jan 16, 2024

Conversation

nflaig
Copy link
Member

@nflaig nflaig commented Jan 16, 2024

Motivation

Noticed when running yarn install locally on unstable branch it produces a lock file diff. This is due to the fact that we install different vitest versions.

I reviewed #6222 and seems to be the issue as the branch was open before we upgraded vitest in #6237.

There is a way to enforce that a branch is rebased / merged against target branch before the PR can be merged. While I don't think this is strictly necessary, we should keep in mind to rebase long lived branches before merging.

Description

Install same vitest version across packages

@nflaig nflaig requested a review from a team as a code owner January 16, 2024 10:20
@@ -112,7 +112,7 @@ export function describeDirectorySpecTest<TestCase extends {meta?: any}, Result>
continue;
}

// Use full path here, not just `testSubDirname` to allow usage of `vitest --grep`
// Use full path here, not just `testSubDirname` to allow usage of `vitest -t`
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

completely unrelated change, picked that up while reviewing #6222 and since this is a fixup of that PR, might as well include that here

Copy link

codecov bot commented Jan 16, 2024

Codecov Report

Merging #6306 (eb2f4c2) into unstable (4ff2911) will not change coverage.
The diff coverage is n/a.

Additional details and impacted files
@@            Coverage Diff            @@
##           unstable    #6306   +/-   ##
=========================================
  Coverage     80.38%   80.38%           
=========================================
  Files           202      202           
  Lines         19620    19620           
  Branches       1176     1176           
=========================================
  Hits          15771    15771           
  Misses         3821     3821           
  Partials         28       28           

Copy link
Contributor

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: b206072 Previous: 4ff2911 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 579.01 us/op 790.42 us/op 0.73
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 91.948 us/op 80.935 us/op 1.14
BLS verify - blst-native 1.3401 ms/op 1.3015 ms/op 1.03
BLS verifyMultipleSignatures 3 - blst-native 2.8111 ms/op 2.7542 ms/op 1.02
BLS verifyMultipleSignatures 8 - blst-native 6.2796 ms/op 6.1017 ms/op 1.03
BLS verifyMultipleSignatures 32 - blst-native 23.296 ms/op 22.375 ms/op 1.04
BLS verifyMultipleSignatures 64 - blst-native 46.303 ms/op 43.855 ms/op 1.06
BLS verifyMultipleSignatures 128 - blst-native 90.903 ms/op 86.832 ms/op 1.05
BLS deserializing 10000 signatures 984.28 ms/op 928.19 ms/op 1.06
BLS deserializing 100000 signatures 9.2654 s/op 9.3938 s/op 0.99
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.3991 ms/op 1.3394 ms/op 1.04
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.5377 ms/op 1.5185 ms/op 1.01
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.3913 ms/op 2.3234 ms/op 1.03
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.5142 ms/op 4.4427 ms/op 0.79
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.8216 ms/op 7.8803 ms/op 0.74
BLS aggregatePubkeys 32 - blst-native 26.702 us/op 26.029 us/op 1.03
BLS aggregatePubkeys 128 - blst-native 104.24 us/op 100.23 us/op 1.04
getAttestationsForBlock 53.397 ms/op 49.463 ms/op 1.08
getSlashingsAndExits - default max 190.78 us/op 158.89 us/op 1.20
getSlashingsAndExits - 2k 402.97 us/op 370.92 us/op 1.09
proposeBlockBody type=full, size=empty 6.3602 ms/op 4.9057 ms/op 1.30
isKnown best case - 1 super set check 396.00 ns/op 320.00 ns/op 1.24
isKnown normal case - 2 super set checks 529.00 ns/op 314.00 ns/op 1.68
isKnown worse case - 16 super set checks 463.00 ns/op 309.00 ns/op 1.50
CheckpointStateCache - add get delete 6.0300 us/op 5.8350 us/op 1.03
validate api signedAggregateAndProof - struct 2.8500 ms/op 2.7171 ms/op 1.05
validate gossip signedAggregateAndProof - struct 2.8409 ms/op 2.7186 ms/op 1.04
validate gossip attestation - vc 640000 1.4167 ms/op 1.3136 ms/op 1.08
batch validate gossip attestation - vc 640000 - chunk 32 172.94 us/op 156.85 us/op 1.10
batch validate gossip attestation - vc 640000 - chunk 64 157.75 us/op 143.75 us/op 1.10
batch validate gossip attestation - vc 640000 - chunk 128 144.11 us/op 131.74 us/op 1.09
batch validate gossip attestation - vc 640000 - chunk 256 127.63 us/op 128.63 us/op 0.99
pickEth1Vote - no votes 1.1397 ms/op 1.2189 ms/op 0.94
pickEth1Vote - max votes 9.9950 ms/op 10.697 ms/op 0.93
pickEth1Vote - Eth1Data hashTreeRoot value x2048 18.845 ms/op 18.045 ms/op 1.04
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 26.452 ms/op 26.088 ms/op 1.01
pickEth1Vote - Eth1Data fastSerialize value x2048 586.33 us/op 575.92 us/op 1.02
pickEth1Vote - Eth1Data fastSerialize tree x2048 7.5125 ms/op 6.1417 ms/op 1.22
bytes32 toHexString 499.00 ns/op 476.00 ns/op 1.05
bytes32 Buffer.toString(hex) 278.00 ns/op 274.00 ns/op 1.01
bytes32 Buffer.toString(hex) from Uint8Array 439.00 ns/op 395.00 ns/op 1.11
bytes32 Buffer.toString(hex) + 0x 279.00 ns/op 275.00 ns/op 1.01
Object access 1 prop 0.15700 ns/op 0.14800 ns/op 1.06
Map access 1 prop 0.13800 ns/op 0.13800 ns/op 1.00
Object get x1000 6.7190 ns/op 7.3300 ns/op 0.92
Map get x1000 0.70500 ns/op 0.70200 ns/op 1.00
Object set x1000 48.507 ns/op 47.136 ns/op 1.03
Map set x1000 37.782 ns/op 36.368 ns/op 1.04
Return object 10000 times 0.22830 ns/op 0.22460 ns/op 1.02
Throw Error 10000 times 3.7274 us/op 3.6671 us/op 1.02
fastMsgIdFn sha256 / 200 bytes 3.1470 us/op 3.1190 us/op 1.01
fastMsgIdFn h32 xxhash / 200 bytes 278.00 ns/op 275.00 ns/op 1.01
fastMsgIdFn h64 xxhash / 200 bytes 322.00 ns/op 337.00 ns/op 0.96
fastMsgIdFn sha256 / 1000 bytes 11.008 us/op 10.823 us/op 1.02
fastMsgIdFn h32 xxhash / 1000 bytes 389.00 ns/op 396.00 ns/op 0.98
fastMsgIdFn h64 xxhash / 1000 bytes 382.00 ns/op 393.00 ns/op 0.97
fastMsgIdFn sha256 / 10000 bytes 100.80 us/op 99.559 us/op 1.01
fastMsgIdFn h32 xxhash / 10000 bytes 1.8160 us/op 1.8430 us/op 0.99
fastMsgIdFn h64 xxhash / 10000 bytes 1.2440 us/op 1.2710 us/op 0.98
send data - 1000 256B messages 19.115 ms/op 17.545 ms/op 1.09
send data - 1000 512B messages 25.916 ms/op 25.348 ms/op 1.02
send data - 1000 1024B messages 39.612 ms/op 39.271 ms/op 1.01
send data - 1000 1200B messages 37.148 ms/op 37.281 ms/op 1.00
send data - 1000 2048B messages 43.199 ms/op 42.997 ms/op 1.00
send data - 1000 4096B messages 40.800 ms/op 40.091 ms/op 1.02
send data - 1000 16384B messages 122.67 ms/op 115.93 ms/op 1.06
send data - 1000 65536B messages 475.20 ms/op 451.35 ms/op 1.05
enrSubnets - fastDeserialize 64 bits 1.3390 us/op 1.2390 us/op 1.08
enrSubnets - ssz BitVector 64 bits 509.00 ns/op 418.00 ns/op 1.22
enrSubnets - fastDeserialize 4 bits 232.00 ns/op 173.00 ns/op 1.34
enrSubnets - ssz BitVector 4 bits 448.00 ns/op 409.00 ns/op 1.10
prioritizePeers score -10:0 att 32-0.1 sync 2-0 101.60 us/op 98.759 us/op 1.03
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 127.32 us/op 119.74 us/op 1.06
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 180.05 us/op 155.55 us/op 1.16
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 343.63 us/op 278.17 us/op 1.24
prioritizePeers score 0:0 att 64-1 sync 4-1 373.33 us/op 324.54 us/op 1.15
array of 16000 items push then shift 1.7489 us/op 1.5390 us/op 1.14
LinkedList of 16000 items push then shift 9.0940 ns/op 8.6190 ns/op 1.06
array of 16000 items push then pop 99.783 ns/op 72.656 ns/op 1.37
LinkedList of 16000 items push then pop 8.7830 ns/op 8.3760 ns/op 1.05
array of 24000 items push then shift 2.5487 us/op 2.2840 us/op 1.12
LinkedList of 24000 items push then shift 9.0370 ns/op 8.5720 ns/op 1.05
array of 24000 items push then pop 117.36 ns/op 110.05 ns/op 1.07
LinkedList of 24000 items push then pop 8.6790 ns/op 8.3110 ns/op 1.04
intersect bitArray bitLen 8 6.4750 ns/op 6.1340 ns/op 1.06
intersect array and set length 8 64.201 ns/op 60.318 ns/op 1.06
intersect bitArray bitLen 128 34.010 ns/op 32.565 ns/op 1.04
intersect array and set length 128 869.02 ns/op 816.37 ns/op 1.06
bitArray.getTrueBitIndexes() bitLen 128 1.5960 us/op 1.4100 us/op 1.13
bitArray.getTrueBitIndexes() bitLen 248 2.5780 us/op 2.3900 us/op 1.08
bitArray.getTrueBitIndexes() bitLen 512 4.7580 us/op 4.7750 us/op 1.00
Buffer.concat 32 items 944.00 ns/op 959.00 ns/op 0.98
Uint8Array.set 32 items 1.9240 us/op 1.9970 us/op 0.96
Set add up to 64 items then delete first 4.4075 us/op 4.2766 us/op 1.03
OrderedSet add up to 64 items then delete first 6.0536 us/op 5.3239 us/op 1.14
Set add up to 64 items then delete last 5.0202 us/op 4.4071 us/op 1.14
OrderedSet add up to 64 items then delete last 6.0155 us/op 5.4437 us/op 1.11
Set add up to 64 items then delete middle 4.7475 us/op 4.3592 us/op 1.09
OrderedSet add up to 64 items then delete middle 7.4912 us/op 6.6675 us/op 1.12
Set add up to 128 items then delete first 9.7725 us/op 8.8194 us/op 1.11
OrderedSet add up to 128 items then delete first 12.238 us/op 12.050 us/op 1.02
Set add up to 128 items then delete last 9.0608 us/op 8.9694 us/op 1.01
OrderedSet add up to 128 items then delete last 11.668 us/op 11.249 us/op 1.04
Set add up to 128 items then delete middle 9.1051 us/op 8.9656 us/op 1.02
OrderedSet add up to 128 items then delete middle 16.698 us/op 16.603 us/op 1.01
Set add up to 256 items then delete first 18.594 us/op 18.457 us/op 1.01
OrderedSet add up to 256 items then delete first 24.657 us/op 24.903 us/op 0.99
Set add up to 256 items then delete last 17.655 us/op 17.955 us/op 0.98
OrderedSet add up to 256 items then delete last 22.387 us/op 22.709 us/op 0.99
Set add up to 256 items then delete middle 17.714 us/op 17.827 us/op 0.99
OrderedSet add up to 256 items then delete middle 44.936 us/op 44.808 us/op 1.00
transfer serialized Status (84 B) 1.8920 us/op 1.7300 us/op 1.09
copy serialized Status (84 B) 1.5520 us/op 1.4500 us/op 1.07
transfer serialized SignedVoluntaryExit (112 B) 2.1530 us/op 1.9570 us/op 1.10
copy serialized SignedVoluntaryExit (112 B) 1.7250 us/op 1.6090 us/op 1.07
transfer serialized ProposerSlashing (416 B) 3.1380 us/op 3.0070 us/op 1.04
copy serialized ProposerSlashing (416 B) 2.2590 us/op 2.9280 us/op 0.77
transfer serialized Attestation (485 B) 2.0770 us/op 3.1300 us/op 0.66
copy serialized Attestation (485 B) 2.4550 us/op 2.9280 us/op 0.84
transfer serialized AttesterSlashing (33232 B) 2.8620 us/op 3.0570 us/op 0.94
copy serialized AttesterSlashing (33232 B) 5.8400 us/op 6.0850 us/op 0.96
transfer serialized Small SignedBeaconBlock (128000 B) 3.6600 us/op 3.1580 us/op 1.16
copy serialized Small SignedBeaconBlock (128000 B) 15.451 us/op 14.113 us/op 1.09
transfer serialized Avg SignedBeaconBlock (200000 B) 3.9070 us/op 3.5600 us/op 1.10
copy serialized Avg SignedBeaconBlock (200000 B) 21.284 us/op 20.032 us/op 1.06
transfer serialized BlobsSidecar (524380 B) 3.7770 us/op 3.3220 us/op 1.14
copy serialized BlobsSidecar (524380 B) 113.95 us/op 81.919 us/op 1.39
transfer serialized Big SignedBeaconBlock (1000000 B) 2.9240 us/op 3.6740 us/op 0.80
copy serialized Big SignedBeaconBlock (1000000 B) 304.22 us/op 148.79 us/op 2.04
pass gossip attestations to forkchoice per slot 4.3049 ms/op 3.8246 ms/op 1.13
forkChoice updateHead vc 100000 bc 64 eq 0 690.21 us/op 660.19 us/op 1.05
forkChoice updateHead vc 600000 bc 64 eq 0 4.5766 ms/op 4.4605 ms/op 1.03
forkChoice updateHead vc 1000000 bc 64 eq 0 7.3173 ms/op 6.9217 ms/op 1.06
forkChoice updateHead vc 600000 bc 320 eq 0 4.2142 ms/op 4.1475 ms/op 1.02
forkChoice updateHead vc 600000 bc 1200 eq 0 4.3607 ms/op 4.2859 ms/op 1.02
forkChoice updateHead vc 600000 bc 7200 eq 0 5.4503 ms/op 5.1188 ms/op 1.06
forkChoice updateHead vc 600000 bc 64 eq 1000 11.397 ms/op 11.180 ms/op 1.02
forkChoice updateHead vc 600000 bc 64 eq 10000 12.105 ms/op 11.816 ms/op 1.02
forkChoice updateHead vc 600000 bc 64 eq 300000 16.620 ms/op 15.579 ms/op 1.07
computeDeltas 500000 validators 300 proto nodes 6.8355 ms/op 6.5100 ms/op 1.05
computeDeltas 500000 validators 1200 proto nodes 6.5297 ms/op 6.3606 ms/op 1.03
computeDeltas 500000 validators 7200 proto nodes 6.4536 ms/op 6.3198 ms/op 1.02
computeDeltas 750000 validators 300 proto nodes 9.6488 ms/op 9.2726 ms/op 1.04
computeDeltas 750000 validators 1200 proto nodes 9.6997 ms/op 9.3949 ms/op 1.03
computeDeltas 750000 validators 7200 proto nodes 9.7821 ms/op 9.4504 ms/op 1.04
computeDeltas 1400000 validators 300 proto nodes 18.715 ms/op 18.846 ms/op 0.99
computeDeltas 1400000 validators 1200 proto nodes 19.246 ms/op 18.823 ms/op 1.02
computeDeltas 1400000 validators 7200 proto nodes 18.805 ms/op 18.532 ms/op 1.01
computeDeltas 2100000 validators 300 proto nodes 28.129 ms/op 28.620 ms/op 0.98
computeDeltas 2100000 validators 1200 proto nodes 28.450 ms/op 27.150 ms/op 1.05
computeDeltas 2100000 validators 7200 proto nodes 28.346 ms/op 27.829 ms/op 1.02
computeProposerBoostScoreFromBalances 500000 validators 3.6785 ms/op 3.6500 ms/op 1.01
computeProposerBoostScoreFromBalances 750000 validators 3.7139 ms/op 3.5938 ms/op 1.03
computeProposerBoostScoreFromBalances 1400000 validators 3.7170 ms/op 3.5832 ms/op 1.04
computeProposerBoostScoreFromBalances 2100000 validators 3.6499 ms/op 3.6292 ms/op 1.01
altair processAttestation - 250000 vs - 7PWei normalcase 2.2513 ms/op 2.0451 ms/op 1.10
altair processAttestation - 250000 vs - 7PWei worstcase 3.3443 ms/op 3.0241 ms/op 1.11
altair processAttestation - setStatus - 1/6 committees join 175.28 us/op 139.07 us/op 1.26
altair processAttestation - setStatus - 1/3 committees join 334.96 us/op 272.95 us/op 1.23
altair processAttestation - setStatus - 1/2 committees join 463.10 us/op 371.71 us/op 1.25
altair processAttestation - setStatus - 2/3 committees join 584.33 us/op 457.49 us/op 1.28
altair processAttestation - setStatus - 4/5 committees join 778.93 us/op 655.43 us/op 1.19
altair processAttestation - setStatus - 100% committees join 907.70 us/op 758.18 us/op 1.20
altair processBlock - 250000 vs - 7PWei normalcase 9.4670 ms/op 9.7957 ms/op 0.97
altair processBlock - 250000 vs - 7PWei normalcase hashState 38.280 ms/op 33.317 ms/op 1.15
altair processBlock - 250000 vs - 7PWei worstcase 37.419 ms/op 35.864 ms/op 1.04
altair processBlock - 250000 vs - 7PWei worstcase hashState 101.34 ms/op 88.727 ms/op 1.14
phase0 processBlock - 250000 vs - 7PWei normalcase 2.5007 ms/op 2.4592 ms/op 1.02
phase0 processBlock - 250000 vs - 7PWei worstcase 30.672 ms/op 30.141 ms/op 1.02
altair processEth1Data - 250000 vs - 7PWei normalcase 607.44 us/op 503.90 us/op 1.21
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 11.996 us/op 12.199 us/op 0.98
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 64.701 us/op 57.078 us/op 1.13
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 26.104 us/op 10.631 us/op 2.46
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 9.3090 us/op 9.6820 us/op 0.96
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 175.97 us/op 130.14 us/op 1.35
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.4020 ms/op 1.0699 ms/op 1.31
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.4520 ms/op 1.5594 ms/op 0.93
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.6372 ms/op 1.5198 ms/op 1.08
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 3.1634 ms/op 3.2428 ms/op 0.98
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.3543 ms/op 2.2669 ms/op 1.04
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 5.3177 ms/op 4.4695 ms/op 1.19
Tree 40 250000 create 337.73 ms/op 336.21 ms/op 1.00
Tree 40 250000 get(125000) 195.94 ns/op 197.93 ns/op 0.99
Tree 40 250000 set(125000) 1.0038 us/op 978.60 ns/op 1.03
Tree 40 250000 toArray() 18.523 ms/op 18.555 ms/op 1.00
Tree 40 250000 iterate all - toArray() + loop 18.521 ms/op 18.713 ms/op 0.99
Tree 40 250000 iterate all - get(i) 64.930 ms/op 64.208 ms/op 1.01
MutableVector 250000 create 12.175 ms/op 13.648 ms/op 0.89
MutableVector 250000 get(125000) 6.5880 ns/op 6.3780 ns/op 1.03
MutableVector 250000 set(125000) 285.69 ns/op 267.42 ns/op 1.07
MutableVector 250000 toArray() 3.6099 ms/op 2.9909 ms/op 1.21
MutableVector 250000 iterate all - toArray() + loop 3.6347 ms/op 3.6905 ms/op 0.98
MutableVector 250000 iterate all - get(i) 1.6363 ms/op 1.8969 ms/op 0.86
Array 250000 create 2.9437 ms/op 2.7935 ms/op 1.05
Array 250000 clone - spread 1.2742 ms/op 1.2348 ms/op 1.03
Array 250000 get(125000) 1.0650 ns/op 1.0270 ns/op 1.04
Array 250000 set(125000) 4.2350 ns/op 4.0590 ns/op 1.04
Array 250000 iterate all - loop 168.48 us/op 163.76 us/op 1.03
effectiveBalanceIncrements clone Uint8Array 300000 28.832 us/op 26.326 us/op 1.10
effectiveBalanceIncrements clone MutableVector 300000 375.00 ns/op 364.00 ns/op 1.03
effectiveBalanceIncrements rw all Uint8Array 300000 202.23 us/op 197.45 us/op 1.02
effectiveBalanceIncrements rw all MutableVector 300000 84.763 ms/op 80.961 ms/op 1.05
phase0 afterProcessEpoch - 250000 vs - 7PWei 114.62 ms/op 111.13 ms/op 1.03
phase0 beforeProcessEpoch - 250000 vs - 7PWei 54.224 ms/op 51.951 ms/op 1.04
altair processEpoch - mainnet_e81889 503.22 ms/op 496.82 ms/op 1.01
mainnet_e81889 - altair beforeProcessEpoch 89.239 ms/op 80.107 ms/op 1.11
mainnet_e81889 - altair processJustificationAndFinalization 16.463 us/op 14.500 us/op 1.14
mainnet_e81889 - altair processInactivityUpdates 6.0448 ms/op 5.4021 ms/op 1.12
mainnet_e81889 - altair processRewardsAndPenalties 66.773 ms/op 60.038 ms/op 1.11
mainnet_e81889 - altair processRegistryUpdates 2.6360 us/op 2.5020 us/op 1.05
mainnet_e81889 - altair processSlashings 517.00 ns/op 426.00 ns/op 1.21
mainnet_e81889 - altair processEth1DataReset 798.00 ns/op 426.00 ns/op 1.87
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.5249 ms/op 1.4261 ms/op 1.07
mainnet_e81889 - altair processSlashingsReset 5.2560 us/op 3.6460 us/op 1.44
mainnet_e81889 - altair processRandaoMixesReset 8.0430 us/op 5.0450 us/op 1.59
mainnet_e81889 - altair processHistoricalRootsUpdate 750.00 ns/op 599.00 ns/op 1.25
mainnet_e81889 - altair processParticipationFlagUpdates 2.9280 us/op 2.0950 us/op 1.40
mainnet_e81889 - altair processSyncCommitteeUpdates 1.0700 us/op 556.00 ns/op 1.92
mainnet_e81889 - altair afterProcessEpoch 128.57 ms/op 115.28 ms/op 1.12
capella processEpoch - mainnet_e217614 2.2407 s/op 2.1276 s/op 1.05
mainnet_e217614 - capella beforeProcessEpoch 478.97 ms/op 508.01 ms/op 0.94
mainnet_e217614 - capella processJustificationAndFinalization 13.901 us/op 22.100 us/op 0.63
mainnet_e217614 - capella processInactivityUpdates 20.584 ms/op 23.811 ms/op 0.86
mainnet_e217614 - capella processRewardsAndPenalties 433.45 ms/op 401.69 ms/op 1.08
mainnet_e217614 - capella processRegistryUpdates 21.311 us/op 29.402 us/op 0.72
mainnet_e217614 - capella processSlashings 615.00 ns/op 551.00 ns/op 1.12
mainnet_e217614 - capella processEth1DataReset 408.00 ns/op 516.00 ns/op 0.79
mainnet_e217614 - capella processEffectiveBalanceUpdates 4.4850 ms/op 4.7723 ms/op 0.94
mainnet_e217614 - capella processSlashingsReset 3.5490 us/op 4.3460 us/op 0.82
mainnet_e217614 - capella processRandaoMixesReset 4.8150 us/op 7.5620 us/op 0.64
mainnet_e217614 - capella processHistoricalRootsUpdate 422.00 ns/op 431.00 ns/op 0.98
mainnet_e217614 - capella processParticipationFlagUpdates 2.0720 us/op 1.4720 us/op 1.41
mainnet_e217614 - capella afterProcessEpoch 303.39 ms/op 324.86 ms/op 0.93
phase0 processEpoch - mainnet_e58758 430.89 ms/op 467.16 ms/op 0.92
mainnet_e58758 - phase0 beforeProcessEpoch 138.14 ms/op 121.18 ms/op 1.14
mainnet_e58758 - phase0 processJustificationAndFinalization 14.631 us/op 16.160 us/op 0.91
mainnet_e58758 - phase0 processRewardsAndPenalties 55.038 ms/op 53.539 ms/op 1.03
mainnet_e58758 - phase0 processRegistryUpdates 11.464 us/op 10.390 us/op 1.10
mainnet_e58758 - phase0 processSlashings 711.00 ns/op 538.00 ns/op 1.32
mainnet_e58758 - phase0 processEth1DataReset 445.00 ns/op 376.00 ns/op 1.18
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.1793 ms/op 1.1608 ms/op 1.02
mainnet_e58758 - phase0 processSlashingsReset 6.1260 us/op 4.1090 us/op 1.49
mainnet_e58758 - phase0 processRandaoMixesReset 5.0620 us/op 4.0210 us/op 1.26
mainnet_e58758 - phase0 processHistoricalRootsUpdate 443.00 ns/op 465.00 ns/op 0.95
mainnet_e58758 - phase0 processParticipationRecordUpdates 4.5160 us/op 3.1960 us/op 1.41
mainnet_e58758 - phase0 afterProcessEpoch 97.738 ms/op 95.741 ms/op 1.02
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.3985 ms/op 1.4046 ms/op 1.00
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.4442 ms/op 1.5675 ms/op 0.92
altair processInactivityUpdates - 250000 normalcase 24.466 ms/op 22.633 ms/op 1.08
altair processInactivityUpdates - 250000 worstcase 26.793 ms/op 26.726 ms/op 1.00
phase0 processRegistryUpdates - 250000 normalcase 10.554 us/op 8.5330 us/op 1.24
phase0 processRegistryUpdates - 250000 badcase_full_deposits 400.22 us/op 392.11 us/op 1.02
phase0 processRegistryUpdates - 250000 worstcase 0.5 153.64 ms/op 122.18 ms/op 1.26
altair processRewardsAndPenalties - 250000 normalcase 62.306 ms/op 60.541 ms/op 1.03
altair processRewardsAndPenalties - 250000 worstcase 62.459 ms/op 56.345 ms/op 1.11
phase0 getAttestationDeltas - 250000 normalcase 11.071 ms/op 8.7505 ms/op 1.27
phase0 getAttestationDeltas - 250000 worstcase 14.315 ms/op 9.6382 ms/op 1.49
phase0 processSlashings - 250000 worstcase 106.97 us/op 91.957 us/op 1.16
altair processSyncCommitteeUpdates - 250000 170.94 ms/op 156.41 ms/op 1.09
BeaconState.hashTreeRoot - No change 272.00 ns/op 279.00 ns/op 0.97
BeaconState.hashTreeRoot - 1 full validator 157.74 us/op 152.18 us/op 1.04
BeaconState.hashTreeRoot - 32 full validator 1.5865 ms/op 1.5033 ms/op 1.06
BeaconState.hashTreeRoot - 512 full validator 16.854 ms/op 18.899 ms/op 0.89
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 174.93 us/op 217.97 us/op 0.80
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.4898 ms/op 2.1629 ms/op 1.15
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 30.671 ms/op 28.830 ms/op 1.06
BeaconState.hashTreeRoot - 1 balances 140.71 us/op 122.81 us/op 1.15
BeaconState.hashTreeRoot - 32 balances 1.6761 ms/op 1.1012 ms/op 1.52
BeaconState.hashTreeRoot - 512 balances 15.779 ms/op 17.039 ms/op 0.93
BeaconState.hashTreeRoot - 250000 balances 255.40 ms/op 191.84 ms/op 1.33
aggregationBits - 2048 els - zipIndexesInBitList 24.186 us/op 17.567 us/op 1.38
byteArrayEquals 32 80.328 ns/op 74.156 ns/op 1.08
Buffer.compare 32 59.844 ns/op 55.489 ns/op 1.08
byteArrayEquals 1024 2.3031 us/op 1.9760 us/op 1.17
Buffer.compare 1024 76.151 ns/op 68.704 ns/op 1.11
byteArrayEquals 16384 35.014 us/op 32.149 us/op 1.09
Buffer.compare 16384 288.64 ns/op 269.65 ns/op 1.07
byteArrayEquals 123687377 260.14 ms/op 248.04 ms/op 1.05
Buffer.compare 123687377 8.2668 ms/op 8.2399 ms/op 1.00
byteArrayEquals 32 - diff last byte 76.609 ns/op 73.137 ns/op 1.05
Buffer.compare 32 - diff last byte 59.274 ns/op 57.264 ns/op 1.04
byteArrayEquals 1024 - diff last byte 2.1091 us/op 2.0942 us/op 1.01
Buffer.compare 1024 - diff last byte 74.527 ns/op 74.388 ns/op 1.00
byteArrayEquals 16384 - diff last byte 33.746 us/op 33.441 us/op 1.01
Buffer.compare 16384 - diff last byte 277.82 ns/op 262.95 ns/op 1.06
byteArrayEquals 123687377 - diff last byte 255.42 ms/op 247.00 ms/op 1.03
Buffer.compare 123687377 - diff last byte 7.6940 ms/op 7.2223 ms/op 1.07
byteArrayEquals 32 - random bytes 6.0960 ns/op 5.5930 ns/op 1.09
Buffer.compare 32 - random bytes 67.411 ns/op 60.883 ns/op 1.11
byteArrayEquals 1024 - random bytes 5.7690 ns/op 5.1950 ns/op 1.11
Buffer.compare 1024 - random bytes 64.216 ns/op 59.228 ns/op 1.08
byteArrayEquals 16384 - random bytes 5.9930 ns/op 5.3840 ns/op 1.11
Buffer.compare 16384 - random bytes 63.166 ns/op 60.049 ns/op 1.05
byteArrayEquals 123687377 - random bytes 8.8900 ns/op 8.5500 ns/op 1.04
Buffer.compare 123687377 - random bytes 70.050 ns/op 63.820 ns/op 1.10
regular array get 100000 times 47.025 us/op 44.849 us/op 1.05
wrappedArray get 100000 times 46.697 us/op 44.861 us/op 1.04
arrayWithProxy get 100000 times 14.375 ms/op 14.251 ms/op 1.01
ssz.Root.equals 56.800 ns/op 54.040 ns/op 1.05
byteArrayEquals 56.742 ns/op 53.087 ns/op 1.07
Buffer.compare 12.414 ns/op 11.987 ns/op 1.04
shuffle list - 16384 els 7.3815 ms/op 7.0339 ms/op 1.05
shuffle list - 250000 els 106.52 ms/op 103.54 ms/op 1.03
processSlot - 1 slots 20.111 us/op 17.249 us/op 1.17
processSlot - 32 slots 4.0791 ms/op 3.0352 ms/op 1.34
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 64.193 ms/op 55.220 ms/op 1.16
getCommitteeAssignments - req 1 vs - 250000 vc 2.9940 ms/op 2.4843 ms/op 1.21
getCommitteeAssignments - req 100 vs - 250000 vc 4.4690 ms/op 3.6614 ms/op 1.22
getCommitteeAssignments - req 1000 vs - 250000 vc 4.8762 ms/op 4.0440 ms/op 1.21
findModifiedValidators - 10000 modified validators 736.43 ms/op 523.62 ms/op 1.41
findModifiedValidators - 1000 modified validators 460.82 ms/op 430.54 ms/op 1.07
findModifiedValidators - 100 modified validators 505.16 ms/op 380.59 ms/op 1.33
findModifiedValidators - 10 modified validators 479.24 ms/op 394.07 ms/op 1.22
findModifiedValidators - 1 modified validators 497.66 ms/op 431.32 ms/op 1.15
findModifiedValidators - no difference 477.60 ms/op 425.19 ms/op 1.12
compare ViewDUs 5.4395 s/op 4.3265 s/op 1.26
compare each validator Uint8Array 2.0741 s/op 1.8364 s/op 1.13
compare ViewDU to Uint8Array 1.6585 s/op 1.1131 s/op 1.49
migrate state 1000000 validators, 24 modified, 0 new 939.51 ms/op 781.60 ms/op 1.20
migrate state 1000000 validators, 1700 modified, 1000 new 1.3614 s/op 1.0800 s/op 1.26
migrate state 1000000 validators, 3400 modified, 2000 new 1.7580 s/op 1.3188 s/op 1.33
migrate state 1500000 validators, 24 modified, 0 new 1.2300 s/op 796.33 ms/op 1.54
migrate state 1500000 validators, 1700 modified, 1000 new 1.4984 s/op 1.0936 s/op 1.37
migrate state 1500000 validators, 3400 modified, 2000 new 1.6474 s/op 1.3197 s/op 1.25
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.2900 ns/op 4.4000 ns/op 1.20
state getBlockRootAtSlot - 250000 vs - 7PWei 735.23 ns/op 730.74 ns/op 1.01
computeProposers - vc 250000 10.982 ms/op 9.1791 ms/op 1.20
computeEpochShuffling - vc 250000 115.00 ms/op 99.063 ms/op 1.16
getNextSyncCommittee - vc 250000 169.46 ms/op 157.65 ms/op 1.07
computeSigningRoot for AttestationData 30.262 us/op 26.756 us/op 1.13
hash AttestationData serialized data then Buffer.toString(base64) 2.5451 us/op 2.2539 us/op 1.13
toHexString serialized data 1.2259 us/op 1.0456 us/op 1.17
Buffer.toString(base64) 268.49 ns/op 211.17 ns/op 1.27

by benchmarkbot/action

@wemeetagain wemeetagain merged commit 9940478 into unstable Jan 16, 2024
13 of 15 checks passed
@wemeetagain wemeetagain deleted the nflaig/same-vitest-version branch January 16, 2024 15:20
ensi321 pushed a commit to ensi321/lodestar that referenced this pull request Jan 22, 2024
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.15.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants