Revamp the benchmark suite #324

Job	Run time
ruby-versions / Generate Ruby versions	3s
ubuntu-20.04 2.3	28s
ubuntu-20.04 2.4	30s
ubuntu-20.04 2.5	30s
ubuntu-20.04 2.6	48s
ubuntu-20.04 2.7	1m 21s
ubuntu-20.04 3.0	45s
ubuntu-20.04 3.1	45s
ubuntu-20.04 3.2	43s
ubuntu-20.04 3.3	42s
ubuntu-20.04 head	35s
ubuntu-20.04 jruby	28s
ubuntu-20.04 jruby-head	29s
ubuntu-22.04 2.3	30s
ubuntu-22.04 2.4	28s
ubuntu-22.04 2.5	36s
ubuntu-22.04 2.6	58s
ubuntu-22.04 2.7	1m 20s
ubuntu-22.04 3.0	51s
ubuntu-22.04 3.1	46s
ubuntu-22.04 3.2	43s
ubuntu-22.04 3.3	42s
ubuntu-22.04 head	38s
ubuntu-22.04 jruby	37s
ubuntu-22.04 jruby-head	30s
macos-12 2.3	50s
macos-12 2.4	1m 4s
macos-12 2.5	1m 2s
macos-12 2.6	1m 15s
macos-12 2.7	3m 59s
macos-12 3.0	43s
macos-12 3.1	42s
macos-12 3.2	46s
macos-12 3.3	49s
macos-12 head	40s
macos-12 jruby	31s
macos-12 jruby-head	33s
macos-13 2.3	1m 18s
macos-13 2.4	54s
macos-13 2.5	1m 23s
macos-13 2.6	2m 1s
macos-13 2.7	2m 50s
macos-13 3.0	42s
macos-13 3.1	44s
macos-13 3.2	47s
macos-13 3.3	1m 34s
macos-13 head	39s
macos-13 jruby	58s
macos-13 jruby-head	33s
macos-14 2.6	43s
macos-14 2.7	1m 20s
macos-14 3.0	32s
macos-14 3.1	37s
macos-14 3.2	37s
macos-14 3.3	24s
macos-14 head	24s
macos-14 jruby	18s
macos-14 jruby-head	21s
windows-latest 2.3	2m 3s
windows-latest 2.4	1m 55s
windows-latest 2.5	2m 56s
windows-latest 2.6	5m 40s
windows-latest 2.7	5m 16s
windows-latest 3.0	3m 39s
windows-latest 3.1	3m 47s
windows-latest 3.2	4m 20s
windows-latest 3.3	4m 41s
windows-latest head	2m 31s
windows-latest mswin	1m 12s
ubuntu-latest jruby-9.3	23s
ubuntu-latest jruby-9.4	27s
macos-latest truffleruby-head	50s
ubuntu-latest truffleruby-head	53s
	1h 29m 52s

Provide feedback