Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

benchmarks on new version #641

Closed
wants to merge 1 commit into from
+16 −21
Closed

benchmarks on new version #641

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 1 addition & 21 deletions .github/workflows/book.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -109,24 +109,4 @@ jobs:
name: github-pages
path: ${{ runner.temp }}/artifact.tar
retention-days: 1
if-no-files-found: error

deploy:
# Only deploy if a push to main
if: github.ref_name == 'main' && github.event_name == 'push'
runs-on: ubuntu-latest
needs: [test, lint, build]

# Grant GITHUB_TOKEN the permissions required to make a Pages deployment
permissions:
pages: write
id-token: write

environment:
name: github-pages
url: ${{ steps.deployment.outputs.page_url }}

steps:
- name: Deploy to GitHub Pages
id: deployment
uses: actions/deploy-pages@v2
if-no-files-found: error
15 changes: 15 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -138,6 +138,21 @@ The biggest reasons why we chose to build Arbiter was to gain more control over
For the following, Anvil was set to mine blocks for each transaction as opposed to setting an enforced block time and the `Environment` was set with a block rate of 10.0 (this was chosen somewhat arbitrarily as we will add in more block control in the future).
Preliminary benchmarks of the `RevmMiddleware` interface over `revm` against Anvil are given in the following table.

to run the benchmarking code yourself, you can run:
```bash
cargo bench --package arbiter-core -F contracts
```

bench from 10/24/23 arbiter-core v0.6.3
| Operation | RevmMiddlwware | Anvil | Relative Difference |
|-----------------|-----------------|--------------|---------------------|
| Deploy | 238.975µs | 7712.436µs | ~32.2729x |
| Lookup | 565.617µs | 17880.124µs | ~31.6117x |
| Stateless Call | 1402.524µs | 10397.55µs | ~7.413456x |
| Stateful Call | 2043.88µs | 154553.225µs | ~75.61756x |


bench from 06/??/23ish arbiter-core v0.4.??
| Operation | RevmMiddlwware | Anvil | Relative Difference |
|-----------------|-----------------|--------------|---------------------|
| Deploy | 241.819µs | 8.215446ms | ~33.97x |
Expand Down
Loading