Skip to content

Latest commit

 

History

History
50 lines (39 loc) · 3.08 KB

README.md

File metadata and controls

50 lines (39 loc) · 3.08 KB
Raw

AA Benchmark

A benchmark for AA (ERC-4337) smart contract accounts.

All accounts use single-ECDSA signatures. We plan on expanding to other signing schemes in the future (multisig, RSA, etc.).

Note that these numbers are most relevant for L1s like Ethereum/Polygon. For L2s (e.g. Arbitrum/Optimism/Base), there's a L1 data cost that's not measured.

Results (as of February 24, 2024)

Disclaimer the numbers are obtained from local simulations. On-chain numbers might differ slightly.

Since these are gas numbers, lower is better.

Creation Native transfer ERC20 transfer Total
SimpleAccount 383218 101319 90907 575444
Biconomy 270013 104408 93730 468151
Etherspot 279219 103719 93324 476262
Kernel v2.0 339882 110018 99622 549522
Kernel v2.1 265215 106460 96038 467713
Kernel v2.1-lite 230968 101002 90321 422291
Solady ERC4337 212262 100149 89532 401943
SoulWalletCore 276529 101162 90466 468157
Safe 4337 401848 115469 105089 622406
LightAccount 279820 100910 90411 471141
ERC7579 reference 289438 103811 93213 486462
Alchemy ModularAccount 827723 106630 96438 1030791

How to add your implementation

  1. Fork this repo.
  2. Add your test file to ./test/; create a folder if needed.
  3. Inherit src/TestBase.sol and override getSignature(), fillData(), createAccount(), getAccountAddr(), getInitCode().
    • getSignature(): should return appropriate signature based on _op (e.g. should return ECDSA signature).
    • fillData(): should return appropriate data for userOp.callData.
    • createAccount(): should create the wallet. Skip this if your factory only allows for creation through the EntryPoint.
    • getAccountAddr(): should return the counterfactual address for the given _owner.
    • getInitCode(): should return userOp.initCode.
  4. Write setUp() function to set the initial test condition. For instance, it might deploy the factory and the implementation contract. NOTICE since we don't want this repo to have too many dependencies, please use vm.etch and use your predicted address & bytecode to deploy the contract instead of importing your whole code. This will also make it easy to test without compiler setup fiasco.
  5. Run WRITE_GAS_PROFILE=true forge test -vv this will show you the results of the benchmark and also output the result as a JSON file to results/.
  6. Make a PR to this repository.

TODO

  • add paymaster benchmark
  • allow non-ECDSA benchmark
    • maybe RSA?
  • add CI for cheking/getting the gas results
  • L2 gas cost calculation