feat(l2): commit blocks in batches

[avilagaston9]

Motivation

To reduce the number of times we go to the L1 to commit/verify blocks.

Description

• Modifies l1_committer to merge as many blocks as possible into a single StateDiff before committing, limited by the blob size.
• Modifies StateDiff to now contain both the resulting AccountUpdates from executing all blocks in the batch and the header of the last block.
• Adapts contracts to use batchNumbers instead of blockNumbers.
• Adds a new RPC endpoint, ethrex_getWithdrawalProof, which returns all necessary data to claim an L1 withdrawal for a given L2 withdrawal transaction hash.
• Implements apply_account_updates for the ExecutionDB to prepare the db for executing the next block in the batch.
• Adds a L2/storage with the following tables:
  • block_number => batch_number: Maps block numbers to batches (used by the endpoint to locate a withdrawal's batch).
  • batch_number => Vec<block_number>: Lists all block numbers included in a given batch.
  • batch_number => withdrawal_hashes: Stores withdrawal hashes per batch (used to construct merkle proofs).

Closes None

Created issues:

• Restore state reconstruction test #2563
• L2: review LatestBlocks command #2578
• L2: Update metrics to work with batches #2579
• Add a state reconstruct section to StateDiffs docs #2617

[github-actions]

Lines of code report

Total lines added: 1238
Total lines removed: 328
Total lines changed: 1566

Detailed view

+--------------------------------------------------------------+-------+------+
| File                                                         | Lines | Diff |
+--------------------------------------------------------------+-------+------+
| ethrex/cmd/ethrex/ethrex.rs                                  | 88    | +4   |
+--------------------------------------------------------------+-------+------+
| ethrex/cmd/ethrex/initializers.rs                            | 374   | +22  |
+--------------------------------------------------------------+-------+------+
| ethrex/cmd/ethrex/l2.rs                                      | 256   | +4   |
+--------------------------------------------------------------+-------+------+
| ethrex/cmd/ethrex_l2/src/commands/stack.rs                   | 403   | +42  |
+--------------------------------------------------------------+-------+------+
| ethrex/cmd/ethrex_l2/src/commands/wallet.rs                  | 564   | -54  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/prover/src/backends/exec.rs                 | 81    | +20  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/prover/zkvm/interface/pico/src/main.rs      | 63    | +18  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/prover/zkvm/interface/risc0/src/main.rs     | 69    | +23  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/prover/zkvm/interface/sp1/src/main.rs       | 70    | +21  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/sdk/src/sdk.rs                              | 214   | -81  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/sequencer/block_producer/payload_builder.rs | 227   | +2   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/sequencer/l1_committer.rs                   | 505   | +82  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/sequencer/l1_proof_sender.rs                | 165   | -1   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/sequencer/l1_watcher.rs                     | 281   | +1   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/sequencer/metrics.rs                        | 81    | -1   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/sequencer/mod.rs                            | 65    | +5   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/sequencer/proof_coordinator.rs              | 293   | +29  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/sequencer/state_diff.rs                     | 469   | +3   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/storage/src/api.rs                          | 34    | +34  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/storage/src/lib.rs                          | 5     | +5   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/storage/src/rlp.rs                          | 74    | +74  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/storage/src/store.rs                        | 121   | +121 |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/storage/src/store_db/in_memory.rs           | 97    | +97  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/storage/src/store_db/libmdbx.rs             | 141   | +141 |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/storage/src/store_db/mod.rs                 | 5     | +5   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/storage/src/store_db/redb.rs                | 151   | +151 |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/l2/utils/test_data_io.rs                       | 87    | +1   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/networking/rpc/clients/eth/errors.rs           | 209   | +13  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/networking/rpc/clients/eth/mod.rs              | 1039  | +46  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/networking/rpc/eth/filter.rs                   | 542   | -63  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/networking/rpc/eth/gas_price.rs                | 112   | -27  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/networking/rpc/eth/max_priority_fee.rs         | 129   | +5   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/networking/rpc/l2/mod.rs                       | 2     | +1   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/networking/rpc/l2/withdrawal.rs                | 82    | +82  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/networking/rpc/rpc.rs                          | 643   | -78  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/networking/rpc/utils.rs                        | 411   | +77  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/storage/account_update.rs                      | 39    | +39  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/storage/lib.rs                                 | 12    | +1   |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/storage/store.rs                               | 1225  | -23  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/vm/backends/levm/db.rs                         | 193   | +13  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/vm/backends/levm/mod.rs                        | 648   | +21  |
+--------------------------------------------------------------+-------+------+
| ethrex/crates/vm/db.rs                                       | 81    | +35  |
+--------------------------------------------------------------+-------+------+