Skip to content

chore(fast-inbox): delete legacy node message paths (A-1388) - #24793

Open
spalladino wants to merge 18 commits into
spl/a-1387-circuits-cleanupfrom
spl/a-1388-node-cleanup
Open

chore(fast-inbox): delete legacy node message paths (A-1388)#24793
spalladino wants to merge 18 commits into
spl/a-1387-circuits-cleanupfrom
spl/a-1388-node-cleanup

Conversation

@spalladino

@spalladino spalladino commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Node cleanup for the Fast Inbox (AZIP-22) project — removes the legacy L1-to-L2 message paths the flip (#24789) left dead. Sits on the Fast Inbox stack (#24784..#24792); base is spl/a-1387-circuits-cleanup.

What's removed

  • stdlib / p2p: computeInHashFromL1ToL2Messages and the whole in_hash.ts; the inHash field on BlockProposal (constructor, signed payload, wire, and the createBlockProposal validator-interface argument); the CheckpointProposal.getBlockProposal inHash pass-through; the padded per-checkpoint InboxLeaf helpers (smallestIndexForCheckpoint / indexRangeForCheckpoint / checkpointNumberFromIndex); the legacy getL1ToL2Messages(checkpointNumber) member from the L1ToL2MessageSource and archiver RPC interfaces.
  • archiver: the legacy per-checkpoint getL1ToL2Messages flow, the padded per-checkpoint index invariants, the inboxTreeInProgress readiness gate + L1ToL2MessagesNotReadyError, and the 128-bit keccak rolling hash. InboxMessage now carries only the compact global index and the full-width consensus rolling hash (the vacuous derived checkpointNumber and the 128-bit rollingHash are gone). Reorg detection compares the local consensus rolling hash and total against the Inbox's current rolling-hash bucket (new getBucket / getCurrentBucketSeq / getCurrentBucket wrappers) instead of the 128-bit getState.
  • sequencer / validator: the dead inHash = Fr.ZERO threading through the checkpoint proposal job and the validator/validation-service create-proposal path, plus the dead in_hash_mismatch validation-failure reason.
  • world-state: the no-op first-in-checkpoint padding alias and the obsolete non-first-block-empty-bundle transitional test (the production assertion was already removed at the flip).
  • node: the public-calls simulator's dead next-checkpoint message fetch and its now-unused l1ToL2MessageSource dependency.
  • config / env: AZTEC_INBOX_LAG / inboxLag from ethereum config, foundation env vars, the network-consensus-config list, the l1-contracts + spartan network defaults, and the e2e option plumbing.
  • docs: THREAT_MODEL.md and the archiver README rewritten from the inHash == inbox.consume(...) model to the consensus rolling-hash / bucket model.

Format / store / wire notes

  • Store version bump: ARCHIVER_DB_VERSION 8 → 9 because InboxMessage serialization dropped rollingHash + checkpointNumber and the inboxTreeInProgress singleton is gone. No migration — nodes resync (fresh rollup instance per release line, same no-migration policy as the rest of the stack).
  • p2p wire format: dropping the (zeroed-since-flip) inHash shrinks the block-proposal bytes. Done as a plain removal at a release boundary (fresh networks), matching the A-1381 optional-tail precedent; the golden wire_compat_fixtures.ts buffers were regenerated. The checkpoint-proposal fixture is unaffected (it never carried inHash).
  • L1 follow-through: done (leftover sweep, below). The on-chain Inbox 128-bit messagesRollingHash accumulation, InboxState.rollingHash, and the MessageSent.rollingHash event arg are now removed in this PR — this is the earliest branch where it is safe, since the TS reads disappear here. getState() / getTotalMessagesInserted() are kept: chain_monitor and fast node sync still read the message count.

Testing

Locally green (unit suites that run without @aztec/bb-avm-sim): archiver (561), stdlib p2p + interfaces (76), world-state synchronizer + native (74), validator-client unit (38), ethereum config (6). Suites that import @aztec/bb-avm-sim (p2p libp2p, sequencer-client, node simulator, validator integration) and full typecheck of the packages downstream of the pinned-VK blocker are CI-validated. No e2e / VK regen locally.

Review follow-up (phase-2 final review)

Four commits were appended by the final review pass:

  • The env sweep removed AZTEC_INBOX_LAG from scripts/network-defaults.json while both L1 deploy-script test setUps still readUint the key, reverting before any test ran; the reads are gone.
  • The p2p attestation store version is bumped 2 -> 3: it persists proposal/attestation buffers whose formats changed in this stack (checkpoint header lost inHash; block-proposal wire dropped it), and stored checkpoint attestations decode without a tolerant fallback.
  • l1_publisher.integration.test.ts is reworked for streaming consumption: each checkpoint consumes every message sent while it was built, threading the previous checkpoint's rolling hash and reading the propose bucketHint from the Inbox's current bucket (the legacy inboxLag shift register is gone).
  • Remaining inboxLag/inHash references are swept from the spartan environment profiles, the governance-upgrade tutorial, the validator/sequencer READMEs, and stale e2e comments.

l1 publisher test dissolved into A-1387 (pass-8)

This branch's rewrite of l1_publisher.integration.test.ts is superseded by the corrected streaming-selector version landed at A-1387 (#24792): the branch's own message-reconstruction rework commit is dropped and the file is byte-identical to A-1387's here (segment diff for this file is zero). The A-1384 world-state mock bucket registration coexists with this branch's legacy-message-path deletion (the buckets survive the cleanup). First real box verification of this suite at A-1388: l1_publisher 13/13; world-state integration 12/12 at top.

Leftover sweep (post-review)

  • Removed the legacy 128-bit keccak inbox rolling hash from L1: InboxState.rollingHash, the MessageSent bytes16 rollingHash event arg, and its keccak accumulation in Inbox.sol, updating the four Solidity test suites that asserted it (Inbox.t, InboxBuckets.t, TokenPortal.t, depositToAztecPublic.t) and the three live docs-example inbox ABIs that embedded the old event shape. The node's message sync and L1-reorg detection already run entirely on the full-width consensus rolling hash from the buckets.
  • Deleted the dead InboxLeaf class from stdlib (this branch had already removed its per-checkpoint index helpers) and fixed a stale InboxLeaf mention in the archiver retrieval JSDoc.
  • Clarified the checkpoint-builder comments: the up-front whole-checkpoint message insertion (insertMessagesPerBlock = false) is only exercised by tests; production always streams messages per block.

@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 92cecbd to 83a74e1 Compare July 19, 2026 01:25
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from d06eb0f to 7e1dc3d Compare July 19, 2026 01:25
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from 7e1dc3d to 0e1e0ed Compare July 19, 2026 14:05
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch 2 times, most recently from 115b351 to 5817030 Compare July 19, 2026 15:10
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch 2 times, most recently from 2277ca8 to 43ac45a Compare July 19, 2026 15:36
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 5817030 to 01b921a Compare July 19, 2026 15:36
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from 43ac45a to b82f5cc Compare July 19, 2026 17:57
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 01b921a to 6269f44 Compare July 19, 2026 17:57
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from b82f5cc to 8287158 Compare July 19, 2026 18:02
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 6269f44 to 3111d18 Compare July 19, 2026 18:02
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from 8287158 to 4c4c1a8 Compare July 19, 2026 20:30
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 38cadbf to 5660774 Compare July 19, 2026 20:30
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from 4c4c1a8 to c51c85b Compare July 19, 2026 20:48
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 5660774 to 7fa4b0a Compare July 19, 2026 20:48
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from c51c85b to de57be7 Compare July 19, 2026 20:51
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 7fa4b0a to 0224d57 Compare July 19, 2026 20:51
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from de57be7 to ce83790 Compare July 20, 2026 13:32
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 0224d57 to 02cd879 Compare July 20, 2026 13:32
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from ce83790 to f853ebe Compare July 20, 2026 14:07
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 02cd879 to 05a1f0c Compare July 20, 2026 14:07
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from f853ebe to 9d37080 Compare July 20, 2026 15:30
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 05a1f0c to 93b18af Compare July 20, 2026 15:30
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from 9d37080 to c50ce18 Compare July 20, 2026 17:28
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch 2 times, most recently from 5cc8950 to 94dec7d Compare July 20, 2026 21:21
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from b32e629 to 834ca00 Compare July 21, 2026 15:02
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch 2 times, most recently from 141286e to 92c4a70 Compare July 21, 2026 22:32
@spalladino
spalladino requested a review from just-mitch as a code owner July 21, 2026 22:32
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 834ca00 to 5883528 Compare July 21, 2026 22:32
@spalladino
spalladino requested a review from a team as a code owner July 21, 2026 22:39
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from 92c4a70 to f4cc2db Compare July 27, 2026 20:53
@spalladino
spalladino requested a review from LeilaWang as a code owner July 27, 2026 20:53
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from 398aa38 to f0fb1e1 Compare July 27, 2026 20:53
Removes the legacy inboxLag / AZTEC_INBOX_LAG config field and env var from
ethereum config, foundation env vars, the network-consensus-config list, the
l1-contracts and spartan network defaults, and the e2e test option plumbing.
Also drops the removed inHash argument from the e2e web3signer createBlockProposal
wrapper.
…ers from stdlib/p2p (A-1388)

Deletes computeInHashFromL1ToL2Messages and the inHash field from BlockProposal
(including its signed-payload slot), the CheckpointProposal getBlockProposal
pass-through, and the createBlockProposal inHash argument on the validator
interface. Removes the padded per-checkpoint InboxLeaf helpers
(smallestIndexForCheckpoint / indexRangeForCheckpoint / checkpointNumberFromIndex)
and the legacy getL1ToL2Messages(checkpointNumber) member from the L1ToL2MessageSource
and archiver RPC interfaces. Regenerates the block-proposal golden wire fixtures for
the shrunk payload; the p2p wire format changes at a release boundary (fresh networks),
matching the A-1381 optional-tail precedent.
…aths in the archiver (A-1388)

Removes the legacy getL1ToL2Messages(checkpointNumber) flow, the padded
per-checkpoint index invariants, the inboxTreeInProgress readiness gate, and the
L1ToL2MessagesNotReadyError. InboxMessage drops the 128-bit keccak rollingHash and
the vacuous derived checkpointNumber, so messages carry only the compact global
index and the full-width consensus rolling hash; the store serialization changes and
ARCHIVER_DB_VERSION bumps to 9 (nodes resync, no migration). Reorg detection now
compares the local consensus rolling hash and total against the Inbox's current
rolling-hash bucket via new getBucket/getCurrentBucketSeq/getCurrentBucket wrappers,
replacing the 128-bit getState comparison. Test fakes/mocks move to compact indexing.
…lidator (A-1388)

Removes the dead inHash=Fr.ZERO plumbing through the checkpoint proposal job and
the validator/validation-service createBlockProposal path, and deletes the dead
in_hash_mismatch validation-failure reason from proposal_handler, validator, and
metrics. Updates the sequencer/validator test mocks and callers for the dropped
inHash argument and the removed getL1ToL2Messages message source member.
…ator message fetch (A-1388)

Drops the no-op first-in-checkpoint padding alias and its stale docs in world-state,
and removes the obsolete non-first-block-empty-bundle transitional test. The node
public-calls simulator no longer fetches next-checkpoint messages via the removed
per-checkpoint API and drops its now-unused l1ToL2MessageSource dependency, simulating
against the fork's current tree (streaming Inbox consumes per block). Rewrites the
THREAT_MODEL inHash/consume passages to the consensus rolling-hash / bucket model.
…ts (A-1388)

The optional bucket-reference tail keeps proposals that omit it round-tripping
cleanly; it does not make the wire byte-identical to the pre-inHash-removal format.
Reword the toBuffer/fromBuffer comments to describe only the tail's unset case.
… tests (A-1388)

The env sweep removed AZTEC_INBOX_LAG from scripts/network-defaults.json but
both deploy-script test setUps still readUint the key, which reverts
(vm.parseJsonUint on a missing path), failing the suites before any test
runs. The deploy configuration no longer consumes the env var.
…proposal formats (A-1388)

The attestation store persists raw BlockProposal and CheckpointAttestation
buffers. Both changed shape in this stack (the checkpoint header lost inHash
and the block-proposal wire format dropped its zeroed inHash), and stored
checkpoint attestations are decoded without a tolerant fallback, so a store
written by a pre-Fast-Inbox node would throw on read. Bump 2 -> 3 to wipe
stale pools, matching the archiver's no-migration bump.
…388)

Removes the dead AZTEC_INBOX_LAG entries from the spartan environment
profiles and the governance-upgrade tutorial, rewrites the validator and
sequencer README sections that still described the legacy inHash flow, and
drops e2e comments that still explained fixture settings in terms of the
deleted inboxLag / L1ToL2MessagesNotReadyError behavior. Versioned docs
snapshots are left untouched.
…(A-1388)

Finding the cut point for an L1-block rollback walked the messages backwards from
the tip, deserializing every message being removed just to learn where the removal
starts. A bucket lives entirely within one L1 block and its snapshot now records
that block plus the bucket's first message index, so scan the bucket snapshots
instead — a few records per L1 block rather than one per message.
…sage leaf index (A-1388)

Blocks consume Inbox messages in order into consecutive L1-to-L2 tree leaves, so a message is
available at a tip exactly when that tip's leaf count has grown past the message's index — one
comparison against data every block header already carries. `isL1ToL2MessageReady` now does that
via `getL1ToL2MessageIndex`, which also drops its stale claim that messages land in the first block
of a checkpoint. The `getL1ToL2MessageCheckpoint` node RPC method existed only to answer this
question and needed a binary search over block records to do it, so delete it: node service,
world-state queries, interface, schema, and its callers. `getL1ToL2MessageIndex` takes its place in
the operator API reference.
…ing public calls (A-1388)

A transaction that consumes an L1-to-L2 message sent moments ago failed public simulation until a
block actually consumed the message, because the simulation fork stops at the tip's message tree.
Predict the bundle the next block would take — the sequencer's own bucket selection, so lag
eligibility and the per-block/per-checkpoint caps match what will be built — and append it to the
fork. The prediction treats the next block as non-final (the censorship cutoff only widens
consumption on a checkpoint's last block, which the node cannot know) and derives its cursor from
the fork's own leaf count, so it can never re-insert messages the fork already holds. Best-effort:
unsynced buckets or a missing header leave the simulation on the bare tip, as before.
@spalladino
spalladino force-pushed the spl/a-1387-circuits-cleanup branch from f4cc2db to 666df4c Compare July 28, 2026 12:37
@spalladino
spalladino force-pushed the spl/a-1388-node-cleanup branch from f0fb1e1 to 2d04b54 Compare July 28, 2026 12:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant