Repository navigation
Cache bundle analysis per output file - #100475
Merged
Merged
Conversation
wbinnssmith
added this pull request to stack #100476
October 20, 2026 22:35
Contributor
Tests PassedCommit: 33c5747 |
wbinnssmith
marked this pull request as ready for review
October 20, 2026 22:49
lukesandberg
approved these changes
Oct 20, 2026
wbinnssmith
removed this pull request from stack #100476
October 20, 2026 23:55
wbinnssmith
added this pull request to stack #100487
October 20, 2026 23:55
wbinnssmith
force-pushed
the
codex/analyze-compressed-size-cache
branch
from
October 21, 2026 00:07
6b27a5a to
74e9659
Compare
wbinnssmith
removed this pull request from stack #100487
October 21, 2026 20:51
wbinnssmith
added this pull request to stack #100546
October 21, 2026 20:51
Analyze each emitted and traced file once in a cached task that returns its filename, chunk membership, and chunk parts with normalized sources and compressed sizes. Routes previously made 3-5 task calls per shared file, and task-graph bookkeeping for those calls dominated analysis. Splitting, compression, and membership enumeration become plain helpers under that task, since each is read once.
wbinnssmith
force-pushed
the
codex/analyze-compressed-size-cache
branch
from
October 21, 2026 22:00
ef570f5 to
33c5747
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Analyze each emitted and traced file once in a cached task that returns its filename, chunk membership, and chunk parts with normalized sources and compressed sizes. Routes previously made 3â5 task calls per shared file, and task-graph bookkeeping for those calls dominated analysis. Splitting, compression, and membership enumeration run as plain helpers under that task, since each is read once.
Measured on v0/chat with
next build --analyze(#99962), analysis phase only: new tasks went from 269k to 242k, calls into existing tasks from 8.49M to 5.07M, and median CPU time from 150s to 124s. All 455 data artifacts were byte-identical across 12 runs.Supersedes #100486.
Verification
cargo test -p turbopack-analyze --test split_chunkandcargo test -p next-api --lib analyzepassed.release-with-debug, installed it in v0/chat, and comparednext build --analyzeoutput against the previous binary across alternating runs.