Repository navigation
[MemCache] Return only the matched length from match_prefix; read KV indices off the node path - #42923
Merged
Conversation
hnyls2002
requested review from
ByronHsu,
Duyi-Wang,
HaiShaw,
Jialin,
ShangmingCai,
Ying1123,
alphabetc1,
hanming-lu,
huangtingwei9988,
hzh0425,
iforgetmyname,
ispobock,
merrymercy,
ping1jing2,
sogalin,
whybeyoung,
xiezhq-hermann and
yizhang2077
as code owners
October 7, 2026 06:39
github-actions
Bot
added
documentation
hnyls2002
force-pushed
the
lsyin/extend-end
branch
from
October 7, 2026 22:58
d38a0fe to
4d1a22e
Compare
hnyls2002
requested review from
ClawSeven,
Fridge003,
rwang5203 and
yeahdongcn
as code owners
October 7, 2026 22:58
hnyls2002
force-pushed
the
lsyin/extend-end
branch
from
October 7, 2026 23:04
4d1a22e to
426f555
Compare
hnyls2002
force-pushed
the
lsyin/match-len
branch
from
October 7, 2026 23:13
2c1e032 to
c9f340b
Compare
Collaborator
Author
|
/tag-and-rerun-ci |
Collaborator
Author
|
/rerun-test test_radix_cache_unit.py test_unified_cache_linker.py test_unified_radix_cache_unittest.py test_unified_radix_cache_bench.py test_rust_unified_radix_cache_unittest.py test_radix_cache_hit.py test_swa_radix_cache_kl.py test_hicache_variants.py test_hicache_storage_file_backend.py test_disaggregation_decode_offload.py test_disaggregation_decode_radix_cache.py |
Contributor
|
🚀 🚀 🚀 🚀 |
ispobock
approved these changes
Oct 8, 2026
nvpohanh
added a commit
to weireweire/sglang
that referenced
this pull request
Oct 13, 2026
Resolve the conflict in rust/sglang-radix-tree/src/python_bindings.rs with the PyO3 0.29 upgrade (sgl-project#42807) and the dynamo_kv_event_format binding parameter (sgl-project#42455): convert the EvictExcessPathStates action with into_py_any, keep both dynamo_kv_event_format and swa_max_states_per_path in TreeCoreInitParamsBinding, and call the two-argument evict_excess_path_states under py.detach. sgl-project#42923 replaced MatchResult.device_indices with device_prefix_len, so the SWA path-cap fixture tests now read device_prefix_len. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
MatchResultcarriesdevice_prefix_leninstead of the concatenateddevice_indices; radix, unified (Python and Rust tree core), FlexKV, LMCache and session matches no longer concatenate per-node valuesBasePrefixCache.path_device_indices(node)(checkpoint rematch, PD decode prealloc / rematch, LMCache publish / store, buffer-mode ownership check) andprefix_device_indices(req)at allocationempty_device_indicesfor empty placeholdersCI States
Latest PR Test (Base): ❌ Run #37709082763
Latest PR Test (Extra): ❌ Blocked --
run-ciis required first.Latest PR Test (AMD ROCm 10): ❌ Run #37709082516