Skip to content

add for vchunk(demo), kv partition(ok), cvm(ok),submaster architecture - #45

Merged
wangyuqi0429 merged 28 commits into
LinQuickDev:supercache-snapshot-930from
wangyuqi0429:supercache_ha
Sep 3, 2026
Merged

add for vchunk(demo), kv partition(ok), cvm(ok),submaster architecture#45
wangyuqi0429 merged 28 commits into
LinQuickDev:supercache-snapshot-930from
wangyuqi0429:supercache_ha

Conversation

@wangyuqi0429

@wangyuqi0429 wangyuqi0429 commented Sep 3, 2026

Copy link
Copy Markdown

Description

Module

  • Transfer Engine (mooncake-transfer-engine)
  • Mooncake Store (mooncake-store)
  • Reshard (mooncake-reshard)
  • Mooncake EP (mooncake-ep)
  • Mooncake PG (mooncake-pg)
  • Integration (mooncake-integration)
  • P2P Store (mooncake-p2p-store)
  • Python Wheel (mooncake-wheel)
  • Common (mooncake-common)
  • Mooncake RL (mooncake-rl)
  • CI/CD
  • Docs
  • Other

Type of Change

  • Bug fix
  • New feature
  • Refactor
  • Breaking change
  • Documentation update
  • Performance improvement
  • Other

How Has This Been Tested?

Test commands:

# Example: bash scripts/run_ci_test.sh

Test results:

  • Unit tests pass
  • Integration tests pass (if applicable)
  • Manual testing done (describe below)

Checklist

  • I have performed a self-review of my own code
  • I have formatted my code using ./scripts/code_format.sh
  • I have run pre-commit on the files changed in this PR and all hooks pass
  • I have updated the documentation (if applicable)
  • I have added tests to prove my changes are effective
  • For changes >500 LOC: I have filed an RFC issue

AI Assistance Disclosure

  • No AI tools were used
  • AI tools were used (specify below)

zchuango and others added 28 commits August 17, 2026 10:40
Introduce vchunk configuration, slice sizing, metadata validation and serialization foundations with initial unit coverage.
Implement vchunk allocation, master-side lifecycle management, rollback handling and related tests.
Connect client Put, Get and Remove operations to the vchunk control and data planes with retry, timeout and cleanup handling.
Add persistent metadata recovery, reaping, metrics, configuration validation and supporting regression tests.
Add comparative benchmarks and machine-readable reporting for the legacy and vchunk paths.
Correct recovery state handling and keep allocator-backed resources alive for active reads and object cleanup.
Use the correct integer address representation when constructing test segments.
Add a distributed benchmark path using real RPC, ETCD and TransferEngine components and remove superseded temporary probes.
Remove the startup-only incompatibility check while retaining runtime safety gates.
Reject all vchunk control-plane operations when the feature is disabled and include the complete service types required by tests.
Route vchunk requests through the CVM slot map, refresh stale routes with bounded retries, and restrict recovery and cleanup to locally owned slots.
Serialize routed client target changes, add remote read leases, enforce end-to-end deadlines and reject unstable slot ownership.
Include the time helper declaration required by the remote read-lease RPC implementation.
@github-actions github-actions Bot added documentation Improvements or additions to documentation run-ci labels Sep 3, 2026
@wangyuqi0429
wangyuqi0429 merged commit 00ce997 into LinQuickDev:supercache-snapshot-930 Sep 3, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Common documentation Improvements or additions to documentation run-ci store

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants