Skip to content

fix: reject client-controlled PD KV transport params - #1725

Merged
hiworldwzj merged 1 commit into
ModelTC:mainfrom
mikemikimike:fix/reject-client-pd-kv-trans-params-1629
Nov 14, 2026
Merged

hiworldwzj merged 1 commit into
ModelTC:mainfrom
mikemikimike:fix/reject-client-pd-kv-trans-params-1629

Conversation

@mikemikimike

@mikemikimike mikemikimike commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Fixes #1629

Issue: #1629

Summary

Prevent public request parameters from populating the internal PD KV transport field. That field is later deserialized by the inference loop and must only be written by the trusted PD manager.

The regression test verifies that a client-supplied value is ignored while trusted transport data can still be assigned through the existing internal setter.

Test plan

  • python -m pytest -q unit_tests/server/core/objs/test_sampling_params.py (34 passed)
  • Black and Flake8 checks for the changed files

@hiworldwzj
hiworldwzj merged commit 1a2a306 into ModelTC:main Nov 14, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] One request with client-controlled pd_kv_trans_params kills the inference loop while /health stays 200

2 participants