Skip to content

Refactor of http and engine entrypoints to allow custom override #14869

Merged
merrymercy merged 4 commits intomainfrom
lianmin/improve-http
Dec 12, 2025
Merged

Refactor of http and engine entrypoints to allow custom override #14869
merrymercy merged 4 commits intomainfrom
lianmin/improve-http

Conversation

@merrymercy
Copy link
Copy Markdown
Contributor

@merrymercy merrymercy commented Dec 11, 2025

Refactor the class so that people can register their custom launch functions and server args.

  • You can inherit Engine with custom launch_subprocesses_func, server_args_class
  • You can call launch_server with custom launch_subprocesses_func, execute_warmup_func

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@merrymercy
Copy link
Copy Markdown
Contributor Author

/tag-and-rerun-ci

@merrymercy merrymercy merged commit 1b5e903 into main Dec 12, 2025
204 of 223 checks passed
@merrymercy merrymercy deleted the lianmin/improve-http branch December 12, 2025 20:01
Liwansi added a commit to iforgetmyname/sglang that referenced this pull request Dec 13, 2025
…n_eagle3_npu

* 'main' of https://github.com/sgl-project/sglang: (121 commits)
  Super tiny add gsp-fast-prepare (sgl-project#14992)
  Super tiny fix confusing slash_command_handler hint (sgl-project#14976)
  Super tiny remove unused argument (sgl-project#14966)
  [registry] Add a strict mode to model registration (sgl-project#14933)
  Feature/Fix multi lora scheduler blocking issue and evict LoRA None lastly (sgl-project#14795)
  Tune triton fused moe for the case of glm-4.6-fp8 b200 tp4 (sgl-project#15020)
  [model-gateway] refactor: unify worker management into modular workflow structure (sgl-project#15010)
  Update ci permission (sgl-project#15014)
  Refactor of http and engine entrypoints to allow custom override  (sgl-project#14869)
  Add KV4-capable backend flashmla and update server args (sgl-project#14989)
  Revert several PRs (sgl-project#14958)
  Super tiny extract route_typed_request_once (sgl-project#14951)
  Fix CI by reverting incorrect metric check logic (sgl-project#15004)
  [model-gateway] refactor: workflow engine cleanup and minor optimization (sgl-project#15001)
  [model-gateway] fix: handle workflow deadlock and optimize cycle detection (sgl-project#15000)
  [model-gateway] feat: add DAG parallel execution support and workflow optimization (sgl-project#14999)
  [model-gateway] refactor: extract workflow engine to src/workflow module (sgl-project#14996)
  Update CODEOWNERS for multimodal_gen (sgl-project#14995)
  [diffusion] docker: Tiny fix Docker Hub link in installation documentation (sgl-project#14987)
  [PD] Add decode PP event loop for PD disaggregation (sgl-project#14945)
  ...

# Conflicts:
#	python/sglang/srt/model_executor/piecewise_cuda_graph_runner.py
vermouth1992 pushed a commit to verl-project/verl that referenced this pull request Dec 20, 2025
…glang_server.py` (#4617)

Breaking change in sgl-project/sglang#14869,
keeping `app.warmup_thread_args` should make it backwards compatible
jsfanfanfan pushed a commit to meituan-search/verl that referenced this pull request Jan 9, 2026
…glang_server.py` (verl-project#4617)

Breaking change in sgl-project/sglang#14869,
keeping `app.warmup_thread_args` should make it backwards compatible
vyomakesh0728 added a commit to vyomakesh0728/verl that referenced this pull request Jan 22, 2026
…glang_server.py` (verl-project#4617)

Breaking change in sgl-project/sglang#14869,
keeping `app.warmup_thread_args` should make it backwards compatible
sophiayyya pushed a commit to sophiayyya/verl that referenced this pull request Jan 25, 2026
…glang_server.py` (verl-project#4617)

Breaking change in sgl-project/sglang#14869,
keeping `app.warmup_thread_args` should make it backwards compatible
y-a23 pushed a commit to y-a23/query that referenced this pull request Feb 5, 2026
…glang_server.py` (#4617)

Breaking change in sgl-project/sglang#14869,
keeping `app.warmup_thread_args` should make it backwards compatible
KimperYang pushed a commit to KimperYang/TauVerl that referenced this pull request Mar 3, 2026
…glang_server.py` (#4617)

Breaking change in sgl-project/sglang#14869,
keeping `app.warmup_thread_args` should make it backwards compatible
DaizeDong pushed a commit to DaizeDong/verl that referenced this pull request Apr 19, 2026
…glang_server.py` (verl-project#4617)

Breaking change in sgl-project/sglang#14869,
keeping `app.warmup_thread_args` should make it backwards compatible
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant