Skip to content

[Bug] [GLM5/DSv32] PP rank1 hidden_states KEY error #19686

@whybeyoung

Description

@whybeyoung

Checklist

  • I searched related issues but found no solution.
  • The bug persists in the latest version.
  • Issues without environment info and a minimal reproducible demo are hard to resolve and may receive no feedback.
  • If this is not a bug report but a general question, please start a discussion at https://github.com/sgl-project/sglang/discussions. Otherwise, it will be closed.
  • Please use English. Otherwise, it will be closed.

Describe the bug

Image Image

Reproduction

glm5 pp2tp8

Environment

H20

CC @ShangmingCai @hnyls2002

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions