Skip to content

[Feature] Rotary embedding kernel support float32 input dtype #13124

Closed
#13181
Closed
[Feature] Rotary embedding kernel support float32 input dtype#13124
#13181
Labels
good first issueGood for newcomershelp wantedExtra attention is needed
@ispobock

Description

@ispobock
ispobock
opened on Nov 12, 2025

Motivation

Add float32 dtype support for rotary embedding kernel.

sglang/python/sglang/srt/layers/rotary_embedding.py

Line 279 in 7ea5b42

and self.dtype != torch.float32

Related resources

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    good first issueGood for newcomershelp wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions