Skip to content

feat: add eagle3 spec decoding for minicpm#8842

Open
LDLINGLINGLING wants to merge 7 commits intosgl-project:mainfrom
LDLINGLINGLING:main
Open

feat: add eagle3 spec decoding for minicpm#8842
LDLINGLINGLING wants to merge 7 commits intosgl-project:mainfrom
LDLINGLINGLING:main

Conversation

@LDLINGLINGLING
Copy link
Copy Markdown

@LDLINGLINGLING LDLINGLINGLING commented Aug 6, 2025

Motivation

Added the Eagle3 speculative decoding feature to the MiniCPM model

Modifications

Added several functions to support Eagle3 in /model/MiniCPM.py, primarily to retrieve hidden layers from the target model.

Accuracy Test

Benchmark & Profiling

<!image -->

Checklist

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@yhyang201
Copy link
Copy Markdown
Collaborator

I have submitted it, but it hasn't been reviewed yet: #6899

@mickqian mickqian changed the title 增加了MiniCPM的eagle3投机解码模块 feat: add eagle3 spec decoding for minicpm Sep 8, 2025
@mickqian mickqian mentioned this pull request Sep 8, 2025
6 tasks
Copy link
Copy Markdown
Collaborator

@mickqian mickqian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please talk with @yhyang201 with his pr #6899

Comment thread python/sglang/srt/models/minicpm.py Outdated
@b8zhong b8zhong added the run-ci label Sep 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants