Skip to content

Fix regex mask#1296

Merged
merrymercy merged 2 commits intomainfrom
fix-regex-mask
Sep 2, 2024
Merged

Fix regex mask#1296
merrymercy merged 2 commits intomainfrom
fix-regex-mask

Conversation

@hnyls2002
Copy link
Copy Markdown
Collaborator

@hnyls2002 hnyls2002 commented Sep 2, 2024

Motivation

This PR fixes the wrong regex vocab mask when there are constraint decoding and normal decoding in the same batch.

@merrymercy merrymercy merged commit 47f20da into main Sep 2, 2024
@merrymercy merrymercy deleted the fix-regex-mask branch September 2, 2024 04:51
@qeternity
Copy link
Copy Markdown
Contributor

This is broken again.

@merrymercy
Copy link
Copy Markdown
Contributor

@qeternity can you contribute more unit tests to prevent any broken from happening in the future?

@qeternity
Copy link
Copy Markdown
Contributor

@merrymercy yes I will have a look this week, I'm admittedly not familiar with the test harness, but I'll try to pull something together.

timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants