Skip to content

Fix scaled dot product attention mask argument#236

Merged
davidkoski merged 2 commits intoml-explore:mainfrom
louen:val/fix-sadp
May 7, 2025
Merged

Fix scaled dot product attention mask argument#236
davidkoski merged 2 commits intoml-explore:mainfrom
louen:val/fix-sadp

Conversation

@louen
Copy link
Contributor

@louen louen commented May 7, 2025

It looks like the value passed in the mask_mode should be the empty string by default.

@louen louen changed the title Fix scaled dot product attention reversed condition Fix scaled dot product attention mask argument May 7, 2025
@louen louen marked this pull request as ready for review May 7, 2025 23:09
Copy link
Collaborator

@davidkoski davidkoski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, nice find!

@davidkoski davidkoski merged commit a8f7411 into ml-explore:main May 7, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants