Skip to content

Add Support for DeepSeek-R1 models#687

Merged
cjpais merged 2 commits intomozilla-ai:mainfrom
Xydane:main
Jan 30, 2025
Merged

Add Support for DeepSeek-R1 models#687
cjpais merged 2 commits intomozilla-ai:mainfrom
Xydane:main

Conversation

@Xydane
Copy link
Copy Markdown
Contributor

@Xydane Xydane commented Jan 29, 2025

I have incorporated recent changes from llama.cpp to support the DeepSeek-R1 models.

@cjpais
Copy link
Copy Markdown
Collaborator

cjpais commented Jan 29, 2025

I tried it with Qwen Distill 1.5B and it works

Copy link
Copy Markdown
Collaborator

@jart jart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Thank you!

@cjpais cjpais merged commit 29b5f27 into mozilla-ai:main Jan 30, 2025
@RonanKMcGovern
Copy link
Copy Markdown

Could a new release be made? (if this is necessary).

Building from source is quite tricky (on Mac)

@rutravis
Copy link
Copy Markdown

Could a new release be made? (if this is necessary).

Building from source is quite tricky (on Mac)

I second the ask for a new release. I have an app that needs it, but I cannot compile it. Thanks in advance!!

@cjpais
Copy link
Copy Markdown
Collaborator

cjpais commented Feb 14, 2025

I will try and get a new release out soon, maybe the next day or two, but if not by the end of next week

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants