Skip to content

Fix llama-3#423

Merged
danielhanchen merged 56 commits intomainfrom
nightly
May 4, 2024
Merged

Fix llama-3#423
danielhanchen merged 56 commits intomainfrom
nightly

Conversation

@danielhanchen
Copy link
Contributor

@danielhanchen danielhanchen commented May 4, 2024

  1. GGUF uses CPU not GPU
  2. Fix reserved tokens issues

danielhanchen and others added 30 commits April 20, 2024 04:04
@danielhanchen
Fix prompt
64a7d27
@danielhanchen
Merge branch 'main' into nightly
495f1da
@danielhanchen
Update chat_templates.py
656ab22
@danielhanchen
fix_untrained_tokens
c4f2f54
@danielhanchen
Update llama.py
87b4bb9
@danielhanchen
add tokens
abd192f
@danielhanchen
Update _utils.py
868351b
@danielhanchen
Update tokenizer_utils.py
f29a3e7
@danielhanchen
Update llama.py
2573474
@danielhanchen
Update llama.py
bfb32a3
@danielhanchen
Update llama.py
40a6d00
@danielhanchen
Update llama.py
140a0b0
@danielhanchen
pad_token
88435a8
@danielhanchen
Update chat_templates.py
24790e2
@danielhanchen
Update chat_templates.py
1464f7d
@danielhanchen
tokenizer
df069c5
@danielhanchen
Update save.py
eb00fb7
@danielhanchen
Update chat_templates.py
805f890
@danielhanchen
Update chat_templates.py
80be6ff
@danielhanchen
Merge branch 'main' into nightly
92723ba
@danielhanchen
patch tokenizer padding
2e62a69
@danielhanchen
Update tokenizer_utils.py
b0678d6
@danielhanchen
Update save.py
f85ef9c
@oKatanaaa
Fix: loading models with resized vocabulary (#377)
d2f10a0 
* new: vocab resize on load

* new: gitignore
@danielhanchen
GGUF fix
f5fa654
@danielhanchen @shimmyshimmer
Readme (#390)
8325e05 
* Update README.md

* Update README.md

---------

Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
@danielhanchen
Update README.md
13b1ae6
@danielhanchen
Delete .gitignore
5069a7d
@danielhanchen
Merge branch 'main' into nightly
1ba3379
@danielhanchen
Phi-3
7c9c3f5
@danielhanchen danielhanchen merged commit 53dbf76 into main May 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@danielhanchen @oKatanaaa