Skip to content

Releases: simonw/llm-mlc

0.5

15 Aug 04:22
@simonw simonw
0.5
b05eec9

Choose a tag to compare

View all tags
0.5 Latest
Latest
  • New -o max_gen_len 100 option for setting the maximum length of the generated text. #10
Assets 2
Loading

0.4

14 Aug 00:21
@simonw simonw
0.4
afbafe8
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
0.4
  • The llm mlc download-model command now takes zero or more optional -a/--alias options to configure aliases for the model once it has been installed. #4: 
    llm mlc download-model Llama-2-7b-chat --alias llama2
  • Installation instructions are clearer, and show how to install required dependencies first. #6
  • The plugin no longer crashes llm if it cannot find the dist/prebuilt folder. #9
  • New options for temperature, top_p and repetition_penalty: #7 
    llm -m Llama-2-7b-chat \
  -o temperature 0.5 \
  -o top_p 0.9 \
  -o repetition_penalty 0.9 \
  'five names for a cute pet ferret'
Loading

0.3

12 Aug 05:26
@simonw simonw
0.3
5792acb
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
0.3
  • Conversation mode now works, so you can continue a conversation with an MLC model with llm -c "follow-up prompt". #3
Loading

0.2

12 Aug 04:52
@simonw simonw
0.2
c400925
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
0.2
  • Token streaming now works. #2
Loading

0.1a0

12 Aug 02:07
@simonw simonw
0.1
4a7c7e0

Choose a tag to compare

View all tags
0.1a0 Pre-release
Pre-release
  • Initial release. Tools for installing and running MLC models using LLM. #1
Loading