forked from ggml-org/llama.cpp
-
Notifications
You must be signed in to change notification settings - Fork 633
Open
Description
Describe the Issue
The model accepts 32768 as the maximum context size. However, if I set this value, I get a context overflow error by 128 (32896). If I try to set 32640 to get exactly 32768, I get this error in the UI, but the model loads fine with the --config flag.
Exception in Tkinter callback
Traceback (most recent call last):
File "C:\Program Files\Python313\Lib\tkinter\__init__.py", line 2074, in __call__
return self.func(*args)
~~~~~~~~~^^^^^^^
File "C:\Program Files\Python313\site-packages\customtkinter\windows\widgets\ctk_button.py", line 554, in _clicked
self._command()
~~~~~~~~~~~~~^^
File "C:\Program Files\KoboldCpp\koboldcpp\koboldcpp.py", line 5972, in load_config_gui
import_vars(dict)
~~~~~~~~~~~^^^^^^
File "C:\Program Files\KoboldCpp\koboldcpp\koboldcpp.py", line 5813, in import_vars
context_var.set(contextsize_text.index(str(dict["contextsize"])))
~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: '32640' is not in list
Additional Information:
KoboldCpp - Version 1.99.4
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels