Skip to content

contextsize is not in list #1782

@jojorne

Description

@jojorne

Describe the Issue
The model accepts 32768 as the maximum context size. However, if I set this value, I get a context overflow error by 128 (32896). If I try to set 32640 to get exactly 32768, I get this error in the UI, but the model loads fine with the --config flag.

Exception in Tkinter callback
Traceback (most recent call last):
  File "C:\Program Files\Python313\Lib\tkinter\__init__.py", line 2074, in __call__
    return self.func(*args)
           ~~~~~~~~~^^^^^^^
  File "C:\Program Files\Python313\site-packages\customtkinter\windows\widgets\ctk_button.py", line 554, in _clicked
    self._command()
    ~~~~~~~~~~~~~^^
  File "C:\Program Files\KoboldCpp\koboldcpp\koboldcpp.py", line 5972, in load_config_gui
    import_vars(dict)
    ~~~~~~~~~~~^^^^^^
  File "C:\Program Files\KoboldCpp\koboldcpp\koboldcpp.py", line 5813, in import_vars
    context_var.set(contextsize_text.index(str(dict["contextsize"])))
                    ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: '32640' is not in list

Additional Information:
KoboldCpp - Version 1.99.4

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions