Skip to content

Option for max_gen_len #10

@simonw

Description

@simonw

This is hard-coded here at the moment:

llm-mlc/llm_mlc.py

Lines 305 to 308 in afbafe8

chat_config_kwargs = {
"max_gen_len": 512,
"conv_config": mlc_chat.ConvConfig(**config_kwargs),
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions