Skip to content

NameError: name 'model' is not defined - when max_new_tokens exceeds model.config.max_position_embeddings #2034

@ai-nikolai

Description

@ai-nikolai

When calling model generate and max_new_tokens exceeds

Traceback (most recent call last):
    File "model_evaluator.py", line 63, in generate_answer
      outputs = model.generate(
    File "/home/miniconda3/envs/arc24_fixed_03_2025/lib/python3.10/site-packages/unsloth/models/llama.py", line 1551, in unsloth_fast_generate
      f'Unsloth: input length {kwargs["input_ids"].shape[-1]} + max_new_tokens {kwargs["max_new_tokens"]} exceeds the maximum sequence length of {model.config.max_position_embeddings}!\n'\
NameError: name 'model' is not defined

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions