Skip to content

[Feature] NotImplementedError: Unsloth: fast_inference = True does not yet support full_finetuning = True #3577

@yzeng58

Description

@yzeng58
  1. Did you update? pip install --upgrade unsloth unsloth_zoo

Yes, updated to the latest version.

However, fast_inference=True is still not supported when full_finetuning=True.
Please consider implementing this feature — it would be extremely useful for workflows that require both efficient fine-tuning and fast inference.

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestFeature request pending on roadmap

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions