Skip to content

GPU acceleration: "--n-gpu-layers 35" - is 35 good? Should I try different numbers? #3

@salamanders

Description

@salamanders

I missed the specific commands to enable GPU acceleration, and when I noticed and tried them, it made a HUGE improvement! (words... slowly... typing... to a very-reasonable-reading-speed generation on a 2017 GPU)

... what is that 35? Should I try larger numbers until it breaks?

Or, alternatively, a "noob" mode feature request of "If I don't specify anything, try some reasonable defaults depending on what hardware is available"

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions