Skip to content

Unhandled exception: _Xlength_error("string too long") #119

@icewm

Description

@icewm

Use cmake to create the vc++ project ,and debug in vs2022.
python convert-pth-to-ggml.py models/7B/ 1
done.
quantize.exe .\models\7B\ggml-model-f16.bin .\models\7B\ggml-model-q4_0.bin 2
done.
llama -m .\models\7B\ggml-model-q4_0.bin -t 8 -n 128

main: seed = 1678771218
llama_model_load: loading model from '.\models\7B\ggml-model-q4_0.bin' - please wait ...
llama_model_load: n_vocab = 32000
llama_model_load: n_ctx = 512
llama_model_load: n_embd = 4096
llama_model_load: n_mult = 256
llama_model_load: n_head = 32
llama_model_load: n_layer = 32
llama_model_load: n_rot = 128
llama_model_load: f16 = 2
llama_model_load: n_ff = 11008
llama_model_load: n_parts = 1
llama_model_load: ggml ctx size = 4529.34 MB
llama_model_load: memory_size = 512.00 MB, n_mem = 16384
llama_model_load: loading model part 1/1 from '.\models\7B\ggml-model-q4_0.bin'
llama_model_load:

Release file: llama.exe

When i use Debug:

There are "Unhandled exception" in xstring. also in 13B.

Unhandled exception at 0x00007FF8E757051C in llama.exe: Microsoft C++ exception: std::length_error at memory location 0x0000006E15CFCA80.
IN
[[noreturn]] inline void _Xlen_string() {
_Xlength_error("string too long");
}
2023-03-14_134629

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions