Not sure if anyone else had hit into this but when using liuhaotian/llava-v1.5-13b with llava-hf/llava-1.5-13b-hf tokenizer, randomly I get outputs full of only newlines. The frequency of this happening increases when the temperature is close to 0 but also happens at 1 as well.
Not sure if anyone else had hit into this but when using
liuhaotian/llava-v1.5-13bwithllava-hf/llava-1.5-13b-hftokenizer, randomly I get outputs full of only newlines. The frequency of this happening increases when the temperature is close to 0 but also happens at 1 as well.