I tried importing Qwen1.5-0.5b-Chat which has a single safetensors file and config.json but apr fails to import it correctly:
apr run hf://Qwen/Qwen1.5-0.5B-Chat
=== APR Run ===
Source: hf://Qwen/Qwen1.5-0.5B-Chat
Downloading hf://Qwen/Qwen1.5-0.5B-Chat...
Downloading model.safetensors...
Downloading tokenizer.json...
Download complete!
Using mmap for 1181MB model
error: Inference failed: Inference failed: Operation 'safetensors_inference' not supported: SafeTensors model requires config.json for inference
The files on Hugging Face do show the config.json https://huggingface.co/Qwen/Qwen1.5-0.5B-Chat/tree/main
I tried importing Qwen1.5-0.5b-Chat which has a single safetensors file and config.json but
aprfails to import it correctly:The files on Hugging Face do show the config.json https://huggingface.co/Qwen/Qwen1.5-0.5B-Chat/tree/main