You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
C:\llm\llama-cpp\SYCL\b8157>llama-cli --version
load_backend: loaded RPC backend from C:\llm\llama-cpp\SYCL\b8157\ggml-rpc.dll
load_backend: loaded SYCL backend from C:\llm\llama-cpp\SYCL\b8157\ggml-sycl.dll
load_backend: loaded CPU backend from C:\llm\llama-cpp\SYCL\b8157\ggml-cpu-haswell.dll
version: 8157 (2943210c1)
built with Clang 19.1.5 for Windows x86_64
Good day, Jianyu ❤️
@NeoZhangJianyu
I have problems with the performance of the A770 model with the SYCL backend.
PP: 600 vs 1100 t/s
TG: 10 vs 68 t/s
Models:
unsloth/gpt-oss-20b-GGUF https://huggingface.co/unsloth/gpt-oss-20b-GGUF
lmstudio-community/Qwen3.5-35B-A3B-GGUF https://huggingface.co/lmstudio-community/Qwen3.5-35B-A3B-GGUF
SYCL lmstudio-community\Qwen3.5-35B-A3B-GGUF
Vulkan lmstudio-community\Qwen3.5-35B-A3B-GGUF
Tests with GPT-OSS 20B