All Platforms
Linux Results
Server & desktop Linux distributions
|
CPU
|
GPU
|
Memory
|
OS Version | Ollama | Model | Throughput |
|---|---|---|---|---|---|---|
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 NVIDIA GeForce RTX 5090 | 123 GB | Ubuntu 24.04.3 LTS | 0.14.2 | gpt-oss:20b | 292.75 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 NVIDIA GeForce RTX 5090 | 123 GB | Ubuntu 24.04.3 LTS | 0.14.2 | gpt-oss:20b | 292.30 tok/s |
| AMD Ryzen 7 9800X3D 8-Core Processor | NVIDIA GeForce RTX 5090 | 60 GB | Arch Linux | 0.13.5 | gpt-oss:20b | 285.50 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 | 60 GB | CachyOS | 0.17.0 | gpt-oss:20b | 282.27 tok/s |
| 13th Gen Intel(R) Core(TM) i9-13900K | NVIDIA GeForce RTX 5090 | 125 GB | Ubuntu 24.04.4 LTS | 0.17.6 | gpt-oss:20b | 262.46 tok/s |
| unknown | NVIDIA GeForce RTX 5090 | 78 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 259.54 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 254.57 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 253.32 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 253.12 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 | 249 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 252.32 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 252.12 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 251.97 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 251.81 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 251.47 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 250.84 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 250.52 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 250.34 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 250.22 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 250.01 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 249.97 tok/s |
| AMD EPYC 9354P 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 200 GB | "Debian GNU/Linux 13 (trixie)" | 0.16.1 | gpt-oss:20b | 249.91 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 249.85 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 249.79 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 249.53 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 249.32 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 | 249 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 249.31 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 248.56 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 248.30 tok/s |
| AMD Ryzen 9 7950X3D 16-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 125 GB | Ubuntu 24.04.3 LTS | 0.17.7 | gpt-oss:20b | 247.68 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 | 249 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 242.34 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 | 249 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 242.16 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 239.73 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 239.23 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 239.16 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 238.82 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 238.80 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 | 92 GB | Ubuntu 24.04.2 LTS | 0.12.6 | gpt-oss:20b | 238.38 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 238.07 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 236.05 tok/s |
| AMD EPYC 9555 64-Core Processor | NVIDIA H200 NVL | 252 GB | Ubuntu 24.04.4 LTS | 0.16.2 | gpt-oss:20b | 231.65 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 | 249 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 227.70 tok/s |
| AMD EPYC 9J14 96-Core Processor | NVIDIA GeForce RTX 5090 NVIDIA GeForce RTX 5090 | 755 GB | "Ubuntu 24.04.3 LTS" | 0.15.5 | gpt-oss:20b | 224.71 tok/s |
| AMD EPYC 9355P 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Workstation Edition NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 1,133 GB | "Ubuntu 24.04.3 LTS" | 0.13.0 | gpt-oss:20b | 224.40 tok/s |
| 13th Gen Intel(R) Core(TM) i5-13600K | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 126 GB | Ubuntu 22.04.5 LTS | 0.16.3 | gpt-oss:20b | 218.98 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 | 249 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 217.90 tok/s |
| AMD EPYC 9135 16-Core Processor | NVIDIA RTX PRO 6000 Blackwell Server Edition NVIDIA RTX PRO 6000 Blackwell Server Edition | 378 GB | Ubuntu 24.04.3 LTS | 0.12.10 | gpt-oss:20b | 203.59 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 251 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 201.35 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 251 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 199.29 tok/s |
| Intel(R) Xeon(R) Gold 6442Y | NVIDIA H100 NVL | 504 GB | "Ubuntu 24.04.3 LTS" | 0.12.6 | gpt-oss:20b | 197.57 tok/s |
| Intel(R) Xeon(R) Gold 6442Y | NVIDIA H100 NVL | 504 GB | "Ubuntu 24.04.3 LTS" | 0.12.6 | gpt-oss:20b | 197.31 tok/s |
| Intel(R) Xeon(R) Gold 6442Y | NVIDIA H100 NVL | 504 GB | "Ubuntu 24.04.3 LTS" | 0.12.6 | gpt-oss:20b | 196.78 tok/s |
| Intel(R) Xeon(R) Gold 6442Y | NVIDIA H100 NVL | 504 GB | "Ubuntu 24.04.3 LTS" | 0.12.6 | gpt-oss:20b | 194.43 tok/s |
| Intel(R) Xeon(R) Gold 6442Y | NVIDIA H100 NVL | 504 GB | "Ubuntu 24.04.3 LTS" | 0.12.6 | gpt-oss:20b | 193.80 tok/s |
| Intel(R) Xeon(R) Platinum 8458P | NVIDIA H100 PCIe | 236 GB | Ubuntu 22.04.5 LTS | 0.15.6 | gpt-oss:20b | 192.78 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 251 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 191.08 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Arch Linux | 0.18.2 | gpt-oss:20b | 188.87 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX PRO 6000 Blackwell Server Edition | 251 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 188.57 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 4090 | 63 GB | Kali GNU/Linux Rolling | 0.18.3 | gpt-oss:20b | 188.21 tok/s |
| AMD EPYC 7402P 24-Core Processor | NVIDIA RTX A6000 NVIDIA RTX A6000 NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 126 GB | Ubuntu 24.04.3 LTS | 0.11.11 | gpt-oss:20b | 188.11 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Arch Linux | 0.18.2 | gpt-oss:20b | 187.70 tok/s |
| AMD EPYC 7402P 24-Core Processor | NVIDIA RTX A6000 NVIDIA RTX A6000 NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 126 GB | Ubuntu 24.04.3 LTS | 0.11.11 | gpt-oss:20b | 187.52 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Arch Linux | 0.18.2 | gpt-oss:20b | 186.23 tok/s |
| AMD EPYC 9555 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 251 GB | "Ubuntu 24.04.2 LTS" | 0.11.6 | gpt-oss:20b | 185.76 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 77 GB | Ubuntu 24.04.2 LTS | 0.13.5 | gpt-oss:20b | 183.24 tok/s |
| AMD Ryzen 9 5900XT 16-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.15.5 | gpt-oss:20b | 182.27 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 77 GB | Ubuntu 24.04.2 LTS | 0.13.5 | gpt-oss:20b | 182.22 tok/s |
| AMD Ryzen 9 9950X 16-Core Processor | NVIDIA GeForce RTX 3090 Ti | 94 GB | Ubuntu 24.04.3 LTS | 0.15.1 | gpt-oss:20b | 181.91 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 181.25 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.75 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.73 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.54 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.54 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.45 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.44 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.32 tok/s |
| AMD EPYC 7402P 24-Core Processor | NVIDIA RTX A6000 NVIDIA RTX A6000 NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 126 GB | Ubuntu 24.04.3 LTS | 0.11.11 | gpt-oss:20b | 180.25 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.22 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.13 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.11 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.10 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.08 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 180.04 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 179.76 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 179.65 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 179.65 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 179.47 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 178.26 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 77 GB | Ubuntu 24.04.2 LTS | 0.13.5 | gpt-oss:20b | 177.59 tok/s |
| (900-2G530-0060-000) | NVIDIA GH200 480GB | 574 GB | Ubuntu 22.04.5 LTS | 0.11.5 | gpt-oss:20b | 176.91 tok/s |
| AMD EPYC 7402P 24-Core Processor | NVIDIA RTX A6000 NVIDIA RTX A6000 NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 126 GB | Ubuntu 24.04.3 LTS | 0.11.11 | gpt-oss:20b | 176.73 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX PRO 5000 Blackwell | 125 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 174.37 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX PRO 5000 Blackwell | 125 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 174.18 tok/s |
| Intel(R) Xeon(R) w7-3565X | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 251 GB | Ubuntu 24.04.3 LTS | 0.11.6 | gpt-oss:20b | 173.58 tok/s |
| QEMU Virtual CPU version 2.5+ | NVIDIA GeForce RTX 5080 | 94 GB | "Fedora Linux 42 (Server Edition)" | 0.17.2 | gpt-oss:20b | 172.16 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 171.73 tok/s |
| AMD EPYC 9354 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 377 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 170.87 tok/s |
| unknown | NVIDIA GeForce RTX 4090 | 63 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 170.64 tok/s |
| AMD Ryzen 9 9950X 16-Core Processor | NVIDIA GeForce RTX 3090 Ti | 94 GB | Ubuntu 24.04.3 LTS | 0.15.1 | gpt-oss:20b | 170.49 tok/s |
| unknown | NVIDIA GeForce RTX 4090 | 63 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 170.26 tok/s |
| AMD Ryzen 9 9950X 16-Core Processor | NVIDIA GeForce RTX 3090 Ti | 94 GB | Ubuntu 24.04.3 LTS | 0.15.1 | gpt-oss:20b | 170.14 tok/s |
| AMD Ryzen 9 9950X 16-Core Processor | NVIDIA GeForce RTX 3090 Ti | 94 GB | Ubuntu 24.04.3 LTS | 0.15.1 | gpt-oss:20b | 169.86 tok/s |
| AMD EPYC 9354 32-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 377 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 167.60 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 166.18 tok/s |
| unknown | NVIDIA GeForce RTX 5070 Ti | 31 GB | Ubuntu 24.04.3 LTS | 0.16.3 | gpt-oss:20b | 164.98 tok/s |
| unknown | NVIDIA RTX 6000 Ada Generation | 504 GB | Ubuntu 24.04.3 LTS | 0.14.1 | gpt-oss:20b | 164.64 tok/s |
| 13th Gen Intel(R) Core(TM) i5-13400 | NVIDIA GeForce RTX 3090 Ti | 128 GB | Ubuntu 24.04.3 LTS | 0.17.6 | gpt-oss:20b | 163.74 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 163.63 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 5070 Ti | 61 GB | Ubuntu 25.10 | 0.18.3 | gpt-oss:20b | 163.57 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 163.25 tok/s |
| Intel(R) Xeon(R) Gold 5412U | NVIDIA RTX 6000 Ada Generation | 377 GB | "Ubuntu 24.04.1 LTS" | 0.14.2 | gpt-oss:20b | 162.56 tok/s |
| Intel(R) Xeon(R) Gold 5412U | NVIDIA RTX 6000 Ada Generation | 377 GB | "Ubuntu 24.04.1 LTS" | 0.14.2 | gpt-oss:20b | 162.55 tok/s |
| Intel(R) Xeon(R) Gold 5412U | NVIDIA RTX 6000 Ada Generation | 377 GB | "Ubuntu 24.04.1 LTS" | 0.14.2 | gpt-oss:20b | 162.43 tok/s |
| Intel(R) Xeon(R) Gold 5412U | NVIDIA RTX 6000 Ada Generation | 377 GB | "Ubuntu 24.04.1 LTS" | 0.14.2 | gpt-oss:20b | 162.43 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 162.42 tok/s |
| Intel(R) Xeon(R) Gold 5412U | NVIDIA RTX 6000 Ada Generation | 377 GB | "Ubuntu 24.04.1 LTS" | 0.14.2 | gpt-oss:20b | 162.41 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 162.18 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 161.91 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 161.44 tok/s |
| AMD Ryzen Threadripper PRO 5945WX 12-Cores | NVIDIA GeForce RTX 4090 | 252 GB | Ubuntu 24.04.2 LTS | 0.11.10 | gpt-oss:20b | 161.32 tok/s |
| Intel(R) Xeon(R) Gold 5412U | NVIDIA RTX 6000 Ada Generation | 377 GB | "Ubuntu 24.04.1 LTS" | 0.14.3 | gpt-oss:20b | 161.03 tok/s |
| AMD Ryzen Threadripper PRO 5945WX 12-Cores | NVIDIA GeForce RTX 4090 | 252 GB | Ubuntu 24.04.2 LTS | 0.11.10 | gpt-oss:20b | 160.86 tok/s |
| AMD Ryzen 9 7950X 16-Core Processor | NVIDIA GeForce RTX 3090 | 62 GB | Ubuntu 24.04.4 LTS | 0.16.1 | gpt-oss:20b | 160.85 tok/s |
| Intel(R) Xeon(R) Gold 5412U | NVIDIA RTX 6000 Ada Generation | 377 GB | "Ubuntu 24.04.1 LTS" | 0.14.3 | gpt-oss:20b | 160.51 tok/s |
| Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz | NVIDIA H100 80GB HBM3 NVIDIA H100 80GB HBM3 | 460 GB | Debian GNU/Linux 12 (bookworm) | 0.11.8 | gpt-oss:20b | 159.86 tok/s |
| AMD Ryzen AI 9 HX 370 w/ Radeon 890M | NVIDIA GeForce RTX 5070 Ti | 58 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 159.82 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 3090 | 126 GB | Pop!_OS 22.04 LTS | 0.15.1 | gpt-oss:20b | 158.18 tok/s |
| Intel(R) Core(TM) Ultra 9 285H | NVIDIA GeForce RTX 5070 Ti | 125 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 158.01 tok/s |
| AMD EPYC 7713 64-Core Processor | NVIDIA A100 80GB PCIe | 1,259 GB | Red Hat Enterprise Linux release 8.6 (Ootpa) | 0.12.10 | gpt-oss:20b | 157.56 tok/s |
| Intel(R) Core(TM) Ultra 9 285H | NVIDIA GeForce RTX 5070 Ti | 125 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 157.42 tok/s |
| AMD Ryzen Threadripper PRO 5945WX 12-Cores | NVIDIA GeForce RTX 4090 | 252 GB | Ubuntu 24.04.2 LTS | 0.11.11 | gpt-oss:20b | 156.60 tok/s |
| AMD Ryzen 9 5900XT 16-Core Processor | NVIDIA GeForce RTX 3090 | 63 GB | Ubuntu 22.04.5 LTS | 0.15.5 | gpt-oss:20b | 156.54 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 5090 | 249 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 156.53 tok/s |
| AMD Ryzen Threadripper PRO 5945WX 12-Cores | NVIDIA GeForce RTX 4090 | 252 GB | Ubuntu 24.04.2 LTS | 0.11.11 | gpt-oss:20b | 156.17 tok/s |
| AMD Ryzen AI 9 HX 370 w/ Radeon 890M | NVIDIA GeForce RTX 5070 Ti | 58 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 154.09 tok/s |
| AMD EPYC 7713 64-Core Processor | NVIDIA A100-PCIE-40GB | 2,015 GB | Red Hat Enterprise Linux release 8.6 (Ootpa) | 0.12.10 | gpt-oss:20b | 153.98 tok/s |
| AMD Ryzen Threadripper PRO 5945WX 12-Cores | NVIDIA GeForce RTX 4090 | 252 GB | Ubuntu 24.04.2 LTS | 0.11.11 | gpt-oss:20b | 153.90 tok/s |
| AMD EPYC 7713 64-Core Processor | NVIDIA A100-PCIE-40GB | 2,015 GB | Red Hat Enterprise Linux release 8.6 (Ootpa) | 0.12.10 | gpt-oss:20b | 153.44 tok/s |
| AMD EPYC 7713 64-Core Processor | NVIDIA A100-PCIE-40GB | 2,015 GB | Red Hat Enterprise Linux release 8.6 (Ootpa) | 0.12.10 | gpt-oss:20b | 153.18 tok/s |
| AMD EPYC 9454 48-Core Processor | NVIDIA RTX PRO 4500 Blackwell NVIDIA RTX PRO 4500 Blackwell NVIDIA RTX PRO 4500 Blackwell NVIDIA RTX PRO 4500 Blackwell NVIDIA RTX PRO 4500 Blackwell NVIDIA RTX PRO 4500 Blackwell | 126 GB | "Arch Linux" | 0.15.2 | gpt-oss:20b | 152.25 tok/s |
| Intel(R) Core(TM) Ultra 7 265K | NVIDIA GeForce RTX 5070 Ti | 31 GB | Ubuntu 22.04.5 LTS | 0.18.1 | gpt-oss:20b | 151.90 tok/s |
| AMD Ryzen AI 9 HX 370 w/ Radeon 890M | NVIDIA GeForce RTX 3090 | 125 GB | Debian GNU/Linux 13 (trixie) | 0.16.2 | gpt-oss:20b | 151.84 tok/s |
| Intel(R) Core(TM) i9-7980XE CPU @ 2.60GHz | NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090 | 62 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 150.09 tok/s |
| AMD Ryzen Threadripper PRO 7965WX 24-Cores | NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation | 251 GB | Ubuntu 22.04.4 LTS | 0.11.5 | gpt-oss:20b | 149.31 tok/s |
| AMD Ryzen Threadripper PRO 7965WX 24-Cores | NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation | 251 GB | Ubuntu 22.04.4 LTS | 0.11.5 | gpt-oss:20b | 149.13 tok/s |
| 11th Gen Intel(R) Core(TM) i7-11700F @ 2.50GHz | NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090 | 63 GB | "Fedora Linux 42 (Server Edition)" | 0.12.5 | gpt-oss:20b | 148.70 tok/s |
| AMD Ryzen Threadripper PRO 7965WX 24-Cores | NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation | 251 GB | Ubuntu 22.04.4 LTS | 0.11.5 | gpt-oss:20b | 148.60 tok/s |
| AMD Ryzen Threadripper PRO 7965WX 24-Cores | NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation | 251 GB | Ubuntu 22.04.4 LTS | 0.11.5 | gpt-oss:20b | 148.44 tok/s |
| 11th Gen Intel(R) Core(TM) i7-11700F @ 2.50GHz | NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090 | 63 GB | "Fedora Linux 42 (Server Edition)" | 0.12.5 | gpt-oss:20b | 148.35 tok/s |
| QEMU Virtual CPU version 2.5+ | NVIDIA GeForce RTX 3090 | 31 GB | Ubuntu 24.04.3 LTS | 0.12.8 | gpt-oss:20b | 148.17 tok/s |
| AMD Ryzen Threadripper PRO 7965WX 24-Cores | NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation NVIDIA RTX 6000 Ada Generation | 251 GB | Ubuntu 22.04.4 LTS | 0.11.5 | gpt-oss:20b | 148.01 tok/s |
| Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz | NVIDIA GeForce RTX 5070 Ti | 63 GB | Ubuntu 24.04.4 LTS | 0.16.3 | gpt-oss:20b | 147.99 tok/s |
| AMD Ryzen Threadripper 3970X 32-Core Processor | NVIDIA GeForce RTX 3090 | 63 GB | "Fedora Linux 42 (Server Edition)" | 0.12.9 | gpt-oss:20b | 147.74 tok/s |
| Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz | NVIDIA GeForce RTX 5070 Ti | 63 GB | Ubuntu 24.04.4 LTS | 0.18.2 | gpt-oss:20b | 147.70 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 3090 | 52 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 147.43 tok/s |
| AMD Ryzen 9 9900X 12-Core Processor | NVIDIA GeForce RTX 5070 Ti | 31 GB | Ubuntu 24.04.3 LTS | 0.14.2 | gpt-oss:20b | 147.08 tok/s |
| AMD EPYC 7742 64-Core Processor | NVIDIA A100-SXM4-80GB | 2,016 GB | AlmaLinux release 8.10 (Cerulean Leopard) | 0.12.10 | gpt-oss:20b | 146.85 tok/s |
| Intel(R) Core(TM) i7-14700K | NVIDIA GeForce RTX 4080 SUPER | 126 GB | Ubuntu 22.04.5 LTS | 0.13.0 | gpt-oss:20b | 145.78 tok/s |
| Intel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz | NVIDIA L40 NVIDIA A100 80GB PCIe NVIDIA H100 NVL | 252 GB | Ubuntu 22.04.5 LTS | 0.12.10 | gpt-oss:20b | 145.64 tok/s |
| Intel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz | NVIDIA L40 NVIDIA A100 80GB PCIe NVIDIA H100 NVL | 252 GB | Ubuntu 22.04.5 LTS | 0.12.10 | gpt-oss:20b | 145.39 tok/s |
| Intel(R) Xeon(R) W-2123 CPU @ 3.60GHz | NVIDIA GeForce RTX 5080 NVIDIA GeForce RTX 5080 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.0 | gpt-oss:20b | 142.56 tok/s |
| Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz | NVIDIA GeForce RTX 5070 Ti | 63 GB | Ubuntu 24.04.4 LTS | 0.14.3 | gpt-oss:20b | 142.38 tok/s |
| Intel(R) Xeon(R) Gold 6418H | NVIDIA L40S | 1,007 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 142.10 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX PRO 4500 Blackwell | 252 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 141.78 tok/s |
| Intel(R) Core(TM) i7-6900K CPU @ 3.20GHz | NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090 | 126 GB | Ubuntu 24.04.3 LTS | 0.14.3 | gpt-oss:20b | 140.75 tok/s |
| Intel(R) Core(TM) i7-14700K | NVIDIA GeForce RTX 4080 | 126 GB | Ubuntu 22.04.5 LTS | 0.13.0 | gpt-oss:20b | 139.58 tok/s |
| 12th Gen Intel(R) Core(TM) i9-12900K | NVIDIA GeForce RTX 3090 Ti | 62 GB | Ubuntu 25.04 | 0.11.10 | gpt-oss:20b | 138.17 tok/s |
| Intel(R) Core(TM) i7-14700K | NVIDIA GeForce RTX 4070 Ti SUPER | 62 GB | Pop!_OS 22.04 LTS | 0.13.4 | gpt-oss:20b | 137.40 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX 6000 Ada Generation | 251 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 137.04 tok/s |
| AMD Ryzen AI 9 HX 370 w/ Radeon 890M | NVIDIA GeForce RTX 3090 | 31 GB | Debian GNU/Linux 13 (trixie) | 0.16.2 | gpt-oss:20b | 136.34 tok/s |
| Intel Corporation | NVIDIA L20 NVIDIA L20 | 251 GB | Ubuntu 24.04.3 LTS | 0.13.2 | gpt-oss:20b | 135.80 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 135.57 tok/s |
| Intel Corporation | NVIDIA L20 NVIDIA L20 | 251 GB | Ubuntu 24.04.3 LTS | 0.13.2 | gpt-oss:20b | 135.05 tok/s |
| AMD Ryzen 9 3900X 12-Core Processor | NVIDIA GeForce RTX 4070 Ti SUPER | 31 GB | CachyOS | 0.13.5 | gpt-oss:20b | 132.29 tok/s |
| AMD Ryzen Threadripper PRO 5995WX 64-Cores | NVIDIA RTX A5500 NVIDIA RTX A5500 | 504 GB | Ubuntu 24.04.4 LTS | 0.18.2 | gpt-oss:20b | 132.11 tok/s |
| AMD Ryzen 7 5700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 31 GB | Linux Mint 22 | 0.11.11 | gpt-oss:20b | 130.02 tok/s |
| AMD Ryzen 7 5700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 31 GB | Linux Mint 22.2 | 0.11.11 | gpt-oss:20b | 128.81 tok/s |
| Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz | NVIDIA GeForce RTX 5070 Ti | 63 GB | Ubuntu 24.04.4 LTS | 0.16.3 | gpt-oss:20b | 127.43 tok/s |
| AMD Ryzen 7 5700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 31 GB | Linux Mint 22 | 0.11.11 | gpt-oss:20b | 127.26 tok/s |
| 13th Gen Intel(R) Core(TM) i9-13900K | NVIDIA GeForce RTX 3090 | 62 GB | Ubuntu 22.04.5 LTS | 0.12.2 | gpt-oss:20b | 126.63 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090 | 126 GB | Ubuntu 22.04.5 LTS | 0.11.11 | gpt-oss:20b | 126.33 tok/s |
| AMD Ryzen 7 5700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 31 GB | Linux Mint 22 | 0.11.11 | gpt-oss:20b | 125.54 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090 | 126 GB | Ubuntu 22.04.5 LTS | 0.11.11 | gpt-oss:20b | 125.20 tok/s |
| Intel(R) Xeon(R) w5-3433 | NVIDIA RTX PRO 4000 Blackwell NVIDIA RTX PRO 4000 Blackwell NVIDIA RTX PRO 4000 Blackwell | 94 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 125.11 tok/s |
| AMD Ryzen 7 5700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 31 GB | Linux Mint 22 | 0.11.11 | gpt-oss:20b | 124.94 tok/s |
| AMD Ryzen 5 5600G with Radeon Graphics | NVIDIA RTX A5000 | 31 GB | Debian GNU/Linux 12 (bookworm) | 0.18.2 | gpt-oss:20b | 124.88 tok/s |
| Intel Corporation | NVIDIA H200 | 2,016 GB | Ubuntu 22.04.5 LTS | 0.11.10 | gpt-oss:20b | 124.45 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | Navi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M] | 63 GB | Nobara Linux 40 (KDE Plasma) | 0.12.6 | gpt-oss:20b | 123.84 tok/s |
| AMD Ryzen 7 7700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 62 GB | Ubuntu 24.04.2 LTS | 0.11.8 | gpt-oss:20b | 123.36 tok/s |
| AMD Ryzen 7 7700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 62 GB | Ubuntu 24.04.2 LTS | 0.11.8 | gpt-oss:20b | 123.26 tok/s |
| Intel(R) Core(TM) i9-14900K | NVIDIA GeForce RTX 3090 | 31 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 122.79 tok/s |
| 13th Gen Intel(R) Core(TM) i7-13700K | NVIDIA GeForce RTX 3090 | 63 GB | Ubuntu 24.04.2 LTS | 0.11.8 | gpt-oss:20b | 122.54 tok/s |
| AMD EPYC 9135 16-Core Processor | NVIDIA RTX PRO 4000 Blackwell | 566 GB | Ubuntu 24.04.4 LTS | 0.16.3 | gpt-oss:20b | 122.50 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | Navi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M] | 63 GB | Nobara Linux 40 (KDE Plasma) | 0.12.6 | gpt-oss:20b | 122.26 tok/s |
| Intel(R) Core(TM) i9-10900X CPU @ 3.70GHz | NVIDIA RTX A5000 | 63 GB | Ubuntu 24.04.3 LTS | 0.14.2 | gpt-oss:20b | 122.23 tok/s |
| AMD Ryzen 7 5700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 31 GB | Linux Mint 22 | 0.11.11 | gpt-oss:20b | 122.04 tok/s |
| Intel Corporation | NVIDIA H200 | 2,016 GB | Ubuntu 22.04.5 LTS | 0.11.10 | gpt-oss:20b | 122.00 tok/s |
| AMD Ryzen 7 5700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 31 GB | Linux Mint 22 | 0.11.11 | gpt-oss:20b | 121.72 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 120.33 tok/s |
| 13th Gen Intel(R) Core(TM) i9-13900K | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.11.4 | gpt-oss:20b | 120.08 tok/s |
| 13th Gen Intel(R) Core(TM) i9-13900K | NVIDIA GeForce RTX 4090 | 31 GB | Ubuntu 24.04.3 LTS | 0.11.4 | gpt-oss:20b | 119.56 tok/s |
| Intel(R) Xeon(R) CPU E5-2687W v4 @ 3.00GHz | Tesla V100-SXM2-16GB | 220 GB | Ubuntu 24.04.4 LTS | 0.17.5 | gpt-oss:20b | 119.01 tok/s |
| Intel(R) Xeon(R) Gold 6226R CPU @ 2.90GHz | NVIDIA RTX 6000 Ada Generation | 504 GB | Ubuntu 24.04.3 LTS | 0.11.8 | gpt-oss:20b | 118.88 tok/s |
| Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | GV100GL [Tesla V100 PCIe 16GB] | 63 GB | Ubuntu 22.04.5 LTS | 0.13.5 | gpt-oss:20b | 118.20 tok/s |
| Intel(R) Xeon(R) Gold 6226R CPU @ 2.90GHz | NVIDIA RTX 6000 Ada Generation | 504 GB | Ubuntu 24.04.3 LTS | 0.11.8 | gpt-oss:20b | 117.34 tok/s |
| Intel(R) Core(TM) i7-10700K CPU @ 3.80GHz | NVIDIA GeForce RTX 3090 | 63 GB | Ubuntu 22.04.5 LTS | 0.12.3 | gpt-oss:20b | 116.11 tok/s |
| AMD EPYC 7601 32-Core Processor | Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB | 63 GB | "Ubuntu 24.04.3 LTS" | 0.14.2 | gpt-oss:20b | 115.94 tok/s |
| AMD Ryzen Threadripper 3990X 64-Core Processor | Navi 31 [Radeon RX 7900 XT/7900 XTX/7900M] | 252 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 115.49 tok/s |
| AMD EPYC 7601 32-Core Processor | Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB | 63 GB | "Ubuntu 24.04.3 LTS" | 0.14.2 | gpt-oss:20b | 115.31 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX PRO 4000 Blackwell | 252 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 115.18 tok/s |
| AMD Ryzen 7 5700X 8-Core Processor | NVIDIA GeForce RTX 3090 | 31 GB | Linux Mint 22 | 0.11.11 | gpt-oss:20b | 114.84 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 113.53 tok/s |
| AMD Ryzen 7 9700X 8-Core Processor | NVIDIA GeForce RTX 5060 Ti | 92 GB | Linux Mint 22.1 | 0.12.5 | gpt-oss:20b | 113.49 tok/s |
| AMD Ryzen 7 5800X3D 8-Core Processor | AMD Ryzen 7 5800X3D 8-Core Processor AMD Radeon RX 7900 XT | 31 GB | "Ubuntu 24.04.4 LTS" | 0.17.0 | gpt-oss:20b | 112.06 tok/s |
| Intel(R) Core(TM) Ultra 9 285H | NVIDIA GeForce RTX 5090 Laptop GPU | 61 GB | Ubuntu 25.10 | 0.13.5 | gpt-oss:20b | 111.68 tok/s |
| AMD Ryzen 9 7900X 12-Core Processor | NVIDIA GeForce RTX 3090 | 62 GB | Ubuntu 22.04.5 LTS | 0.11.10 | gpt-oss:20b | 111.39 tok/s |
| Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz | NVIDIA RTX A6000 NVIDIA RTX A6000 | 126 GB | Ubuntu 24.04.2 LTS | 0.12.6 | gpt-oss:20b | 110.90 tok/s |
| AMD Ryzen 7 5800X3D 8-Core Processor | no_gpu | 31 GB | "Ubuntu 24.04.4 LTS" | 0.17.0 | gpt-oss:20b | 110.07 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 109.62 tok/s |
| Intel(R) Core(TM) Ultra 9 285H | NVIDIA GeForce RTX 5090 Laptop GPU | 61 GB | Ubuntu 25.10 | 0.13.5 | gpt-oss:20b | 109.49 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 109.34 tok/s |
| Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz | NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090 | 126 GB | Ubuntu 24.04.2 LTS | 0.11.7 | gpt-oss:20b | 109.20 tok/s |
| Intel(R) Core(TM) Ultra 9 285K | NVIDIA RTX 5000 Ada Generation | 62 GB | "Arch Linux" | 0.12.5 | gpt-oss:20b | 109.13 tok/s |
| AMD Ryzen 7 3700X 8-Core Processor | NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090 | 63 GB | Linux Mint 22.1 | 0.11.6 | gpt-oss:20b | 108.75 tok/s |
| 12th Gen Intel(R) Core(TM) i7-12700K | NVIDIA RTX A4500 | 31 GB | Debian GNU/Linux 13 (trixie) | 0.13.1 | gpt-oss:20b | 108.50 tok/s |
| Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz | NVIDIA RTX A6000 NVIDIA RTX A6000 | 126 GB | Ubuntu 24.04.2 LTS | 0.12.6 | gpt-oss:20b | 107.66 tok/s |
| Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz | NVIDIA RTX A6000 NVIDIA RTX A6000 | 126 GB | Ubuntu 24.04.2 LTS | 0.12.6 | gpt-oss:20b | 105.89 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 1,133 GB | "Ubuntu 24.04.1 LTS" | 0.12.3 | gpt-oss:20b | 105.58 tok/s |
| AMD Ryzen 9 9950X 16-Core Processor | Advanced Micro Devices, Inc. [AMD/ATI] | 251 GB | Ubuntu 24.04.3 LTS | 0.13.3 | gpt-oss:20b | 104.98 tok/s |
| 13th Gen Intel(R) Core(TM) i9-13900 | NVIDIA RTX A4500 | 62 GB | Ubuntu 24.04.4 LTS | 0.19.0 | gpt-oss:20b | 104.14 tok/s |
| AMD Ryzen Threadripper 9960X 24-Cores | Navi 48 [Radeon AI PRO R9700] | 123 GB | Ubuntu 25.10 | 0.15.6 | gpt-oss:20b | 102.20 tok/s |
| Intel(R) Xeon(R) Gold 6230 CPU @ 2.10GHz | NVIDIA RTX A5000 | 251 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 102.01 tok/s |
| AMD EPYC 9554 64-Core Processor | NVIDIA A10 NVIDIA A10 | 86 GB | Debian GNU/Linux 13 (trixie) | 0.14.1 | gpt-oss:20b | 101.47 tok/s |
| Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz | Quadro GV100 Quadro GV100 | 126 GB | "Ubuntu 24.04.2 LTS" | 0.16.2 | gpt-oss:20b | 97.22 tok/s |
| AMD Ryzen 9 9950X 16-Core Processor | AMD Ryzen 9 9950X 16-Core Processor AMD Radeon AI PRO R9700 AMD Radeon Graphics | 249 GB | Debian GNU/Linux 13 (trixie) | 0.13.1 | gpt-oss:20b | 97.15 tok/s |
| AMD Ryzen 7 9700X 8-Core Processor | NVIDIA GeForce RTX 5060 Ti | 92 GB | Linux Mint 22.1 | 0.11.6 | gpt-oss:20b | 96.46 tok/s |
| AMD Ryzen 9 9950X 16-Core Processor | AMD Ryzen 9 9950X 16-Core Processor AMD Radeon AI PRO R9700 AMD Radeon AI PRO R9700 AMD Radeon Graphics | 249 GB | Debian GNU/Linux 13 (trixie) | 0.13.1 | gpt-oss:20b | 96.29 tok/s |
| Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz | NVIDIA A40 | 63 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 96.19 tok/s |
| unknown | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 2080 Ti | 31 GB | Ubuntu 24.04.3 LTS | 0.15.0 | gpt-oss:20b | 95.88 tok/s |
| unknown | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 2080 Ti | 31 GB | Ubuntu 24.04.3 LTS | 0.15.0 | gpt-oss:20b | 95.76 tok/s |
| unknown | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 2080 Ti | 31 GB | Ubuntu 24.04.3 LTS | 0.15.0 | gpt-oss:20b | 95.74 tok/s |
| unknown | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 2080 Ti | 31 GB | Ubuntu 24.04.3 LTS | 0.15.0 | gpt-oss:20b | 95.16 tok/s |
| AMD Ryzen 9 9900X 12-Core Processor | Granite Ridge [Radeon Graphics] | 60 GB | Ubuntu 24.04.3 LTS | 0.12.0 | gpt-oss:20b | 94.84 tok/s |
| Intel(R) Xeon(R) W-3223 CPU @ 3.50GHz | NVIDIA RTX A5000 | 63 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 94.59 tok/s |
| AMD Ryzen 7 5800X3D 8-Core Processor | AMD Ryzen 7 5800X3D 8-Core Processor AMD Radeon RX 9070 XT | 31 GB | Solus 4.8 Opportunity | 0.15.2 | gpt-oss:20b | 94.48 tok/s |
| Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz | NVIDIA TITAN RTX | 47 GB | Ubuntu 24.04.3 LTS | 0.13.0 | gpt-oss:20b | 93.10 tok/s |
| Intel(R) Core(TM) i9-14900K | NVIDIA GeForce RTX 5060 Ti | 62 GB | CachyOS | 0.12.10 | gpt-oss:20b | 92.96 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | Navi 21 [Radeon RX 6950 XT] | 63 GB | Ubuntu 24.04.4 LTS | 0.16.2 | gpt-oss:20b | 92.80 tok/s |
| Intel(R) Core(TM) i7-14700K | NVIDIA GeForce RTX 5060 Ti | 63 GB | Ubuntu 24.04.1 LTS | 0.17.1 | gpt-oss:20b | 92.02 tok/s |
| Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz | NVIDIA GeForce RTX 5060 Ti | 31 GB | Debian GNU/Linux 13 (trixie) | 0.19.0 | gpt-oss:20b | 91.36 tok/s |
| Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz | NVIDIA GeForce RTX 5060 Ti | 31 GB | Debian GNU/Linux 13 (trixie) | 0.19.0 | gpt-oss:20b | 91.13 tok/s |
| Intel Corporation | NVIDIA L40S NVIDIA L40S | 1,003 GB | Ubuntu 24.04.3 LTS | 0.11.4 | gpt-oss:20b | 91.00 tok/s |
| Intel Corporation | NVIDIA L40S NVIDIA L40S | 1,003 GB | Ubuntu 24.04.3 LTS | 0.11.4 | gpt-oss:20b | 90.83 tok/s |
| AMD Ryzen 9 9900X 12-Core Processor | Granite Ridge [Radeon Graphics] | 60 GB | Ubuntu 24.04.3 LTS | 0.12.0 | gpt-oss:20b | 90.80 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | Navi 21 [Radeon RX 6950 XT] | 63 GB | Ubuntu 24.04.4 LTS | 0.16.2 | gpt-oss:20b | 89.02 tok/s |
| Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 126 GB | Ubuntu 24.04.3 LTS | 0.14.1 | gpt-oss:20b | 88.69 tok/s |
| Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz | NVIDIA A40 | 31 GB | Ubuntu 24.04.2 LTS | 0.11.7 | gpt-oss:20b | 88.17 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | Navi 48 [Radeon RX 9070/9070 XT/9070 GRE] | 126 GB | Arch Linux | 0.12.7 | gpt-oss:20b | 87.42 tok/s |
| Intel(R) Xeon(R) W-2135 CPU @ 3.70GHz | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 3060 | 48 GB | "Debian GNU/Linux 13 (trixie)" | 0.12.9 | gpt-oss:20b | 87.36 tok/s |
| Intel(R) Core(TM) i9-10900X CPU @ 3.70GHz | NVIDIA GeForce RTX 5060 Ti NVIDIA RTX A2000 12GB | 63 GB | Ubuntu 24.04.4 LTS | 0.18.2 | gpt-oss:20b | 86.45 tok/s |
| Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz | NVIDIA GeForce RTX 2060 NVIDIA GeForce RTX 2060 NVIDIA GeForce RTX 2060 NVIDIA GeForce RTX 2060 NVIDIA GeForce RTX 5090 NVIDIA GeForce RTX 2060 NVIDIA GeForce RTX 2060 NVIDIA GeForce RTX 2060 | 126 GB | Ubuntu 24.04.3 LTS | 0.12.10 | gpt-oss:20b | 86.39 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | Navi 21 [Radeon RX 6900 XT] | 63 GB | Linux Mint 22.2 | 0.13.5 | gpt-oss:20b | 85.88 tok/s |
| Intel(R) Core(TM) i9-14900K | NVIDIA RTX 4500 Ada Generation | 63 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 85.55 tok/s |
| Intel(R) Xeon(R) W-3275M CPU @ 2.50GHz | AMD Radeon RX 6600M AMD Radeon RX 6900 XT | 94 GB | CachyOS | 0.17.0 | gpt-oss:20b | 84.63 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 121 GB | Ubuntu 25.04 | 0.12.5 | gpt-oss:20b | 84.38 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 121 GB | Ubuntu 25.04 | 0.12.5 | gpt-oss:20b | 84.25 tok/s |
| Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz | NVIDIA TITAN RTX | 60 GB | Ubuntu 25.04 | 0.11.10 | gpt-oss:20b | 84.20 tok/s |
| AMD Ryzen 5 3600 6-Core Processor | AMD Ryzen 5 3600 6-Core Processor AMD Radeon RX 6900 XT | 31 GB | "Arch Linux" | 0.18.2 | gpt-oss:20b | 83.60 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 121 GB | Ubuntu 25.04 | 0.12.5 | gpt-oss:20b | 83.10 tok/s |
| Intel(R) Core(TM) Ultra 7 265K | NVIDIA GeForce RTX 5060 Ti | 31 GB | "Debian GNU/Linux 12 (bookworm)" | 0.12.3 | gpt-oss:20b | 82.85 tok/s |
| AMD Ryzen 7 9700X 8-Core Processor | NVIDIA GeForce RTX 5060 Ti | 90 GB | Ubuntu 25.04 | 0.12.3 | gpt-oss:20b | 82.68 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 121 GB | Ubuntu 25.04 | 0.12.5 | gpt-oss:20b | 82.38 tok/s |
| Intel(R) Xeon(R) W-2255 CPU @ 3.70GHz | NVIDIA RTX A4000 | 63 GB | Ubuntu 24.04.4 LTS | 0.18.3 | gpt-oss:20b | 81.61 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 121 GB | Ubuntu 25.04 | 0.12.5 | gpt-oss:20b | 81.54 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 121 GB | Ubuntu 25.04 | 0.12.5 | gpt-oss:20b | 81.28 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 121 GB | Ubuntu 25.04 | 0.12.5 | gpt-oss:20b | 81.25 tok/s |
| AMD Ryzen 7 9700X 8-Core Processor | NVIDIA GeForce RTX 5060 Ti | 90 GB | Ubuntu 25.04 | 0.12.3 | gpt-oss:20b | 81.22 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 31 GB | Ubuntu 24.04.4 LTS | 0.18.2 | gpt-oss:20b | 80.74 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 121 GB | Ubuntu 24.04.3 LTS | 0.11.5 | gpt-oss:20b | 77.91 tok/s |
| AMD EPYC 9474F 48-Core Processor | NVIDIA RTX 4000 Ada Generation | 31 GB | Ubuntu 24.04.3 LTS | 0.17.7 | gpt-oss:20b | 76.89 tok/s |
| Intel(R) Core(TM) i7-7820X CPU @ 3.60GHz | NVIDIA TITAN RTX NVIDIA GeForce RTX 5060 Ti NVIDIA GeForce RTX 5060 Ti | 62 GB | Ubuntu 24.04.3 LTS | 0.13.0 | gpt-oss:20b | 75.59 tok/s |
| Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz | Tesla V100-SXM2-32GB Tesla V100-SXM2-32GB Tesla V100-SXM2-32GB Tesla V100-SXM2-32GB Tesla V100-SXM2-32GB Tesla V100-SXM2-32GB Tesla V100-SXM2-32GB Tesla V100-SXM2-32GB | 503 GB | Ubuntu 24.04.3 LTS | 0.11.6 | gpt-oss:20b | 75.41 tok/s |
| AMD Ryzen 7 PRO 8840U w/ Radeon 780M Graphics | unknown | 61 GB | Arch Linux | 0.16.1 | gpt-oss:20b | 75.17 tok/s |
| Intel(R) Core(TM) i5-14600KF | Navi 21 [Radeon RX 6800/6800 XT / 6900 XT] | 49 GB | Ubuntu 22.04.5 LTS | 0.11.8 | gpt-oss:20b | 71.54 tok/s |
| AMD EPYC 7K62 48-Core Processor | NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060 | 252 GB | Ubuntu 24.04.1 LTS | 0.17.5 | gpt-oss:20b | 70.64 tok/s |
| Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz | NVIDIA GeForce RTX 3090 | 63 GB | Ubuntu 22.04.3 LTS | 0.11.4 | gpt-oss:20b | 70.30 tok/s |
| AMD Ryzen 9 3950X 16-Core Processor | NVIDIA RTX A4000 NVIDIA RTX A4000 NVIDIA RTX A4000 | 63 GB | Debian GNU/Linux 12 (bookworm) | 0.11.8 | gpt-oss:20b | 70.06 tok/s |
| Intel(R) Xeon(R) W-2135 CPU @ 3.70GHz | NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060 | 48 GB | "Debian GNU/Linux 13 (trixie)" | 0.12.9 | gpt-oss:20b | 69.99 tok/s |
| AMD Ryzen 5 5600X 6-Core Processor | NVIDIA GeForce RTX 4060 Ti | 31 GB | Ubuntu 24.04.4 LTS | 0.17.0 | gpt-oss:20b | 65.71 tok/s |
| AMD Ryzen 5 5600X 6-Core Processor | NVIDIA GeForce RTX 4060 Ti | 31 GB | Ubuntu 24.04.4 LTS | 0.17.0 | gpt-oss:20b | 65.19 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | AMD Ryzen 9 5900X 12-Core Processor AMD Radeon RX 9060 XT | 63 GB | Arch Linux | 0.14.1 | gpt-oss:20b | 62.39 tok/s |
| AMD Ryzen 7 3700X 8-Core Processor | NVIDIA GeForce RTX 3060 NVIDIA GeForce GTX 1660 SUPER | 31 GB | Debian GNU/Linux 13 (trixie) | 0.16.2 | gpt-oss:20b | 62.01 tok/s |
| 13th Gen Intel(R) Core(TM) i5-13500 | NVIDIA RTX 4000 SFF Ada Generation | 63 GB | Ubuntu 24.04.4 LTS | 0.17.6 | gpt-oss:20b | 61.87 tok/s |
| AMD EPYC 7713 64-Core Processor | Arcturus GL-XL [Instinct MI100] | 2,004 GB | Ubuntu 22.04.5 LTS | 0.11.5 | gpt-oss:20b | 61.83 tok/s |
| Intel(R) Xeon(R) Gold 6226R CPU @ 2.90GHz | Tesla V100S-PCIE-32GB | 43 GB | Ubuntu 22.04.4 LTS | 0.11.2 | gpt-oss:20b | 61.61 tok/s |
| unknown | NVIDIA GB10 | 122 GB | Ubuntu 24.04.4 LTS | 0.17.7 | gpt-oss:20b | 61.55 tok/s |
| Intel(R) Xeon(R) Gold 6226R CPU @ 2.90GHz | Tesla V100S-PCIE-32GB | 43 GB | Ubuntu 22.04.4 LTS | 0.11.2 | gpt-oss:20b | 61.52 tok/s |
| Intel(R) Core(TM) i9-14900 | NVIDIA RTX 4000 SFF Ada Generation | 61 GB | Ubuntu 25.10 | 0.14.1 | gpt-oss:20b | 61.45 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.15.2 | gpt-oss:20b | 61.45 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.12.9 | gpt-oss:20b | 61.44 tok/s |
| unknown | NVIDIA GB10 | 122 GB | Ubuntu 24.04.4 LTS | 0.19.0 | gpt-oss:20b | 61.42 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.12.10 | gpt-oss:20b | 61.41 tok/s |
| - | NVIDIA GB10 | 120 GB | "Debian GNU/Linux 12 (bookworm)" | 0.13.1 | gpt-oss:20b | 61.35 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.12.10 | gpt-oss:20b | 61.34 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.13.2 | gpt-oss:20b | 61.30 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.15.1 | gpt-oss:20b | 60.97 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.18.2 | gpt-oss:20b | 60.96 tok/s |
| INTEL(R) XEON(R) SILVER 4510 | NVIDIA RTX PRO 2000 Blackwell | 252 GB | Ubuntu 22.04.5 LTS | 0.12.5 | gpt-oss:20b | 60.82 tok/s |
| AMD Ryzen 9 9950X3D 16-Core Processor | NVIDIA GeForce RTX 4060 Ti | 92 GB | Manjaro Linux | 0.11.6 | gpt-oss:20b | 60.54 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.12.10 | gpt-oss:20b | 60.49 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.15.1 | gpt-oss:20b | 60.15 tok/s |
| Intel(R) Xeon(R) w5-3525 | NVIDIA RTX 4500 Ada Generation NVIDIA RTX 4500 Ada Generation | 125 GB | Ubuntu 24.04.2 LTS | 0.11.4 | gpt-oss:20b | 60.13 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.15.2 | gpt-oss:20b | 59.98 tok/s |
| unknown | NVIDIA GB10 | 122 GB | Ubuntu 24.04.4 LTS | 0.16.3 | gpt-oss:20b | 59.44 tok/s |
| QEMU Virtual CPU version 2.5+ | NVIDIA GeForce GTX 1080 Ti NVIDIA GeForce GTX 1080 Ti | 31 GB | Ubuntu 22.04.5 LTS | 0.13.3 | gpt-oss:20b | 59.38 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.13.0 | gpt-oss:20b | 58.90 tok/s |
| (Spark) | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 58.74 tok/s |
| Intel(R) Xeon(R) CPU E3-1246 v3 @ 3.50GHz | Tesla P40 Tesla P100-PCIE-16GB | 31 GB | "Fedora Linux 42 (Server Edition)" | 0.12.5 | gpt-oss:20b | 56.59 tok/s |
| Intel(R) Xeon(R) CPU E3-1246 v3 @ 3.50GHz | Tesla P40 Tesla P100-PCIE-16GB | 31 GB | "Fedora Linux 42 (Server Edition)" | 0.12.5 | gpt-oss:20b | 56.56 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.12.11 | gpt-oss:20b | 55.75 tok/s |
| Intel(R) Xeon(R) CPU E3-1246 v3 @ 3.50GHz | Tesla P40 Tesla P100-PCIE-16GB | 31 GB | "Fedora Linux 42 (Server Edition)" | 0.12.5 | gpt-oss:20b | 53.50 tok/s |
| unknown | NVIDIA GB10 | 122 GB | Ubuntu 24.04.4 LTS | 0.16.1 | gpt-oss:20b | 53.46 tok/s |
| Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz | NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060 | 157 GB | Ubuntu 22.04.5 LTS | 0.12.2 | gpt-oss:20b | 53.38 tok/s |
| 13th Gen Intel(R) Core(TM) i9-13900 | NVIDIA GeForce RTX 2060 SUPER NVIDIA GeForce RTX 2060 SUPER NVIDIA GeForce RTX 2060 SUPER | 63 GB | CachyOS | 0.19.0 | gpt-oss:20b | 53.19 tok/s |
| 13th Gen Intel(R) Core(TM) i9-13900 | NVIDIA GeForce RTX 2060 SUPER NVIDIA GeForce RTX 2060 SUPER NVIDIA GeForce RTX 2060 SUPER | 63 GB | CachyOS | 0.19.0 | gpt-oss:20b | 53.13 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.12.5 | gpt-oss:20b | 52.45 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.12.11 | gpt-oss:20b | 50.97 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 50.96 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.13.0 | gpt-oss:20b | 50.53 tok/s |
| unknown | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.12.5 | gpt-oss:20b | 50.49 tok/s |
| Intel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz | NVIDIA L4 | 1,007 GB | Ubuntu 22.04.5 LTS | 0.11.8 | gpt-oss:20b | 50.05 tok/s |
| Intel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz | NVIDIA L4 | 1,007 GB | Ubuntu 22.04.5 LTS | 0.11.8 | gpt-oss:20b | 49.89 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 123 GB | Ubuntu 25.10 | 0.18.1 | gpt-oss:20b | 49.89 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 62 GB | Ubuntu 24.04.3 LTS | 0.18.2 | gpt-oss:20b | 49.58 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 62 GB | Ubuntu 24.04.3 LTS | 0.13.2 | gpt-oss:20b | 49.26 tok/s |
| Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz | Tesla P40 Tesla P40 | 378 GB | Ubuntu 22.04.5 LTS | 0.17.0 | gpt-oss:20b | 48.56 tok/s |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz | Tesla P40 Tesla P40 | 252 GB | Ubuntu 24.04.4 LTS | 0.16.3 | gpt-oss:20b | 48.51 tok/s |
| Intel(R) Xeon(R) CPU E5-2440 v2 @ 1.90GHz | Tesla P40 Tesla P40 | 189 GB | Debian GNU/Linux 13 (trixie) | 0.15.0 | gpt-oss:20b | 48.16 tok/s |
| Intel(R) Xeon(R) CPU E5-2440 v2 @ 1.90GHz | Tesla P40 Tesla P40 | 189 GB | Debian GNU/Linux 13 (trixie) | 0.14.3-rc2 | gpt-oss:20b | 47.81 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 123 GB | Ubuntu 25.10 | 0.17.7 | gpt-oss:20b | 47.11 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 62 GB | Ubuntu 24.04.3 LTS | 0.18.2 | gpt-oss:20b | 47.08 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 123 GB | Ubuntu 25.10 | 0.17.7 | gpt-oss:20b | 46.95 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 125 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 46.84 tok/s |
| QEMU Virtual CPU version 2.5+ | NVIDIA GeForce GTX 1080 Ti NVIDIA GeForce GTX 1070 | 31 GB | Ubuntu 22.04.5 LTS | 0.13.3 | gpt-oss:20b | 46.76 tok/s |
| Intel(R) Xeon(R) Gold 6134 CPU @ 3.20GHz | Quadro P5000 | 62 GB | Arch Linux | 0.15.1 | gpt-oss:20b | 46.76 tok/s |
| Intel(R) Xeon(R) Gold 6134 CPU @ 3.20GHz | Quadro P5000 | 62 GB | Arch Linux | 0.15.1 | gpt-oss:20b | 46.75 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | Navi 21 [Radeon RX 6900 XT] | 63 GB | Linux Mint 22.2 | 0.13.2 | gpt-oss:20b | 46.57 tok/s |
| AMD RYZEN AI MAX+ PRO 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 63 GB | Ubuntu 24.04.3 LTS | 0.14.3 | gpt-oss:20b | 45.59 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.53 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.52 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.51 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.51 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.50 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.50 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.50 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.48 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.47 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.47 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 125 GB | Ubuntu 24.04.3 LTS | 0.0.0 | gpt-oss:20b | 45.46 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.46 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.45 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.44 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.44 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.43 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.43 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.43 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.43 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.42 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.42 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.42 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.42 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.42 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.41 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.41 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.40 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.40 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.40 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.39 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.39 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.39 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.39 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.38 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.38 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.38 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.38 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.37 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.37 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.37 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.36 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.36 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.35 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.35 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.34 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.34 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.32 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 45.32 tok/s |
| Intel Corporation | NVIDIA H200 | 2,016 GB | Ubuntu 22.04.5 LTS | 0.11.11 | gpt-oss:20b | 45.25 tok/s |
| Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz | Tesla T4 NVIDIA GeForce RTX 3060 Ti | 47 GB | Ubuntu 24.04.4 LTS | 0.17.5 | gpt-oss:20b | 44.33 tok/s |
| AMD RYZEN AI MAX+ PRO 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 110 GB | Ubuntu 25.10 | 0.15.1 | gpt-oss:20b | 43.75 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 62 GB | Ubuntu 25.04 | 0.12.3 | gpt-oss:20b | 43.60 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 123 GB | Ubuntu 25.10 | 0.17.7 | gpt-oss:20b | 43.60 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 62 GB | Ubuntu 25.04 | 0.12.3 | gpt-oss:20b | 43.51 tok/s |
| AMD Ryzen Threadripper 2970WX 24-Core Processor | NVIDIA GeForce RTX 3060 Tesla P40 Tesla P40 | 63 GB | Ubuntu 24.04.3 LTS | 0.11.8 | gpt-oss:20b | 42.61 tok/s |
| AMD RYZEN AI MAX+ PRO 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 94 GB | Ubuntu 24.04.3 LTS | 0.11.5 | gpt-oss:20b | 41.88 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 123 GB | Ubuntu 25.10 | 0.15.2 | gpt-oss:20b | 41.67 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 125 GB | Ubuntu 24.04.3 LTS | 0.12.11 | gpt-oss:20b | 41.13 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.11.11 | gpt-oss:20b | 41.03 tok/s |
| AMD Ryzen 9 3950X 16-Core Processor | NVIDIA RTX A4000 NVIDIA RTX A4000 | 31 GB | Debian GNU/Linux 12 (bookworm) | 0.11.3 | gpt-oss:20b | 40.04 tok/s |
| 13th Gen Intel(R) Core(TM) i7-13700KF | AMD Radeon RX 6900 XT | 63 GB | Debian GNU/Linux forky/sid | 0.12.6 | gpt-oss:20b | 39.18 tok/s |
| 12th Gen Intel(R) Core(TM) i7-12700K | Tesla T4 | 31 GB | Debian GNU/Linux 13 (trixie) | 0.12.10 | gpt-oss:20b | 38.82 tok/s |
| 12th Gen Intel(R) Core(TM) i7-12700K | Tesla T4 | 31 GB | Debian GNU/Linux 13 (trixie) | 0.12.10 | gpt-oss:20b | 38.74 tok/s |
| 12th Gen Intel(R) Core(TM) i7-12700K | Tesla T4 | 31 GB | Debian GNU/Linux 13 (trixie) | 0.12.10 | gpt-oss:20b | 38.41 tok/s |
| Intel(R) Xeon(R) Gold 6230 CPU @ 2.10GHz | Quadro P4000 NVIDIA P102-100 | 63 GB | "Ubuntu 24.04.3 LTS" | 0.14.0 | gpt-oss:20b | 36.85 tok/s |
| Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz | CoffeeLake-S GT2 [UHD Graphics 630] | 94 GB | Ubuntu 22.04.5 LTS | 0.11.8 | gpt-oss:20b | 33.82 tok/s |
| 12th Gen Intel(R) Core(TM) i9-12900KF | NVIDIA GeForce RTX 3080 Ti | 189 GB | Ubuntu 24.04.4 LTS | 0.16.1 | gpt-oss:20b | 32.10 tok/s |
| Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | Quadro P4000 Quadro P4000 | 46 GB | Ubuntu 25.10 | 0.13.5 | gpt-oss:20b | 31.58 tok/s |
| AMD Ryzen 9 7950X 16-Core Processor | NVIDIA GeForce RTX 3080 | 62 GB | Arch Linux | 0.12.7 | gpt-oss:20b | 31.42 tok/s |
| Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | Quadro P4000 Quadro P4000 | 46 GB | Ubuntu 25.10 | 0.13.5 | gpt-oss:20b | 31.33 tok/s |
| unknown | unknown | 63 GB | Ubuntu 22.04.5 LTS | 0.12.0 | gpt-oss:20b | 30.88 tok/s |
| AMD RYZEN AI MAX+ PRO 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 118 GB | Ubuntu 24.04.4 LTS | 0.13.4 | gpt-oss:20b | 30.80 tok/s |
| Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | Quadro P4000 Quadro P4000 | 46 GB | Ubuntu 25.10 | 0.13.5 | gpt-oss:20b | 30.71 tok/s |
| AMD Ryzen 9 7900 12-Core Processor | Advanced Micro Devices, Inc. [AMD/ATI] | 125 GB | Ubuntu 22.04.5 LTS | 0.11.3 | gpt-oss:20b | 30.66 tok/s |
| Intel(R) Xeon(R) Gold 6230R CPU @ 2.10GHz | unknown | 63 GB | "openSUSE Leap 15.6" | 0.18.1 | gpt-oss:20b | 30.63 tok/s |
| Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | Quadro P4000 Quadro P4000 | 46 GB | Ubuntu 25.10 | 0.13.5 | gpt-oss:20b | 30.47 tok/s |
| AMD RYZEN AI MAX+ PRO 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 63 GB | Ubuntu 24.04.3 LTS | 0.14.3 | gpt-oss:20b | 30.07 tok/s |
| AMD Ryzen Threadripper PRO 5955WX 16-Cores | NVIDIA RTX A2000 12GB | 63 GB | "Fedora Linux 42 (Workstation Edition)" | 0.12.10 | gpt-oss:20b | 28.92 tok/s |
| AMD Ryzen Threadripper PRO 5955WX 16-Cores | no_gpu | 63 GB | "Fedora Linux 42 (Workstation Edition)" | 0.12.10 | gpt-oss:20b | 28.79 tok/s |
| Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz | Quadro RTX 4000 Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB | 220 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 28.45 tok/s |
| Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz | Quadro RTX 4000 Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB | 220 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 28.11 tok/s |
| unknown | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.15.5 | gpt-oss:20b | 27.60 tok/s |
| Intel(R) Core(TM) i9-10900X CPU @ 3.70GHz | NVIDIA RTX A2000 12GB | 63 GB | Ubuntu 24.04.4 LTS | 0.18.2 | gpt-oss:20b | 27.38 tok/s |
| Intel(R) Core(TM) i9-10900X CPU @ 3.70GHz | NVIDIA RTX A2000 12GB | 63 GB | Ubuntu 24.04.4 LTS | 0.18.2 | gpt-oss:20b | 27.35 tok/s |
| Intel(R) Core(TM) i9-10900X CPU @ 3.70GHz | NVIDIA RTX A2000 12GB | 63 GB | Ubuntu 24.04.4 LTS | 0.18.2 | gpt-oss:20b | 27.16 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 125 GB | Fedora Linux 43 (KDE Plasma Desktop Edition) | 0.13.1 | gpt-oss:20b | 26.98 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Advanced Micro Devices, Inc. [AMD/ATI] | 62 GB | Ubuntu 24.04.3 LTS | 0.13.2 | gpt-oss:20b | 26.74 tok/s |
| AMD Ryzen 9 7950X 16-Core Processor | NVIDIA GeForce RTX 4070 | 62 GB | Fedora Linux 43 (KDE Plasma Desktop Edition) | 0.18.2 | gpt-oss:20b | 25.85 tok/s |
| Intel(R) Core(TM) Ultra 7 155H | NVIDIA GeForce RTX 4080 Laptop GPU | 62 GB | Debian GNU/Linux 13 (trixie) | 0.12.2 | gpt-oss:20b | 25.31 tok/s |
| AMD EPYC 7452 32-Core Processor | Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB Tesla M40 24GB | 252 GB | Ubuntu 24.04.3 LTS | 0.12.9 | gpt-oss:20b | 25.04 tok/s |
| AMD Ryzen 9 7950X3D 16-Core Processor | Raphael | 91 GB | Ubuntu 25.10 | 0.15.0 | gpt-oss:20b | 24.96 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.15.6 | gpt-oss:20b | 24.94 tok/s |
| Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz | Tesla P100-PCIE-16GB Tesla P100-PCIE-16GB Tesla P100-PCIE-16GB Tesla P100-PCIE-16GB | 126 GB | "Arch Linux" | 0.17.7 | gpt-oss:20b | 24.51 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | AMD RYZEN AI MAX+ 395 w/ Radeon 8060S AMD Radeon Graphics | 62 GB | Ubuntu 24.04.3 LTS | 0.11.4 | gpt-oss:20b | 23.76 tok/s |
| AMD EPYC 9474F 48-Core Processor | NVIDIA A16 NVIDIA A16 NVIDIA A16 NVIDIA A16 NVIDIA A16 NVIDIA A16 NVIDIA A16 NVIDIA A16 | 1,007 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 23.55 tok/s |
| Intel(R) Core(TM) i9-10920X CPU @ 3.50GHz | NVIDIA GeForce RTX 2080 Ti | 125 GB | Ubuntu 25.10 | 0.13.0 | gpt-oss:20b | 23.22 tok/s |
| Intel(R) Core(TM) i5-10500T CPU @ 2.30GHz | NVIDIA GeForce RTX 3060 | 63 GB | Ubuntu 24.04.4 LTS | 0.16.1 | gpt-oss:20b | 22.91 tok/s |
| Intel(R) Xeon(R) CPU E3-1285 v6 @ 4.10GHz | NVIDIA A2 | 31 GB | Ubuntu 24.04.3 LTS | 0.12.0 | gpt-oss:20b | 22.87 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.11.8 | gpt-oss:20b | 22.50 tok/s |
| AMD Ryzen 7 3700X 8-Core Processor | NVIDIA GeForce RTX 3060 NVIDIA GeForce GTX 1660 SUPER | 31 GB | Debian GNU/Linux 13 (trixie) | 0.16.2 | gpt-oss:20b | 21.96 tok/s |
| AMD Ryzen AI 9 HX 370 w/ Radeon 890M | unknown | 47 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 21.54 tok/s |
| Intel(R) Xeon(R) CPU X5650 @ 2.67GHz | Tesla P4 Tesla P4 | 141 GB | AlmaLinux release 8.10 (Cerulean Leopard) | 0.12.10 | gpt-oss:20b | 21.29 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | bochs-drmdrmfb | 123 GB | Ubuntu 24.04.3 LTS | 0.13.1 | gpt-oss:20b | 21.16 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | NVIDIA GeForce RTX 3060 | 63 GB | Manjaro Linux | 0.12.1 | gpt-oss:20b | 20.36 tok/s |
| 12th Gen Intel(R) Core(TM) i7-12700K | NVIDIA GeForce RTX 3070 Ti | 63 GB | "Ubuntu 24.04.3 LTS" | 0.12.10 | gpt-oss:20b | 19.65 tok/s |
| 12th Gen Intel(R) Core(TM) i9-12900HX | NVIDIA GeForce RTX 4060 Laptop GPU | 63 GB | "Red Hat Enterprise Linux 10.1 (Coughlan)" | 0.15.2 | gpt-oss:20b | 18.87 tok/s |
| Intel(R) Xeon(R) W-2125 CPU @ 4.00GHz | NVIDIA GeForce RTX 3060 | 31 GB | Ubuntu 22.04.5 LTS | 0.12.11 | gpt-oss:20b | 18.64 tok/s |
| 12th Gen Intel(R) Core(TM) i9-12900HX | NVIDIA GeForce RTX 4060 Laptop GPU | 63 GB | "Red Hat Enterprise Linux 10.1 (Coughlan)" | 0.15.2 | gpt-oss:20b | 18.54 tok/s |
| AMD Ryzen 7 8845HS w/ Radeon 780M Graphics | no_gpu | 110 GB | "Ubuntu 24.04.4 LTS" | 0.17.7 | gpt-oss:20b | 18.48 tok/s |
| AMD Ryzen 7 7840U w/ Radeon 780M Graphics | AMD Ryzen 7 7840U w/ Radeon 780M Graphics AMD Radeon 780M Graphics RyzenAI-npu1 | 55 GB | EndeavourOS Linux | 0.17.7 | gpt-oss:20b | 18.39 tok/s |
| AMD Ryzen 5 5600X 6-Core Processor | AMD Ryzen 5 5600X 6-Core Processor AMD Radeon RX 6700 XT | 31 GB | Garuda Linux Broadwing | 0.12.3 | gpt-oss:20b | 18.28 tok/s |
| Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz | NVIDIA GeForce RTX 3060 | 126 GB | Linux Mint 22.2 | 0.15.5-rc2 | gpt-oss:20b | 18.07 tok/s |
| AMD Ryzen AI 9 HX 370 w/ Radeon 890M | unknown | 58 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 17.43 tok/s |
| Intel Core Processor (Haswell, no TSX, IBRS) | Virtio GPU | 47 GB | Ubuntu 22.04.1 LTS | 0.15.6 | gpt-oss:20b | 17.12 tok/s |
| Intel(R) Core(TM) Ultra 9 185H | NVIDIA GeForce RTX 4070 Laptop GPU | 62 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 16.81 tok/s |
| Intel Core Processor (Haswell, no TSX, IBRS) | Virtio GPU | 47 GB | Ubuntu 22.04.1 LTS | 0.15.6 | gpt-oss:20b | 16.71 tok/s |
| Intel(R) Xeon(R) Gold 6430 | bochs-drmdrmfb | 62 GB | "Rocky Linux 9.6 (Blue Onyx)" | 0.12.1 | gpt-oss:20b | 16.34 tok/s |
| AMD Ryzen AI 9 HX PRO 370 w/ Radeon 890M | Strix [Radeon 880M / 890M] | 61 GB | Ubuntu 25.10 | 0.15.5 | gpt-oss:20b | 16.31 tok/s |
| Intel(R) Core(TM) i5-14600KF | NVIDIA GeForce RTX 3070 Ti | 50 GB | Ubuntu 22.04.5 LTS | 0.11.8 | gpt-oss:20b | 16.21 tok/s |
| AMD EPYC 9554P 64-Core Emb Processor | MGA G200eH3 | 755 GB | Ubuntu 22.04.5 LTS | 0.11.4 | gpt-oss:20b | 16.16 tok/s |
| Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | no_gpu | 818 GB | Debian GNU/Linux 13 (trixie) | 0.11.10 | gpt-oss:20b | 15.69 tok/s |
| Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz | Quadro M1200 NVIDIA GeForce RTX 2060 | 47 GB | Ubuntu 22.04.5 LTS | 0.18.3 | gpt-oss:20b | 15.45 tok/s |
| Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | no_gpu | 126 GB | "Debian GNU/Linux 13 (trixie)" | 0.11.10 | gpt-oss:20b | 15.28 tok/s |
| Intel(R) Core(TM) i5-9600K CPU @ 3.70GHz | NVIDIA GeForce RTX 2080 Ti | 63 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 15.10 tok/s |
| AMD Ryzen 7 5700X 8-Core Processor | NVIDIA GeForce RTX 3080 | 31 GB | Arch Linux | 0.13.2 | gpt-oss:20b | 14.85 tok/s |
| AMD EPYC 7532 32-Core Processor | ASPEED Graphics Family | 247 GB | Ubuntu 25.04 | 0.11.5 | gpt-oss:20b | 14.60 tok/s |
| AMD Ryzen 7 5700G with Radeon Graphics | NVIDIA GeForce RTX 5060 Ti | 62 GB | Ubuntu 24.04.2 LTS | 0.11.2 | gpt-oss:20b | 14.35 tok/s |
| AMD Ryzen 7 7840HS w/ Radeon 780M Graphics | AMD Ryzen 7 7840HS w/ Radeon 780M Graphics AMD Radeon 780M Graphics AIE-ML | 55 GB | Fedora Linux 42 (KDE Plasma Desktop Edition) | 0.12.3 | gpt-oss:20b | 14.34 tok/s |
| AMD EPYC 9654 96-Core Processor | SVGA II Adapter | 63 GB | Ubuntu 24.04.4 LTS | 0.18.2 | gpt-oss:20b | 14.26 tok/s |
| 13th Gen Intel(R) Core(TM) i7-13700 | NVIDIA GeForce RTX 3060 | 31 GB | Ubuntu 24.04.3 LTS | 0.13.0 | gpt-oss:20b | 14.23 tok/s |
| Intel(R) Xeon(R) Gold 6208U CPU @ 2.90GHz | Integrated Matrox G200eW3 Graphics Controller | 93 GB | Ubuntu 24.04.4 LTS | 0.17.6 | gpt-oss:20b | 13.89 tok/s |
| AMD Ryzen 7 7800X3D 8-Core Processor | Advanced Micro Devices, Inc. [AMD/ATI] | 62 GB | Ubuntu 22.04.5 LTS | 0.12.3 | gpt-oss:20b | 13.87 tok/s |
| Intel(R) Xeon(R) E E-2456 | Tesla T4 | 31 GB | Debian GNU/Linux 12 (bookworm) | 0.11.6 | gpt-oss:20b | 13.85 tok/s |
| AMD Ryzen 9 3900X 12-Core Processor | NVIDIA GeForce GTX 1080 | 126 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 13.70 tok/s |
| AMD Ryzen AI 9 HX 370 w/ Radeon 890M | unknown | 58 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 13.59 tok/s |
| Intel(R) Core(TM) Ultra 9 275HX | NVIDIA GeForce RTX 5070 Ti Laptop GPU | 61 GB | Ubuntu 25.10 | 0.13.5 | gpt-oss:20b | 13.53 tok/s |
| Intel(R) Core(TM) i7-10875H CPU @ 2.30GHz | NVIDIA GeForce RTX 2080 Super | 31 GB | Ubuntu 24.04.4 LTS | 0.17.7 | gpt-oss:20b | 13.40 tok/s |
| unknown | NVIDIA GeForce GTX 1080 Ti | 63 GB | Ubuntu 24.04.3 LTS | 0.12.6 | gpt-oss:20b | 13.32 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 3080 | 31 GB | "Arch Linux" | 0.11.4 | gpt-oss:20b | 12.86 tok/s |
| 12th Gen Intel(R) Core(TM) i7-12700 | NVIDIA GeForce RTX 4070 | 63 GB | CachyOS | 0.11.4 | gpt-oss:20b | 12.71 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 3070 | 31 GB | Manjaro Linux | 0.13.5 | gpt-oss:20b | 12.70 tok/s |
| Intel(R) Xeon(R) Gold 6208U CPU @ 2.90GHz | Integrated Matrox G200eW3 Graphics Controller | 376 GB | Ubuntu 24.04.4 LTS | 0.17.6 | gpt-oss:20b | 12.70 tok/s |
| Intel(R) Core(TM) i9-10850K CPU @ 3.60GHz | NVIDIA GeForce GTX 1660 | 31 GB | Ubuntu 24.04.4 LTS | 0.17.2 | gpt-oss:20b | 12.48 tok/s |
| AMD Ryzen 5 7600X3D 6-Core Processor | AMD Ryzen 5 7600X3D 6-Core Processor AMD Radeon RX 9070 XT AMD Ryzen 5 7600X3D 6-Core Processor | 125 GB | "Arch Linux" | 0.12.9 | gpt-oss:20b | 12.23 tok/s |
| Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz | bochs-drmdrmfb | 126 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 12.15 tok/s |
| 13th Gen Intel(R) Core(TM) i7-13700KF | no_gpu | 63 GB | Debian GNU/Linux forky/sid | 0.12.6 | gpt-oss:20b | 11.81 tok/s |
| Intel(R) Core(TM) i7-10700K CPU @ 3.80GHz | NVIDIA GeForce RTX 2080 SUPER | 63 GB | Ubuntu 24.04.3 LTS | 0.11.8 | gpt-oss:20b | 11.65 tok/s |
| Intel(R) Core(TM) Ultra 9 185H | Meteor Lake-P [Intel Arc Graphics] | 62 GB | Ubuntu 24.04.4 LTS | 0.18.3 | gpt-oss:20b | 11.54 tok/s |
| AMD EPYC 7B12 | unknown | 94 GB | Debian GNU/Linux rodete | 0.17.7 | gpt-oss:20b | 11.51 tok/s |
| 13th Gen Intel(R) Core(TM) i5-13500 | no_gpu | 63 GB | "Ubuntu 24.04.3 LTS" | 0.16.2 | gpt-oss:20b | 11.16 tok/s |
| AMD Ryzen 9 9900X 12-Core Processor | Advanced Micro Devices, Inc. [AMD/ATI] | 32 GB | Ubuntu 24.04.3 LTS | 0.11.11 | gpt-oss:20b | 11.15 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 3060 | 63 GB | Ubuntu 20.04.3 LTS | 0.11.4 | gpt-oss:20b | 11.13 tok/s |
| Intel(R) Xeon(R) Gold 6208U CPU @ 2.90GHz | Integrated Matrox G200eW3 Graphics Controller | 503 GB | Ubuntu 24.04.4 LTS | 0.17.6 | gpt-oss:20b | 10.77 tok/s |
| Intel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHz | Quadro P4000 | 63 GB | Debian GNU/Linux 12 (bookworm) | 0.17.7 | gpt-oss:20b | 10.74 tok/s |
| AMD EPYC 7B12 64-Core Processor | NVIDIA P102-100 NVIDIA P102-100 | 126 GB | Ubuntu 22.04.5 LTS | 0.16.2 | gpt-oss:20b | 10.45 tok/s |
| 11th Gen Intel(R) Core(TM) i7-11700K @ 3.60GHz | RocketLake-S GT1 [UHD Graphics 750] | 63 GB | Ubuntu 24.04.3 LTS | 0.13.0 | gpt-oss:20b | 10.43 tok/s |
| AMD Ryzen 5 5600 6-Core Processor | NVIDIA GeForce RTX 2060 | 63 GB | "Ubuntu 24.04.3 LTS" | 0.13.5 | gpt-oss:20b | 10.36 tok/s |
| Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz | bochs-drmdrmfb | 126 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 10.30 tok/s |
| AMD Ryzen 7 1700 Eight-Core Processor | Navi 10 [Radeon RX 5600 OEM/5600 XT / 5700/5700 XT] | 31 GB | Pop!_OS 22.04 LTS | 0.13.0 | gpt-oss:20b | 9.99 tok/s |
| (Spark) | NVIDIA GB10 | 120 GB | Ubuntu 24.04.3 LTS | 0.16.1 | gpt-oss:20b | 9.93 tok/s |
| AMD Ryzen 9 5900X 12-Core Processor | NVIDIA GeForce RTX 4090 | 31 GB | Arch Linux | 0.18.2 | gpt-oss:20b | 9.62 tok/s |
| Intel(R) Core(TM) i5-10400 CPU @ 2.90GHz | NVIDIA GeForce GTX 1660 SUPER | 31 GB | Ubuntu 24.04.3 LTS | 0.12.3 | gpt-oss:20b | 9.60 tok/s |
| Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz | bochs-drmdrmfb | 126 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 9.59 tok/s |
| AMD Ryzen AI 9 HX PRO 370 w/ Radeon 890M | no_gpu | 39 GB | Debian GNU/Linux 13 (trixie) | 0.13.3 | gpt-oss:20b | 9.56 tok/s |
| Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz | bochs-drmdrmfb | 126 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 9.36 tok/s |
| Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz | Tesla M10 Tesla M10 Tesla M10 Tesla M10 Tesla M10 Tesla M10 Tesla M10 Tesla M10 | 63 GB | Ubuntu 24.04.3 LTS | 0.15.2 | gpt-oss:20b | 9.34 tok/s |
| AMD Ryzen 7 1700X Eight-Core Processor | NVIDIA GeForce GTX 1060 6GB | 31 GB | Ubuntu 20.04.6 LTS | 0.12.10 | gpt-oss:20b | 9.10 tok/s |
| AMD Ryzen 7 7730U with Radeon Graphics | Barcelo | 60 GB | Ubuntu 22.04.3 LTS | 0.15.5 | gpt-oss:20b | 8.62 tok/s |
| AMD Ryzen 7 7730U with Radeon Graphics | Barcelo | 47 GB | Ubuntu 22.04.3 LTS | 0.15.5 | gpt-oss:20b | 8.53 tok/s |
| 13th Gen Intel(R) Core(TM) i7-13850HX | NVIDIA RTX 2000 Ada Generation Laptop GPU | 62 GB | Manjaro Linux | 0.11.4 | gpt-oss:20b | 8.40 tok/s |
| Intel(R) Xeon(R) CPU E5-4669 v4 @ 2.20GHz | no_gpu | 252 GB | Debian GNU/Linux 13 (trixie) | 0.15.1 | gpt-oss:20b | 8.19 tok/s |
| Intel(R) Core(TM) Ultra 9 185H | Basic Render Driver | 31 GB | Ubuntu 24.04.4 LTS | 0.17.7 | gpt-oss:20b | 7.91 tok/s |
| Intel(R) Xeon(R) CPU E5-2660 v4 @ 2.00GHz | Tesla P4 | 63 GB | Ubuntu 24.04.1 LTS | 0.16.3 | gpt-oss:20b | 7.75 tok/s |
| Intel(R) Core(TM) i5-10400 CPU @ 2.90GHz | no_gpu | 63 GB | "Fedora Linux 43 (Workstation Edition)" | 0.16.3 | gpt-oss:20b | 7.71 tok/s |
| Intel(R) Core(TM) i7-10700K CPU @ 3.80GHz | NVIDIA GeForce GTX 1080 Ti | 63 GB | Ubuntu 24.04.2 LTS | 0.11.2 | gpt-oss:20b | 7.64 tok/s |
| Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz | CoffeeLake-S GT2 [UHD Graphics 630] | 126 GB | Ubuntu 24.04.4 LTS | 0.17.4 | gpt-oss:20b | 7.63 tok/s |
| Intel(R) Core(TM) i7-10700K CPU @ 3.80GHz | NVIDIA GeForce GTX 1080 Ti | 63 GB | Ubuntu 24.04.2 LTS | 0.11.2 | gpt-oss:20b | 7.62 tok/s |
| 11th Gen Intel(R) Core(TM) i7-1185G7 @ 3.00GHz | TigerLake-LP GT2 [Iris Xe Graphics] | 61 GB | Ubuntu 25.10 | 0.14.3 | gpt-oss:20b | 7.59 tok/s |
| AMD Ryzen 7 5800X3D 8-Core Processor | NVIDIA GeForce RTX 3060 Ti | 126 GB | Linux Mint 21.3 | 0.11.4 | gpt-oss:20b | 7.50 tok/s |
| AMD Ryzen 5 3600 6-Core Processor | AMD Ryzen 5 3600 6-Core Processor AMD Radeon RX 6900 XT | 31 GB | "Arch Linux" | 0.18.2 | gpt-oss:20b | 7.45 tok/s |
| l2-cache-9 | unknown | 123 GB | Ubuntu 24.04.3 LTS | 0.12.11 | gpt-oss:20b | 7.26 tok/s |
| l2-cache-9 | NVIDIA Thor | 123 GB | Ubuntu 24.04.3 LTS | 0.11.8 | gpt-oss:20b | 7.12 tok/s |
| AMD Ryzen 5 3600 6-Core Processor | Baffin [Radeon RX 550 640SP / RX 560/560X] | 31 GB | Pop!_OS 22.04 LTS | 0.11.8 | gpt-oss:20b | 7.04 tok/s |
| AMD Ryzen 9 5950X 16-Core Processor | no_gpu | 126 GB | Debian GNU/Linux 12 (bookworm) | 0.11.4 | gpt-oss:20b | 6.96 tok/s |
| AMD Ryzen 9 7940HS w/ Radeon 780M Graphics | no_gpu | 124 GB | Debian GNU/Linux 13 (trixie) | 0.11.4 | gpt-oss:20b | 6.90 tok/s |
| unknown | NVIDIA GeForce GTX 1050 Ti | 31 GB | Ubuntu 24.04.3 LTS | 0.12.9 | gpt-oss:20b | 6.86 tok/s |
| AMD Ryzen 7 7730U with Radeon Graphics | Barcelo | 60 GB | Ubuntu 22.04.3 LTS | 0.15.5 | gpt-oss:20b | 6.80 tok/s |
| AMD Ryzen 5 3600 6-Core Processor | Advanced Micro Devices, Inc. [AMD/ATI] | 31 GB | Pop!_OS 22.04 LTS | 0.11.8 | gpt-oss:20b | 6.79 tok/s |
| Intel(R) Core(TM) i7-8850H CPU @ 2.60GHz | Quadro P2000 | 63 GB | Debian GNU/Linux 12 (bookworm) | 0.11.11 | gpt-oss:20b | 6.70 tok/s |
| Intel(R) Core(TM) Ultra 9 285H | NVIDIA GeForce RTX 5070 Ti Laptop GPU | 31 GB | Ubuntu 24.04.3 LTS | 0.16.3 | gpt-oss:20b | 6.70 tok/s |
| AMD Ryzen Threadripper 2970WX 24-Core Processor | Tesla M40 | 63 GB | Ubuntu 24.04.3 LTS | 0.11.6 | gpt-oss:20b | 6.67 tok/s |
| Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz | no_gpu | 63 GB | Debian GNU/Linux 13 (trixie) | 0.12.6 | gpt-oss:20b | 6.57 tok/s |
| Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz | AMD Radeon Pro WX 4100 | 63 GB | Debian GNU/Linux 13 (trixie) | 0.12.6 | gpt-oss:20b | 6.53 tok/s |
| Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz | CoffeeLake-H GT2 [UHD Graphics 630] | 63 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 5.85 tok/s |
| Intel Core Processor (Broadwell) | Tesla P4 | 432 GB | Ubuntu 24.04.3 LTS | 0.11.7 | gpt-oss:20b | 5.84 tok/s |
| Intel(R) Core(TM) Ultra 9 285K | Arrow Lake-U [Intel Graphics] | 94 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 5.66 tok/s |
| AMD RYZEN AI MAX+ 395 w/ Radeon 8060S | Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] | 125 GB | Fedora Linux 43 (KDE Plasma Desktop Edition) | 0.14.2 | gpt-oss:20b | 5.65 tok/s |
| Intel(R) Core(TM) i7-9700F CPU @ 3.00GHz | no_gpu | 63 GB | Arch Linux | 0.16.3 | gpt-oss:20b | 5.44 tok/s |
| Intel(R) Core(TM) Ultra 9 285H | unknown | 94 GB | Ubuntu 24.04.3 LTS | 0.15.6 | gpt-oss:20b | 5.04 tok/s |
| Intel(R) Xeon(R) Silver 4316 CPU @ 2.30GHz | no_gpu | 31 GB | "Ubuntu 24.04.3 LTS" | 0.12.11 | gpt-oss:20b | 4.85 tok/s |
| Intel(R) Xeon(R) Gold 5120 CPU @ 2.20GHz | SVGA II Adapter | 63 GB | Ubuntu 24.04.3 LTS | 0.11.11 | gpt-oss:20b | 4.78 tok/s |
| Intel(R) Xeon(R) Gold 6126 CPU @ 2.60GHz | no_gpu | 755 GB | Debian GNU/Linux forky/sid | 0.11.4 | gpt-oss:20b | 4.75 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 4.75 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 4.75 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 4.74 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 4.73 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 4.73 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 4.73 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 4.73 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 4.73 tok/s |
| l3-cache2 | Orin (nvgpu) | 61 GB | Ubuntu 22.04.5 LTS | 0.12.6 | gpt-oss:20b | 4.72 tok/s |
| Intel(R) Xeon(R) Silver 4210R CPU @ 2.40GHz | SVGA II Adapter | 31 GB | Ubuntu 24.04.3 LTS | 0.11.10 | gpt-oss:20b | 4.43 tok/s |
| Intel(R) Xeon(R) CPU E5-2440 v2 @ 1.90GHz | Tesla P40 Tesla P40 | 189 GB | Debian GNU/Linux 13 (trixie) | 0.15.0 | gpt-oss:20b | 4.41 tok/s |
| AMD EPYC 9754 128-Core Processor | no_gpu | 126 GB | Ubuntu 24.04.3 LTS | 0.13.5 | gpt-oss:20b | 4.36 tok/s |
| Intel(R) Xeon(R) Gold 5120 CPU @ 2.20GHz | SVGA II Adapter | 63 GB | Ubuntu 24.04.3 LTS | 0.11.11 | gpt-oss:20b | 3.65 tok/s |
| AMD Ryzen 9 7940HS w/ Radeon 780M Graphics | amdgpudrmfb | 61 GB | "NixOS 25.11 (Xantusia)" | 0.11.3 | gpt-oss:20b | 3.47 tok/s |
| Cortex-A720 | no_gpu | 62 GB | Debian GNU/Linux 12 (bookworm) | 0.13.5 | gpt-oss:20b | 2.98 tok/s |
| Cortex-A720 | no_gpu | 62 GB | Debian GNU/Linux 12 (bookworm) | 0.13.5 | gpt-oss:20b | 2.97 tok/s |
| Cortex-A720 | no_gpu | 62 GB | Debian GNU/Linux 12 (bookworm) | 0.13.5 | gpt-oss:20b | 2.95 tok/s |
| Intel(R) Core(TM) i7-8850H CPU @ 2.60GHz | Quadro P2000 | 47 GB | Manjaro Linux | 0.11.4 | gpt-oss:20b | 2.75 tok/s |
| AMD Ryzen Threadripper PRO 5975WX 32-Cores | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 251 GB | Ubuntu 24.04.3 LTS | 0.11.8 | gpt-oss:20b | 1.40 tok/s |
| Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz | unknown | 63 GB | Ubuntu 22.04.5 LTS | 0.18.3 | gpt-oss:20b | 1.20 tok/s |