ChebyKAN is faster #7
Description
Right now the ChebyKAN implementation is the fastest one. You are not including it in your README. If you want to claim that you are the fastest you should provide evidence that supports it. Specially now that I have run the benchmark on my machine and ChebyKAN appears to run faster than yours. The updated benchmarks in my repo is now as follows:
| forward | backward | forward | backward | num params | num trainable params
----------------------------------------------------------------------------------------------------------------------------------
effkan-cpu | 31.98 ms | 44.49 ms | nan GB | nan GB | 10010000 | 10010000
effkan-gpu | 4.76 ms | 4.54 ms | 0.13 GB | 0.19 GB | 10010000 | 10010000
fourierkan-cpu | 727.35 ms | 936.78 ms | nan GB | nan GB | 10011001 | 10011001
fourierkan-gpu | 17.93 ms | 14.40 ms | 1.96 GB | 2.01 GB | 10011001 | 10011001
fusedfourierkan-cpu | 908.43 ms | 1637.14 ms | nan GB | nan GB | 10011001 | 10011001
fusedfourierkan-gpu | 30.30 ms | 84.61 ms | 0.09 GB | 0.13 GB | 10011001 | 10011001
cufkan-cpu | 1467.37 ms | 3767.40 ms | nan GB | nan GB | 10011001 | 10011001
cufkan-gpu | 5.95 ms | 49.74 ms | 0.09 GB | 0.13 GB | 10011001 | 10011001
chebykan-cpu | 20.29 ms | 12.38 ms | nan GB | nan GB | 10010000 | 10010000
chebykan-gpu | 1.03 ms | 1.21 ms | 0.14 GB | 0.13 GB | 10010000 | 10010000
fast-kan-cpu | 9.96 ms | 17.06 ms | nan GB | nan GB | 10015019 | 10015001
fast-kan-gpu | 1.44 ms | 2.13 ms | 0.11 GB | 0.14 GB | 10015019 | 10015001
faster-kan-cpu | 10.58 ms | 15.42 ms | nan GB | nan GB | 10014022 | 10014000
faster-kan-gpu | 1.20 ms | 2.01 ms | 0.12 GB | 0.14 GB | 10014022 | 10014000
rbf-kan-cpu | 12.59 ms | 12.07 ms | nan GB | nan GB | 10011019 | 10011001
rbf-kan-gpu | 1.12 ms | 2.08 ms | 0.11 GB | 0.13 GB | 10011019 | 10011001
----------------------------------------------------------------------------------------------------------------------------------
mlp-cpu | 9.77 ms | 7.27 ms | nan GB | nan GB | 10020001 | 10020001
mlp-gpu | 0.49 ms | 1.07 ms | 0.10 GB | 0.13 GB | 10020001 | 10020001
----------------------------------------------------------------------------------------------------------------------------------
pykan-cpu | 15.59 ms | 17.53 ms | nan GB | nan GB | 2431 | 1551
pykan-gpu | 50.56 ms | 93.93 ms | 0.02 GB | 0.02 GB | 2431 | 1551
As you can see, the rbf-kan is also faster in the forward while being slower in the backward. And the chebykan is faster in both cases.