Ideally, the kernel and its modules should be available as an archive for each release. So that one doesn't have to reinstall a new pi64 version from scratch each time in order to get kernel updates / fixes.
There could be a new command for that in pi64-config, that would download the latest archive from github releases.