Didn’t have much time, found alternative (plugin) and it works.
Already did that and just to be sure I deleted plugin, as you said, and manually removed wp-content/wp-cache-config.php. Then reinstalled it, set it up and the issue appeared again. Site not loading for not logged in users.
I didn’t change anything regarding PHP version (using 7.4).