Each shared folder shows an 'Shared With' item, containing all the devices that the folder is shared with. I propose to open the dialog for changing the shared with setting, when clicking on any of those devices.

And maybe do something similar with the 'Folders' item for each device in the remote device list.