In pytorch/docs/source/notes/cuda.rst, it is mentioned that:

unless care is taken to meet the data handling requirements exactly, it is likely that your program will have incorrect or undefined behavior.

IMO, more details on the requirements would be helpful for this part.