#21785 showed that at::svd() is not stream-safe. at::svd() uses magma_dgesdd().
According to http://icl.cs.utk.edu/magma/forum/viewtopic.php?f=2&t=1080, the old way of making MAGMA functions stream-safe is:
lock()
magmablasSetKernelStream( s1 )
magma_dgemm( ... )
unlock()
The new way is using a magma_queue_t, but not all functions have it. In particular magma_dgesdd() doesn't appear to have this parameter.
I'm not sure if either of these methods can be integrated into pytorch. Meanwhile, the functions should probably raise an error if a non-default stream is detected.
#21785 showed that
at::svd()is not stream-safe.at::svd()usesmagma_dgesdd().According to http://icl.cs.utk.edu/magma/forum/viewtopic.php?f=2&t=1080, the old way of making MAGMA functions stream-safe is:
The new way is using a
magma_queue_t, but not all functions have it. In particularmagma_dgesdd()doesn't appear to have this parameter.I'm not sure if either of these methods can be integrated into
pytorch. Meanwhile, the functions should probably raise an error if a non-default stream is detected.