Skip to content

add multiprocessing unit tests, working file-descriptor based solution and OSX#11

Merged
apaszke merged 13 commits intomasterfrom
multiprocessing
Sep 8, 2016
Merged

add multiprocessing unit tests, working file-descriptor based solution and OSX#11
apaszke merged 13 commits intomasterfrom
multiprocessing

Conversation

@apaszke
Copy link
Contributor

@apaszke apaszke commented Sep 7, 2016

Don't merge, this PR is only for test purposes

soumith and others added 3 commits August 13, 2016 11:33
* TH_ALLOCATOR_MAPPED_FROMFD uses an existing file descriptor for
  mapping (and steals it)
* TH_ALLOCATOR_MAPPED_KEEPFD doesn't close the file descriptor
  until the mapping is freed
* TH_ALLOCATOR_MAPPED_UNLINK unlinks the file immediately after
  mapping it to memory

Also, now it's using fstat to check the file size (instead of lseek,
which alters the fd state).
@soumith soumith closed this Sep 7, 2016
@soumith soumith reopened this Sep 7, 2016

This comment was marked as off-topic.

@soumith soumith changed the title Update multiprocessing add multiprocessing unit tests, working file-descriptor based solution and OSX Sep 8, 2016
@apaszke apaszke merged commit 3d6b805 into master Sep 8, 2016
@soumith soumith deleted the multiprocessing branch September 20, 2016 20:49
apaszke pushed a commit that referenced this pull request Apr 28, 2017
Summary:
This change includes CMake changes to compile the MPI assets when the USE_MPI flag is enabled. If so, the benchmark tool can now be launched through mpirun.

Includes the changes done in #11.
Closes pytorch/gloo#12

Reviewed By: Yangqing

Differential Revision: D4712060

Pulled By: pietern

fbshipit-source-id: 0d0e93882f5822583f59304d4256dbdf5dea7483
soumith pushed a commit that referenced this pull request Jul 13, 2017
Fix ATen build for debug python
hubertlu-tw pushed a commit to hubertlu-tw/pytorch that referenced this pull request Nov 1, 2022
Handle the use of .sum() in fused LSTM/GRU backward
hubertlu-tw pushed a commit to hubertlu-tw/pytorch that referenced this pull request Nov 1, 2022
[FusedOptimizers] Bug fixes in fused optimizers for fp16/bfp16.
@iateadonut iateadonut mentioned this pull request Sep 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants