Skip to content

Disallow num_workers > 0 for DataLoader on Windows#5591

Merged
ezyang merged 1 commit intopytorch:masterfrom
yf225:windows_fix
Mar 7, 2018
Merged

Disallow num_workers > 0 for DataLoader on Windows#5591
ezyang merged 1 commit intopytorch:masterfrom
yf225:windows_fix

Conversation

@yf225
Copy link
Copy Markdown
Contributor

@yf225 yf225 commented Mar 6, 2018

Using DataLoader with num_workers > 0 is known to cause CUDA out-of-memory issue on Windows.

Example: https://ci.pytorch.org/jenkins/job/pytorch-builds/job/pytorch-win-ws2016-cuda9-cudnn7-py3-test/2436//console

This issue has already been noted in #4092.

@ezyang
Copy link
Copy Markdown
Contributor

ezyang commented Mar 6, 2018

Do we have to skip the corresponding tests in Windows? @yf225

@yf225
Copy link
Copy Markdown
Contributor Author

yf225 commented Mar 6, 2018

@ezyang In this PR https://github.com/pytorch/pytorch/pull/4640/files#diff-f539198dd366265fb8dc2d661bc5d5bcR618 it's already skipped in the latest commit

@yf225
Copy link
Copy Markdown
Contributor Author

yf225 commented Mar 6, 2018

Existing tests with multiple workers are skipped in #5322.

@ezyang ezyang merged commit a90b695 into pytorch:master Mar 7, 2018
laurentdupin pushed a commit to laurentdupin/pytorch that referenced this pull request Apr 24, 2026
Using DataLoader with num_workers > 0 is known to cause CUDA out-of-memory issue on Windows.

This issue has already been noted in pytorch#4092.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants