Skip to content

BatchNorm fallback to THNN when eps < CUDNN_BN_MIN_EPSILON#1742

Merged
soumith merged 1 commit intomasterfrom
fixesv18
Jun 7, 2017
Merged

BatchNorm fallback to THNN when eps < CUDNN_BN_MIN_EPSILON#1742
soumith merged 1 commit intomasterfrom
fixesv18

Conversation

@soumith
Copy link
Collaborator

@soumith soumith commented Jun 7, 2017

fixes #1623

@soumith soumith merged commit edd41d8 into master Jun 7, 2017
using thpp::Tensor;

#ifndef CUDNN_BN_MIN_EPSILON
#define CUDNN_BN_MIN_EPSILON 0

This comment was marked as off-topic.

This comment was marked as off-topic.

@soumith soumith deleted the fixesv18 branch June 7, 2017 15:08
jjsjann123 added a commit to jjsjann123/pytorch that referenced this pull request Jun 7, 2022
Fixes pytorch#1741

Relaxing vectorization check to avoid false assert on strides for broadcasted domains
Shamelessly stole Kevin's cpp repro.
jjsjann123 added a commit to jjsjann123/pytorch that referenced this pull request Jun 8, 2022
…sarofeen/pytorch/

Squashed commits to WAR github API

Commits that's actually in this PR from the devel branch:

4c60e7d Add examples infrastructure for using nvFuser in a standalone program (pytorch#1725)
02a05d9 Fix issue pytorch#1751 (pytorch#1753)
8a69aa3 Refactor NvFuser transpose API to match eager mode behavior (pytorch#1746)
ffdf6b7 Remove BroadcastWithoutStride. (pytorch#1738)
02bab16 Fix flipping of a boolean flag (pytorch#1745)
465d668 cleanup (pytorch#1744)
26d354e fixing noncontig broadcast (pytorch#1742)
856b6b2 Add IterDomainBuilder (pytorch#1736)
1fd974f fixing warning for gcc7 (pytorch#1732)
de2740a disabling complex in python tests for pytorch#1730 (pytorch#1733)
fbbbe0a fixing MSVC build (pytorch#1728)
b5feee5 Fix the fused reduction runtime kernel (pytorch#1729)
5247682 Re-entrant GroupedGridReduction (pytorch#1727)
pytorchmergebot pushed a commit that referenced this pull request Jun 10, 2022
Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/

Bug fixes and minor refactor

Squashed commits to WAR github API
Commits that's actually in this PR from the devel branch:

```
4c60e7d Add examples infrastructure for using nvFuser in a standalone program (#1725)
02a05d9 Fix issue #1751 (#1753)
8a69aa3 Refactor NvFuser transpose API to match eager mode behavior (#1746)
ffdf6b7 Remove BroadcastWithoutStride. (#1738)
02bab16 Fix flipping of a boolean flag (#1745)
465d668 cleanup (#1744)
26d354e fixing noncontig broadcast (#1742)
856b6b2 Add IterDomainBuilder (#1736)
1fd974f fixing warning for gcc7 (#1732)
de2740a disabling complex in python tests for #1730 (#1733)
fbbbe0a fixing MSVC build (#1728)
b5feee5 Fix the fused reduction runtime kernel (#1729)
5247682 Re-entrant GroupedGridReduction (#1727)
```

RUN_TORCHBENCH: nvfuser
Pull Request resolved: #79147
Approved by: https://github.com/davidberard98
facebook-github-bot pushed a commit that referenced this pull request Jun 10, 2022
Summary:
Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/

Bug fixes and minor refactor

Squashed commits to WAR github API
Commits that's actually in this PR from the devel branch:

```
4c60e7d Add examples infrastructure for using nvFuser in a standalone program (#1725)
02a05d9 Fix issue #1751 (#1753)
8a69aa3 Refactor NvFuser transpose API to match eager mode behavior (#1746)
ffdf6b7 Remove BroadcastWithoutStride. (#1738)
02bab16 Fix flipping of a boolean flag (#1745)
465d668 cleanup (#1744)
26d354e fixing noncontig broadcast (#1742)
856b6b2 Add IterDomainBuilder (#1736)
1fd974f fixing warning for gcc7 (#1732)
de2740a disabling complex in python tests for #1730 (#1733)
fbbbe0a fixing MSVC build (#1728)
b5feee5 Fix the fused reduction runtime kernel (#1729)
5247682 Re-entrant GroupedGridReduction (#1727)
```

Pull Request resolved: #79147

Reviewed By: zou3519

Differential Revision: D37038192

Pulled By: davidberard98

fbshipit-source-id: 330f46ee21eef5c2de7e178290f2962aa030393e
pytorchmergebot pushed a commit that referenced this pull request Jun 16, 2022
Landing reverted PR #79147.

Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/

Bug fixes and minor refactor

Squashed commits to WAR github API
Commits that's actually in this PR from the devel branch:

```
4c60e7d Add examples infrastructure for using nvFuser in a standalone program (#1725)
02a05d9 Fix issue #1751 (#1753)
8a69aa3 Refactor NvFuser transpose API to match eager mode behavior (#1746)
ffdf6b7 Remove BroadcastWithoutStride. (#1738)
02bab16 Fix flipping of a boolean flag (#1745)
465d668 cleanup (#1744)
26d354e fixing noncontig broadcast (#1742)
856b6b2 Add IterDomainBuilder (#1736)
1fd974f fixing warning for gcc7 (#1732)
de2740a disabling complex in python tests for #1730 (#1733)
fbbbe0a fixing MSVC build (#1728)
b5feee5 Fix the fused reduction runtime kernel (#1729)
5247682 Re-entrant GroupedGridReduction (#1727)
```

RUN_TORCHBENCH: nvfuser
Pull Request resolved: #79406
Approved by: https://github.com/davidberard98
facebook-github-bot pushed a commit that referenced this pull request Jun 16, 2022
Summary:
Landing reverted PR #79147.

Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/

Bug fixes and minor refactor

Squashed commits to WAR github API
Commits that's actually in this PR from the devel branch:

```
4c60e7d Add examples infrastructure for using nvFuser in a standalone program (#1725)
02a05d9 Fix issue #1751 (#1753)
8a69aa3 Refactor NvFuser transpose API to match eager mode behavior (#1746)
ffdf6b7 Remove BroadcastWithoutStride. (#1738)
02bab16 Fix flipping of a boolean flag (#1745)
465d668 cleanup (#1744)
26d354e fixing noncontig broadcast (#1742)
856b6b2 Add IterDomainBuilder (#1736)
1fd974f fixing warning for gcc7 (#1732)
de2740a disabling complex in python tests for #1730 (#1733)
fbbbe0a fixing MSVC build (#1728)
b5feee5 Fix the fused reduction runtime kernel (#1729)
5247682 Re-entrant GroupedGridReduction (#1727)
```

RUN_TORCHBENCH: nvfuser

Pull Request resolved: #79406

Reviewed By: anjali411

Differential Revision: D37109147

Pulled By: davidberard98

fbshipit-source-id: 14209be028a3338be112cc83ffe77e631f802891
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

incompatibility between Pytorch 0.1.12 and cuda 8.0.61/cudnn 5.1.10 ?

2 participants