Skip to content

Fix Windows build in tensor merge PR#9715

Merged
ezyang merged 6 commits intopytorch:tensor-mergefrom
ezyang:testing/windows-tensor-merge
Jul 23, 2018
Merged

Fix Windows build in tensor merge PR#9715
ezyang merged 6 commits intopytorch:tensor-mergefrom
ezyang:testing/windows-tensor-merge

Conversation

@ezyang
Copy link
Contributor

@ezyang ezyang commented Jul 23, 2018

Prior to this patch, the Windows build failed saying that it ran out of heap. This fixes the problem.

This is done by splitting up THTensor.cpp into more compilation units; furthermore, THTensorMath.cpp is further split into THTensorMath, THTensorMoreMath, and THTensorEvenMoreMath. Because I'm pressed for time I didn't try to split them based on theme; it's just purely positional based on the original file.

ezyang added 4 commits July 23, 2018 09:48
This increases available parallelism, and fixes an
MSVC out of heap space error.

Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
ezyang added 2 commits July 23, 2018 09:55
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
TH_API void THTensor_(narrow)(THTensor *self, THTensor *src, int dimension_, int64_t firstIndex_, int64_t size_);
TH_API void THTensor_(select)(THTensor *self, THTensor *src, int dimension_, int64_t sliceIndex_);
TH_API void THTensor_(transpose)(THTensor *self, THTensor *src, int dimension1_, int dimension2_);
TH_API int THTensor_(isTransposed)(const THTensor *self);

This comment was marked as off-topic.

This comment was marked as off-topic.

Copy link
Contributor

@gchanan gchanan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If this unblocks us I think it can go in. But these file names are pretty bad. THC has better names and you can just copy them.

Copy link
Collaborator

@ssnl ssnl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm to me as well. let's get this in to unblock.

@ezyang ezyang merged commit 59022ec into pytorch:tensor-merge Jul 23, 2018
@ezyang ezyang mentioned this pull request Jul 23, 2018
11 tasks
facebook-github-bot pushed a commit that referenced this pull request Jul 24, 2018
Summary:
Constituent PRs:

- [x] #9553 Remove unnecessary functions from StorageDerived.h (by cpuhrsch, reviewed by ezyang)
- [x] #9588 Use THTensor/Storage for THVoidTensor/Storage (by cpuhrsch , reviewed by gchanan)
- [x] #9627 Delete context from tensor (by ezyang, reviewed by gchanan)
- [x] #9641 Tensor reorganization (by ezyang, reviewed by gchanan )
- [x] #9647 Remove dim_ from THTensor (by cpuhrsch, reviewed by ezyang)
- [x] #9650 Remove context (by cpuhrsch, reviewed by gchanan and ezyang)
- [x] #9715 Fix Windows build in tensor merge PR (by ezyang, reviewed by gchanan and SsnL)

Upcoming PRs which didn't make this cut:

- [x] #9644 Stride move to TensorImpl, and nits (by ezyang, reviewed by gchanan)
- [ ] #9652 Native localScalar  (by ezyang, **UNREVIEWED AND FAILING TESTS**)
- [x] #9710 Devirtualize TensorImpl::toString (by ezyang, reviewed by gchanan)
- [ ] #9654 Use int64_t instead of ptrdiff_t for size / Rename flag to resizable_  (by cpuhrsch, **CHANGES REQUESTED AND FAILING TESTS**)
Pull Request resolved: #9713

Reviewed By: gchanan

Differential Revision: D8960882

Pulled By: ezyang

fbshipit-source-id: 99747b2c5462c7ff6809b67aacb4197626408204
jramseyer pushed a commit to jramseyer/pytorch that referenced this pull request Jul 30, 2018
Summary:
Constituent PRs:

- [x] pytorch#9553 Remove unnecessary functions from StorageDerived.h (by cpuhrsch, reviewed by ezyang)
- [x] pytorch#9588 Use THTensor/Storage for THVoidTensor/Storage (by cpuhrsch , reviewed by gchanan)
- [x] pytorch#9627 Delete context from tensor (by ezyang, reviewed by gchanan)
- [x] pytorch#9641 Tensor reorganization (by ezyang, reviewed by gchanan )
- [x] pytorch#9647 Remove dim_ from THTensor (by cpuhrsch, reviewed by ezyang)
- [x] pytorch#9650 Remove context (by cpuhrsch, reviewed by gchanan and ezyang)
- [x] pytorch#9715 Fix Windows build in tensor merge PR (by ezyang, reviewed by gchanan and SsnL)

Upcoming PRs which didn't make this cut:

- [x] pytorch#9644 Stride move to TensorImpl, and nits (by ezyang, reviewed by gchanan)
- [ ] pytorch#9652 Native localScalar  (by ezyang, **UNREVIEWED AND FAILING TESTS**)
- [x] pytorch#9710 Devirtualize TensorImpl::toString (by ezyang, reviewed by gchanan)
- [ ] pytorch#9654 Use int64_t instead of ptrdiff_t for size / Rename flag to resizable_  (by cpuhrsch, **CHANGES REQUESTED AND FAILING TESTS**)
Pull Request resolved: pytorch#9713

Reviewed By: gchanan

Differential Revision: D8960882

Pulled By: ezyang

fbshipit-source-id: 99747b2c5462c7ff6809b67aacb4197626408204
goodlux pushed a commit to goodlux/pytorch that referenced this pull request Aug 15, 2018
Summary:
Constituent PRs:

- [x] pytorch#9553 Remove unnecessary functions from StorageDerived.h (by cpuhrsch, reviewed by ezyang)
- [x] pytorch#9588 Use THTensor/Storage for THVoidTensor/Storage (by cpuhrsch , reviewed by gchanan)
- [x] pytorch#9627 Delete context from tensor (by ezyang, reviewed by gchanan)
- [x] pytorch#9641 Tensor reorganization (by ezyang, reviewed by gchanan )
- [x] pytorch#9647 Remove dim_ from THTensor (by cpuhrsch, reviewed by ezyang)
- [x] pytorch#9650 Remove context (by cpuhrsch, reviewed by gchanan and ezyang)
- [x] pytorch#9715 Fix Windows build in tensor merge PR (by ezyang, reviewed by gchanan and SsnL)

Upcoming PRs which didn't make this cut:

- [x] pytorch#9644 Stride move to TensorImpl, and nits (by ezyang, reviewed by gchanan)
- [ ] pytorch#9652 Native localScalar  (by ezyang, **UNREVIEWED AND FAILING TESTS**)
- [x] pytorch#9710 Devirtualize TensorImpl::toString (by ezyang, reviewed by gchanan)
- [ ] pytorch#9654 Use int64_t instead of ptrdiff_t for size / Rename flag to resizable_  (by cpuhrsch, **CHANGES REQUESTED AND FAILING TESTS**)
Pull Request resolved: pytorch#9713

Reviewed By: gchanan

Differential Revision: D8960882

Pulled By: ezyang

fbshipit-source-id: 99747b2c5462c7ff6809b67aacb4197626408204
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants