Skip to content

Add a OperatorHandle argument to boxed kernels#29201

Closed
smessmer wants to merge 21 commits intogh/smessmer/109/basefrom
gh/smessmer/109/head
Closed

Add a OperatorHandle argument to boxed kernels#29201
smessmer wants to merge 21 commits intogh/smessmer/109/basefrom
gh/smessmer/109/head

Conversation

@smessmer
Copy link
Contributor

@smessmer smessmer commented Nov 5, 2019

Stack from ghstack:

This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: D18282746

This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
smessmer added a commit that referenced this pull request Nov 5, 2019
Pull Request resolved: #29201

This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.
ghstack-source-id: 93276980

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)
@smessmer smessmer requested review from dzhulgakov and ezyang November 5, 2019 15:49
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
smessmer added a commit that referenced this pull request Nov 5, 2019
Pull Request resolved: #29201

This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.
ghstack-source-id: 93280246

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)
Copy link
Contributor

@ezyang ezyang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have we audited the OperatorHandle API so that it is OK to make public?

This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This was referenced Nov 12, 2019
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
@smessmer smessmer requested a review from apaszke as a code owner November 15, 2019 09:19
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
@smessmer
Copy link
Contributor Author

Which part of the API exactly? This is the current API, but I don't think it's stable yet. The callUnboxed method for example has quite some quirks - you need to pass it exactly the same type the kernel function had (i.e. const Tensor& is not the same as Tensor). Ideally, you wouldn't have to specify the type arguments at all and it would infer it from the values you pass in.

This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
mcarilli pushed a commit to mcarilli/pytorch that referenced this pull request Nov 19, 2019
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
This is required for boxed backend fallback kernels (e.g. lazy, AMP) because they need to know which op was actually called.

Differential Revision: [D18282746](https://our.internmc.facebook.com/intern/diff/D18282746/)

[ghstack-poisoned]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants