Skip to content

[export] Enable verifier [2/n]#113075

Closed
zhxchen17 wants to merge 1 commit intopytorch:mainfrom
zhxchen17:export-D51014944
Closed

[export] Enable verifier [2/n]#113075
zhxchen17 wants to merge 1 commit intopytorch:mainfrom
zhxchen17:export-D51014944

Conversation

@zhxchen17
Copy link
Copy Markdown
Contributor

@zhxchen17 zhxchen17 commented Nov 6, 2023

Summary: Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Test Plan: CI

Differential Revision: D51014944

cc @avikchaudhuri @gmagogsfm @tugsbayasgalan @angelayi @suo @ydwu4

@pytorch-bot
Copy link
Copy Markdown

pytorch-bot Bot commented Nov 6, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/113075

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit 3bb63ce with merge base eb54873 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot
Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D51014944

range_constraints: Dict[str, RangeConstraint]
equality_constraints: List[Tuple[Tuple[str, int], Tuple[str, int]]]
schema_version: int
example_inputs: Optional[Tuple[List[bytes], Dict[str, bytes]]]
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we're removing this?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removing this in schema

zhxchen17 added a commit to zhxchen17/executorch-1 that referenced this pull request Nov 6, 2023
Summary:
X-link: pytorch/pytorch#113075

Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Differential Revision: D51014944
zhxchen17 added a commit to zhxchen17/executorch-1 that referenced this pull request Nov 7, 2023
Summary:

X-link: pytorch/pytorch#113075

Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Differential Revision: D51014944
@facebook-github-bot
Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D51014944

zhxchen17 added a commit to zhxchen17/pytorch that referenced this pull request Nov 7, 2023
Summary:
X-link: pytorch/executorch#1155


Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Test Plan: CI

Differential Revision: D51014944
zhxchen17 added a commit to zhxchen17/executorch-1 that referenced this pull request Nov 7, 2023
Summary:

X-link: pytorch/pytorch#113075

Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Differential Revision: D51014944
@facebook-github-bot
Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D51014944

zhxchen17 added a commit to zhxchen17/executorch-1 that referenced this pull request Nov 7, 2023
Summary:

X-link: pytorch/pytorch#113075

Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Differential Revision: D51014944
@facebook-github-bot
Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D51014944

zhxchen17 added a commit to zhxchen17/executorch-1 that referenced this pull request Nov 7, 2023
Summary:

X-link: pytorch/pytorch#113075

Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Differential Revision: D51014944
@facebook-github-bot
Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D51014944

zhxchen17 added a commit to zhxchen17/executorch-1 that referenced this pull request Nov 7, 2023
Summary:

X-link: pytorch/pytorch#113075

Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Reviewed By: angelayi

Differential Revision: D51014944
@facebook-github-bot
Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D51014944

zhxchen17 added a commit to zhxchen17/executorch-1 that referenced this pull request Nov 7, 2023
Summary:

X-link: pytorch/pytorch#113075

Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Reviewed By: angelayi

Differential Revision: D51014944
@facebook-github-bot
Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D51014944

Summary:
X-link: pytorch/executorch#1155


Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Test Plan: CI

Reviewed By: angelayi

Differential Revision: D51014944
zhxchen17 added a commit to zhxchen17/executorch-1 that referenced this pull request Nov 8, 2023
Summary:

X-link: pytorch/pytorch#113075

Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Reviewed By: angelayi

Differential Revision: D51014944
@facebook-github-bot
Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D51014944

facebook-github-bot pushed a commit to pytorch/executorch that referenced this pull request Nov 8, 2023
Summary:
Pull Request resolved: #1155

X-link: pytorch/pytorch#113075

Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Reviewed By: angelayi

Differential Revision: D51014944

fbshipit-source-id: 9a9e689ec9c8561a9c5cd4b6bd8836809ae5ff30
@facebook-github-bot
Copy link
Copy Markdown
Contributor

@pytorchbot merge -f 'Landed internally'

(Initiating merge automatically since Phabricator Diff has merged, using force because this PR might not pass merge_rules.json but landed internally)

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes). Please use -f as last resort and instead consider -i/--ignore-current to continue the merge ignoring current failures. This will allow currently pending tests to finish and report signal before the merge.

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

mergennachin pushed a commit to mergennachin/executorch-1 that referenced this pull request Nov 9, 2023
Summary: Due to pytorch/pytorch#113075 and pytorch#1155

Differential Revision: D51159878
Skylion007 pushed a commit to Skylion007/pytorch that referenced this pull request Nov 14, 2023
Summary: Turn on verifier check for exportec program ctor. Note that this effectively detect a large surface of spec violations, so we also spend some time fixing them one by one in this diff.

Test Plan: CI

Differential Revision: D51014944

Pull Request resolved: pytorch#113075
Approved by: https://github.com/angelayi
pytorchmergebot pushed a commit that referenced this pull request Dec 15, 2023
Since pytorch 2.1 release we've made some BC breaking changes to the serialized schema. We should update it in time for the 2.2 release. Some of the changes include:

* #114371 - custom class objects / pybinded objects are no longer saved directly to the `ExportedProgram` structure. Instead, the name is serialized inside of the program, and the actual bytes are stored. in a separate location from the exported program, allowing it to be saved to a different location.
* #111204 - `GraphSignature` structure changed and `call_spec` is removed from the `GraphModule` schema
* #111407 - `loss_outout` -> `loss_output`
* #113075 - `example_inputs` removed from the `ExportedProgram` structure (this originally did not store anything), `dialect` added to the `ExportedProgram` structure.
* #113689 - tensor constants are now lifted as inputs to the graph, and their locations are stored in the `GraphSignature`
* #114172 - removed `equality_constraints` and added a `SymExprHint` for all symbolic expressions.
Pull Request resolved: #115712
Approved by: https://github.com/gmagogsfm
angelayi added a commit that referenced this pull request Dec 15, 2023
Since pytorch 2.1 release we've made some BC breaking changes to the serialized schema. We should update it in time for the 2.2 release. Some of the changes include:

* #114371 - custom class objects / pybinded objects are no longer saved directly to the `ExportedProgram` structure. Instead, the name is serialized inside of the program, and the actual bytes are stored. in a separate location from the exported program, allowing it to be saved to a different location.
* #111204 - `GraphSignature` structure changed and `call_spec` is removed from the `GraphModule` schema
* #111407 - `loss_outout` -> `loss_output`
* #113075 - `example_inputs` removed from the `ExportedProgram` structure (this originally did not store anything), `dialect` added to the `ExportedProgram` structure.
* #113689 - tensor constants are now lifted as inputs to the graph, and their locations are stored in the `GraphSignature`
* #114172 - removed `equality_constraints` and added a `SymExprHint` for all symbolic expressions.
Pull Request resolved: #115712
Approved by: https://github.com/gmagogsfm
guilhermeleobas pushed a commit to guilhermeleobas/pytorch that referenced this pull request Dec 18, 2023
Since pytorch 2.1 release we've made some BC breaking changes to the serialized schema. We should update it in time for the 2.2 release. Some of the changes include:

* pytorch#114371 - custom class objects / pybinded objects are no longer saved directly to the `ExportedProgram` structure. Instead, the name is serialized inside of the program, and the actual bytes are stored. in a separate location from the exported program, allowing it to be saved to a different location.
* pytorch#111204 - `GraphSignature` structure changed and `call_spec` is removed from the `GraphModule` schema
* pytorch#111407 - `loss_outout` -> `loss_output`
* pytorch#113075 - `example_inputs` removed from the `ExportedProgram` structure (this originally did not store anything), `dialect` added to the `ExportedProgram` structure.
* pytorch#113689 - tensor constants are now lifted as inputs to the graph, and their locations are stored in the `GraphSignature`
* pytorch#114172 - removed `equality_constraints` and added a `SymExprHint` for all symbolic expressions.
Pull Request resolved: pytorch#115712
Approved by: https://github.com/gmagogsfm
malfet pushed a commit that referenced this pull request Dec 18, 2023
Since pytorch 2.1 release we've made some BC breaking changes to the serialized schema. We should update it in time for the 2.2 release. Some of the changes include:

* #114371 - custom class objects / pybinded objects are no longer saved directly to the `ExportedProgram` structure. Instead, the name is serialized inside of the program, and the actual bytes are stored. in a separate location from the exported program, allowing it to be saved to a different location.
* #111204 - `GraphSignature` structure changed and `call_spec` is removed from the `GraphModule` schema
* #111407 - `loss_outout` -> `loss_output`
* #113075 - `example_inputs` removed from the `ExportedProgram` structure (this originally did not store anything), `dialect` added to the `ExportedProgram` structure.
* #113689 - tensor constants are now lifted as inputs to the graph, and their locations are stored in the `GraphSignature`
* #114172 - removed `equality_constraints` and added a `SymExprHint` for all symbolic expressions.
Pull Request resolved: #115712
Approved by: https://github.com/gmagogsfm
dmenig pushed a commit to dmenig/pytorch that referenced this pull request Dec 21, 2023
Since pytorch 2.1 release we've made some BC breaking changes to the serialized schema. We should update it in time for the 2.2 release. Some of the changes include:

* pytorch#114371 - custom class objects / pybinded objects are no longer saved directly to the `ExportedProgram` structure. Instead, the name is serialized inside of the program, and the actual bytes are stored. in a separate location from the exported program, allowing it to be saved to a different location.
* pytorch#111204 - `GraphSignature` structure changed and `call_spec` is removed from the `GraphModule` schema
* pytorch#111407 - `loss_outout` -> `loss_output`
* pytorch#113075 - `example_inputs` removed from the `ExportedProgram` structure (this originally did not store anything), `dialect` added to the `ExportedProgram` structure.
* pytorch#113689 - tensor constants are now lifted as inputs to the graph, and their locations are stored in the `GraphSignature`
* pytorch#114172 - removed `equality_constraints` and added a `SymExprHint` for all symbolic expressions.
Pull Request resolved: pytorch#115712
Approved by: https://github.com/gmagogsfm
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants