Skip to content

mx_formats: move training to the quantize_ API#1970

Merged
vkuzo merged 42 commits into
mainfrom
gh/vkuzo/82/head
Mar 28, 2025
Merged

mx_formats: move training to the quantize_ API#1970
vkuzo merged 42 commits into
mainfrom
gh/vkuzo/82/head

Conversation

@vkuzo

@vkuzo vkuzo commented Mar 26, 2025

Copy link
Copy Markdown
Contributor

Summary:

Moves the MX training code to the quantize_ API, and removes the
custom linear swapping function.

The inference code will be moved in a separate PR, since that will
require splitting the config between training and inference.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

vkuzo added 23 commits March 21, 2025 06:59
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
@vkuzo

vkuzo commented Mar 26, 2025

Copy link
Copy Markdown
Contributor Author

@pytorch-bot

pytorch-bot Bot commented Mar 26, 2025

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/1970

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 26, 2025
vkuzo added a commit that referenced this pull request Mar 26, 2025
Summary:

Moves the MX training code to the `quantize_` API, and removes the
custom linear swapping function.

The inference code will be moved in a separate PR, since that will
require splitting the config between training and inference.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 8ebcac3
ghstack-comment-id: 2755847180
Pull Request resolved: #1970
Comment thread test/prototype/mx_formats/test_mx_linear.py Outdated
vkuzo added 16 commits March 27, 2025 07:23
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
@vkuzo vkuzo added the topic: improvement Use this tag if this PR is an improvement (doesn't fit into any of the other categories) label Mar 28, 2025
vkuzo added 3 commits March 28, 2025 13:00
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
@vkuzo vkuzo changed the base branch from gh/vkuzo/81/head to main March 28, 2025 20:02
@vkuzo vkuzo merged commit ce759d5 into main Mar 28, 2025
liangel-02 pushed a commit that referenced this pull request Aug 25, 2025
* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: improvement Use this tag if this PR is an improvement (doesn't fit into any of the other categories)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants