This issue is tracking the deprecation of the (1) configs (2) model checkpoints quantized with these configs.
What is deprecated:
Timeline:
0.14.0: annouce deprecation for version 1 config
after all tensors are migrated: remove support for version 1 config
after pytorch 2.11 release: remove support for version 1 checkpoints
This issue is tracking the deprecation of the (1) configs (2) model checkpoints quantized with these configs.
What is deprecated:
Int4WeightOnlyConfigversion to 2 #2949, the version 1 config is now deprecated, please use version 2 config to quantize the modelTimeline:
0.14.0: annouce deprecation for version 1 config
after all tensors are migrated: remove support for version 1 config
after pytorch 2.11 release: remove support for version 1 checkpoints