Skip to content

[VitisAI] Int4 support #22850

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
jywu-msft merged 1 commit into from
Dec 21, 2024
Merged

[VitisAI] Int4 support #22850

jywu-msft merged 1 commit into from
Dec 21, 2024

Conversation

@BoarQing
Copy link
Contributor

@BoarQing BoarQing commented Nov 15, 2024 •
edited
Loading

Description

  1. Add support for throwing error when hardware is not supported for VitisAI.
  2. Add support for unloading VitisAI EP.
  3. Add API for Win25.

Motivation and Context

This is requirement for Win25

@BoarQing BoarQing changed the title Int4 support [VitisAI] Int4 support Dec 14, 2024
@BoarQing BoarQing marked this pull request as ready for review December 14, 2024 10:53
@BoarQing
Copy link
Contributor Author

BoarQing commented Dec 14, 2024

@jywu-msft I have accumulated a few things due to the slow progress of VitisAI open source. Could you review this? This is required for Win25 Release.

@jywu-msft
Copy link
Member

jywu-msft commented Dec 17, 2024

/azp run Linux CPU CI Pipeline, Linux CPU Minimal Build E2E CI Pipeline, Linux GPU CI Pipeline, Linux GPU TensorRT CI Pipeline, Linux OpenVINO CI Pipeline, MacOS CI Pipeline, ONNX Runtime Web CI Pipeline, onnxruntime-binary-size-checks-ci-pipeline, Linux QNN CI Pipeline

@azure-pipelines
Copy link

azure-pipelines bot commented Dec 17, 2024

Pull request contains merge conflicts.

@jywu-msft
Copy link
Member

jywu-msft commented Dec 17, 2024

/azp run Windows ARM64 QNN CI Pipeline, Windows CPU CI Pipeline, Windows GPU TensorRT CI Pipeline, Windows x64 QNN CI Pipeline, orttraining-linux-ci-pipeline, orttraining-linux-gpu-ci-pipeline

@azure-pipelines
Copy link

azure-pipelines bot commented Dec 17, 2024

Pull request contains merge conflicts.

@jywu-msft
Copy link
Member

jywu-msft commented Dec 17, 2024

/azp run Big Models, Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines
Copy link

azure-pipelines bot commented Dec 17, 2024

Pull request contains merge conflicts.

@BoarQing
Copy link
Contributor Author

BoarQing commented Dec 17, 2024

/azp run Big Models, Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

Hi, I have resolved the conflect.

@jywu-msft
Copy link
Member

jywu-msft commented Dec 17, 2024

/azp run Linux CPU CI Pipeline, Linux CPU Minimal Build E2E CI Pipeline, Linux GPU CI Pipeline, Linux GPU TensorRT CI Pipeline, Linux OpenVINO CI Pipeline, MacOS CI Pipeline, ONNX Runtime Web CI Pipeline, onnxruntime-binary-size-checks-ci-pipeline, Linux QNN CI Pipeline

@jywu-msft
Copy link
Member

jywu-msft commented Dec 17, 2024

/azp run Windows ARM64 QNN CI Pipeline, Windows CPU CI Pipeline, Windows GPU TensorRT CI Pipeline, Windows x64 QNN CI Pipeline, orttraining-linux-ci-pipeline, orttraining-linux-gpu-ci-pipeline

1 similar comment
@jywu-msft
Copy link
Member

jywu-msft commented Dec 17, 2024

/azp run Windows ARM64 QNN CI Pipeline, Windows CPU CI Pipeline, Windows GPU TensorRT CI Pipeline, Windows x64 QNN CI Pipeline, orttraining-linux-ci-pipeline, orttraining-linux-gpu-ci-pipeline

@azure-pipelines
Copy link

azure-pipelines bot commented Dec 17, 2024

Azure Pipelines successfully started running 4 pipeline(s).

1 similar comment
@azure-pipelines
Copy link

azure-pipelines bot commented Dec 17, 2024

Azure Pipelines successfully started running 4 pipeline(s).

@azure-pipelines
Copy link

azure-pipelines bot commented Dec 17, 2024

Azure Pipelines successfully started running 9 pipeline(s).

@jywu-msft
Copy link
Member

jywu-msft commented Dec 18, 2024

@BoarQing please fix lint error https://github.com/microsoft/onnxruntime/actions/runs/12369885814/job/34542672292?pr=22850

@BoarQing
Copy link
Contributor Author

BoarQing commented Dec 18, 2024

@BoarQing please fix lint error https://github.com/microsoft/onnxruntime/actions/runs/12369885814/job/34542672292?pr=22850

Hi, I wasn't aware of the lint update that caused the lint error. I am sorry about it. The lint issue is resolved now.

@jywu-msft
Copy link
Member

jywu-msft commented Dec 18, 2024

/azp run Linux CPU CI Pipeline, Linux CPU Minimal Build E2E CI Pipeline, Linux GPU CI Pipeline, Linux GPU TensorRT CI Pipeline, Linux OpenVINO CI Pipeline, MacOS CI Pipeline, ONNX Runtime Web CI Pipeline, onnxruntime-binary-size-checks-ci-pipeline, Linux QNN CI Pipeline

@jywu-msft
Copy link
Member

jywu-msft commented Dec 18, 2024

/azp run Windows ARM64 QNN CI Pipeline, Windows CPU CI Pipeline, Windows GPU TensorRT CI Pipeline, Windows x64 QNN CI Pipeline, orttraining-linux-ci-pipeline, orttraining-linux-gpu-ci-pipeline

@jywu-msft
Copy link
Member

jywu-msft commented Dec 18, 2024

/azp run Big Models, Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines
Copy link

azure-pipelines bot commented Dec 18, 2024

Azure Pipelines successfully started running 4 pipeline(s).

@azure-pipelines
Copy link

azure-pipelines bot commented Dec 18, 2024

Azure Pipelines successfully started running 9 pipeline(s).

@azure-pipelines
Copy link

azure-pipelines bot commented Dec 18, 2024

Azure Pipelines successfully started running 5 pipeline(s).

@BoarQing
Copy link
Contributor Author

BoarQing commented Dec 20, 2024

/azp run Big Models, Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

Hi, the pipeline is finished. Could you review it when you have the time?

@jywu-msft jywu-msft merged commit ebdbbb7 into microsoft:main Dec 21, 2024
75 checks passed
tarekziade pushed a commit to tarekziade/onnxruntime that referenced this pull request Jan 10, 2025
@BoarQing @tarekziade
[VitisAI] Int4 support (microsoft#22850)
e16a24e 
### Description
<!-- Describe your changes. -->
1. Add support for throwing error when hardware is not supported for
VitisAI.
2. Add support for unloading VitisAI EP.
3. Add API for Win25.

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
This is requirement for Win25
@BoarQing BoarQing deleted the int4_support branch January 21, 2025 07:14
ashrit-ms pushed a commit that referenced this pull request Mar 17, 2025
@BoarQing @ashrit-ms
[VitisAI] Int4 support (#22850)
13b074c 
### Description
<!-- Describe your changes. -->
1. Add support for throwing error when hardware is not supported for
VitisAI.
2. Add support for unloading VitisAI EP.
3. Add API for Win25.

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
This is requirement for Win25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jywu-msft jywu-msft jywu-msft approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@BoarQing @jywu-msft