-
Notifications
You must be signed in to change notification settings - Fork 3.7k
Add logging macros for KleidiAI and fix todos from previous PR #26146
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: Orlaith Monahan <orlaith.monahan@arm.com>
|
@microsoft-github-policy-service agree company="Arm" |
onnxruntime/contrib_ops/cpu/quantization/dynamic_quantize_matmul.cc
Outdated
Show resolved
Hide resolved
…ul.cc Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
|
Can you please resolve the conflicts ? |
onnxruntime/contrib_ops/cpu/quantization/dynamic_quantize_matmul.cc
Outdated
Show resolved
Hide resolved
Handle cases where NumDimensions for dynamic_quantize_matmul are less than 2
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
Remove redundant checks for SVE
Cover all permutations of 2d tensors for dynamic_quantize_matmul
Lint changes to comment spaces
Lint runner change to if/else formatting
Rename logging macros defines to be clearer Signed-off-by: Orlaith Monahan <orlaith.monahan@arm.com>
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
Adjust else statement to be in line with lintrunner expectations
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
More lintrunner tweaks
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
|
LGTM. @edgchen1 - Do you have any additional comments ? |
|
The build failures seem unrelated to this PR. Might be something else going on. |
Remove no longer needed comment
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
* Actually add in the changes to logging to include file and line in the output * Move the logic for enabling logging to be within onnxruntime_USE_KLEIDIAI Signed-off-by: Orlaith Monahan <orlaith.monahan@arm.com>
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
Signed-off-by: Orlaith Monahan <orlaith.monahan@arm.com>
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
Signed-off-by: Orlaith Monahan <orlaith.monahan@arm.com>
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
…soft#26146) ### Key changes This patch contains logging macros for the KleidiAI kernels It also contains changes / todos from a previous PR: microsoft#25187 --------- Signed-off-by: Orlaith Monahan <orlaith.monahan@arm.com> Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
Key changes
This patch contains logging macros for the KleidiAI kernels
It also contains changes / todos from a previous PR:
#25187