Skip to content

feat: add trtllm all-reduce fusion#1131

Merged
yzh119 merged 16 commits intoflashinfer-ai:mainfrom
yyihuang:trtllm-ar
Jun 19, 2025
Merged

feat: add trtllm all-reduce fusion#1131
yzh119 merged 16 commits intoflashinfer-ai:mainfrom
yyihuang:trtllm-ar

Conversation

@yyihuang
Copy link
Copy Markdown
Collaborator

@yyihuang yyihuang commented Jun 9, 2025

📌 Description

Add all reduce fusion kernels from trt-llm.

🔍 Related Issues

🚀 Pull Request Checklist

Thank you for contributing to FlashInfer! Before we review your pull request, please make sure the following items are complete.

✅ Pre-commit Checks

  • I have installed pre-commit by running pip install pre-commit (or used your preferred method).
  • I have installed the hooks with pre-commit install.
  • I have run the hooks manually with pre-commit run --all-files and fixed any reported issues.

If you are unsure about how to set up pre-commit, see the pre-commit documentation.

🧪 Tests

  • Tests have been added or updated as needed.
  • All tests are passing (unittest, etc.).

Reviewer Notes

@yyihuang yyihuang marked this pull request as ready for review June 18, 2025 22:04
@yyihuang yyihuang requested a review from yzh119 June 18, 2025 22:05
Comment thread include/flashinfer/comm/trtllm_allreduce_fusion.cuh Outdated
Copy link
Copy Markdown
Collaborator

@yzh119 yzh119 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for the contribution!

@yzh119 yzh119 merged commit 28d0843 into flashinfer-ai:main Jun 19, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants