Skip to content

[Dynamic Shape] Adding dynamic shape support for reduce#268

Merged
yaoyaoding merged 9 commits intohidet-org:mainfrom
Aalanli:preliminary-shape-support-v2
Jun 5, 2023
Merged

[Dynamic Shape] Adding dynamic shape support for reduce#268
yaoyaoding merged 9 commits intohidet-org:mainfrom
Aalanli:preliminary-shape-support-v2

Conversation

@Aalanli
Copy link
Copy Markdown
Contributor

@Aalanli Aalanli commented Jun 2, 2023

Dynamic shape support for reduce is required by llama.

However, this introduces Expr into launch_bounds, so I add a check for that case.

Future work:

  • add more tests for dynamic shape
  • add more dynamic shape support for more operators
  • add assert feature in hidet script, as to assert things during kernel launch in compiled kernel, due to dynamic shape (see reduce_fp16.py, which checks that the last dimension is divisible by 2)

Copy link
Copy Markdown
Member

@yaoyaoding yaoyaoding left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @Aalanli!

Overall LGTM, left a few minor comments.

@yaoyaoding yaoyaoding merged commit 9057b7d into hidet-org:main Jun 5, 2023
@Aalanli Aalanli deleted the preliminary-shape-support-v2 branch September 27, 2023 18:09
vadiklyutiy added a commit that referenced this pull request Jul 22, 2024
adaptation for matmul_f16 with fp32 accumulation. 
@yaoyaoding please assign reviewers. Thanks.

---------

Co-authored-by: xiaocenxiaocen <xiao.zhang@centml.ai>
Co-authored-by: vadiklyutiy <156319763+vadiklyutiy@users.noreply.github.com>
vadiklyutiy added a commit that referenced this pull request Jul 23, 2024
adaptation for matmul_f16 with fp32 accumulation. 
@yaoyaoding please assign reviewers. Thanks.

---------

Co-authored-by: xiaocenxiaocen <xiao.zhang@centml.ai>
Co-authored-by: vadiklyutiy <156319763+vadiklyutiy@users.noreply.github.com>
vadiklyutiy added a commit that referenced this pull request Dec 26, 2024
adaptation for matmul_f16 with fp32 accumulation. 
@yaoyaoding please assign reviewers. Thanks.

---------

Co-authored-by: xiaocenxiaocen <xiao.zhang@centml.ai>
Co-authored-by: vadiklyutiy <156319763+vadiklyutiy@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants