Skip to content

add dynamo config skip_input_data_check#7913

Merged
JackCaoG merged 3 commits intomasterfrom
JackCaoG/add_dynamo_config_2
Aug 26, 2024
Merged

add dynamo config skip_input_data_check#7913
JackCaoG merged 3 commits intomasterfrom
JackCaoG/add_dynamo_config_2

Conversation

@JackCaoG
Copy link
Copy Markdown
Collaborator

@JackCaoG JackCaoG commented Aug 26, 2024

This is introduce the config skip_input_data_check which will skip an parameter check in dynamo bridge. This code is in the hot path of the dynamo execution and will invoke a pybind + constructuing a boolean array with the same zie of the input parameters.

Enabling this will save us ~0.1ms launch overhead.

@JackCaoG JackCaoG requested a review from lsy323 August 26, 2024 21:39
@JackCaoG JackCaoG marked this pull request as ready for review August 26, 2024 21:39
@JackCaoG JackCaoG requested a review from alanwaketan August 26, 2024 21:40
Comment thread test/run_tests.sh Outdated
run_test "$CDIR/dynamo/test_bridge.py"
run_test "$CDIR/dynamo/test_num_output.py"
run_test "$CDIR/dynamo/test_graph_input_matcher.py"
run_test "$CDIR/dynamo/test_dynamo_config.py"
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: indent

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

opps.. let me fix..

@JackCaoG JackCaoG merged commit 98a9372 into master Aug 26, 2024
@JackCaoG JackCaoG deleted the JackCaoG/add_dynamo_config_2 branch August 26, 2024 23:11
yitongh pushed a commit to AlibabaPAI/xla that referenced this pull request Oct 11, 2024
yitongh pushed a commit to AlibabaPAI/xla that referenced this pull request Dec 11, 2024
yitongh pushed a commit to AlibabaPAI/xla that referenced this pull request Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants