Skip to content

Add experiments timings to output data#5108

Merged
vurusovs merged 10 commits intoopenvinotoolkit:masterfrom
alexander-shchepetov:ashchepe/timetests
Apr 12, 2021
Merged

Add experiments timings to output data#5108
vurusovs merged 10 commits intoopenvinotoolkit:masterfrom
alexander-shchepetov:ashchepe/timetests

Conversation

@alexander-shchepetov
Copy link
Copy Markdown
Contributor

@alexander-shchepetov alexander-shchepetov commented Apr 5, 2021

Tickets:

  • *-51330

@alexander-shchepetov alexander-shchepetov added the category: IE Tests OpenVINO Test: plugins and common label Apr 5, 2021
@alexander-shchepetov alexander-shchepetov requested a review from a team April 5, 2021 13:08
Copy link
Copy Markdown
Contributor

@asomsiko asomsiko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 1 of 1 files at r1.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved (waiting on @alexander-shchepetov)

Copy link
Copy Markdown
Contributor

@asomsiko asomsiko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: all files reviewed, 1 unresolved discussion (waiting on @alexander-shchepetov)


tests/time_tests/scripts/run_timetest.py, line 168 at r1 (raw file):

pprint(aggr_stats)

We should keep the std output less verbose and print the only aggregated values. Could we exclude vals from printing here?

@alexander-shchepetov
Copy link
Copy Markdown
Contributor Author

Reviewable status: all files reviewed, 1 unresolved discussion (waiting on @alexander-shchepetov)

tests/time_tests/scripts/run_timetest.py, line 168 at r1 (raw file):

pprint(aggr_stats)

We should keep the std output less verbose and print the only aggregated values. Could we exclude vals from printing here?

Done

@alexander-shchepetov
Copy link
Copy Markdown
Contributor Author

Rebuild

@alexander-shchepetov
Copy link
Copy Markdown
Contributor Author

@vurusovs, @asomsiko, please review again

with open(args.stats_path, "w") as file:
yaml.safe_dump(aggr_stats, file)
logging.info("Aggregated statistics saved to a file: '{}'".format(
logging.info("All statistics saved to a file: '{}'".format(
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

to be reverted

@vurusovs vurusovs merged commit e864972 into openvinotoolkit:master Apr 12, 2021
mryzhov pushed a commit to mryzhov/openvino that referenced this pull request Apr 23, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

category: IE Tests OpenVINO Test: plugins and common

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants