Decrease number of workers for ONNX Model tests to prevent OOM kills#22243
Merged
ababushk merged 2 commits intoopenvinotoolkit:masterfrom Jan 18, 2024
Merged
Conversation
mryzhov
reviewed
Jan 18, 2024
| python3 -m pip install pytest-xdist[psutil] pytest-forked | ||
|
|
||
| - name: ONNX Models Tests | ||
| run: python3 -m pytest --backend="CPU" --model_zoo_dir="${MODELS_SHARE_PATH}" ${INSTALL_TEST_DIR}/onnx/tests/tests_python/test_zoo_models.py -v -n 12 --forked -k 'not _cuda' --model_zoo_xfail |
Contributor
There was a problem hiding this comment.
surprised that it was hardcoded, it should be set to -n auto or -n logical to utilize all the available cpu cores
Contributor
There was a problem hiding this comment.
auto will create as many workers as number of CPU cores, right? Currently, we use 16 cores which is more than hardcoded 12
Contributor
There was a problem hiding this comment.
auto - all physical cores, logical - all logical cores
ilya-lavrenov
approved these changes
Jan 18, 2024
ilya-lavrenov
added a commit
that referenced
this pull request
Jan 19, 2024
* [CI] [GHA] Introduce JS API as a part of the existing workflows (#21898) * add js api to linux * try inside the ov repo * use rel path * use a separate job for js api * correct command formatting * add missing var * use spacing * mv js building * add node installing * add to windows * check pwsh and cmd running npm * add smart CI conditions; disable for win * use node version as env var * extract js job into a separate workflow, add to other *nix * fix input name * Activate js bindings tests for arm64 * upload ov js package * correct formatting * add missing syntax --------- Co-authored-by: Vishniakov Nikolai <nikolai.vishniakov@intel.com> * Cmake Python build option flags should be added to the command in step #3 not step #4. I fixed the typo (#21993) * [CI] [GHA] [JS API] Remove explicit default values settings in Linux ARM64 `cmake` (#22019) * rm explicit default values settings * Activate mac arm64 js api check * Specify test run --------- Co-authored-by: Vishniakov Nikolai <nikolai.vishniakov@intel.com> * [OV JS] Activate validation for mac x86 (#22035) * Extend validation for mac x86 * Remove extra params * fixed broken doc links (#22088) Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com> * [GHA] Update MO deps (#22130) * [GHA] Update MO deps Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com> * Update .github/components.yml --------- Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com> * Avoid DOWNLOAD_EXTRACT_TIMESTAMP warning (#22135) * Avoid DOWNLOAD_EXTRACT_TIMESTAMP warning * Change applying policy condition Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com> --------- Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com> * Fixed API validator search (#22136) * [OV JS] Conditional enabling of JS API (#22139) * Disable js api building for vcpkg * Disable JS API by default * Add disable JS API conditions in features.cmake * Update cmake/features.cmake * Update src/bindings/js/CMakeLists.txt --------- Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com> * Fixed GHSA-h5c8-rqwp-cp95 (#22159) * [PyOV][SAMPLES] Fix bugbear issue B038 (#22183) * Fixed compilation on GHA CI * Decrease number of workers for ONNX Model tests to prevent OOM kills (#22243) * Decrease number of workers for ONNX Model tests to prevent OOM kills * Try to use "-n auto" also --------- Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com> Co-authored-by: Andrei Kashchikhin <andrey.kashchikhin@intel.com> Co-authored-by: Vishniakov Nikolai <nikolai.vishniakov@intel.com> Co-authored-by: fredrickomondi <omondifredrick@gmail.com> Co-authored-by: Santhosh Mamidisetti <92091342+SANTHOSH-MAMIDISETTI@users.noreply.github.com> Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com> Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com> Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com> Co-authored-by: Andrey Babushkin <andrey.babushkin@intel.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Details:
ONNX Model tests are consuming all available RAM on the node assigned, let's reduce number of parallel workers and see if they become any slower
Tickets: