…nter` options (openvinotoolkit#6663)

* Adds perf counters, and scale factor args

* Adding defined choices for arch type for -a/--arch option

* changing print to logger, frequencies are now global consts

* change to log info formatting

* Fix style issues

* doc: Update inference-engine/ie_bridges/python/sample/speech_sample/README.md

* doc: Update inference-engine/ie_bridges/python/sample/speech_sample/README.md

* doc: Update inference-engine/ie_bridges/python/sample/speech_sample/arg_parser.py

* doc: Update inference-engine/ie_bridges/python/sample/speech_sample/arg_parser.py

Co-authored-by: Koyanagi, Ken <ken.koyanagi@intel.com>
Co-authored-by: Kate Generalova <kate.generalova@intel.com>

* Moved ngraph::Node to ov namespace

* Fixed code style

* Fixed VPU

* Fixed GNA

* Fixed tests

* Added aliases for backward compatibility

* Fix clDNN

* Try to fix build

* Fixed comment

* Renamed RTTI macros

* Moved op utils to ov namespace

* Fixed ngraph library build

* Fixed unit-tests

* Changed src folder

* Fixed recurrent_sequence

* Changed low latency

* Fixed serialize

* Fixed ieFuncTests

* Try to fix windows

* Remove custom operator<< from tests

* Fixed build

* Moved operations from A to ov namespace

* Moved operations from B and C to ov namespace

* Moved operations D-F to ov namespace

* Update ngraph/core/src/op/embeddingbag_offsets_sum.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update ngraph/core/src/op/embeddingbag_packedsum.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Moved ngraph::Node to ov namespace

* Fixed code style

* Fixed VPU

* Fixed GNA

* Fixed tests

* Added aliases for backward compatibility

* Fix clDNN

* Try to fix build

* Fixed comment

* Renamed RTTI macros

* Moved op utils to ov namespace

* Fixed ngraph library build

* Fixed unit-tests

* Changed src folder

* Fixed recurrent_sequence

* Changed low latency

* Fixed serialize

* Fixed ieFuncTests

* Try to fix windows

* Remove custom operator<< from tests

* Fixed build

* Moved operations from A to ov namespace

* Moved operations from B and C to ov namespace

* Moved operations D-F to ov namespace

* Update ngraph/core/src/op/embeddingbag_offsets_sum.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update ngraph/core/src/op/embeddingbag_packedsum.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Fixed RTTI

* Moved operations G-L to ov namespace

* Fixed RTTI

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* fix paths & setup.py install

* fix linter issues

* remove extra spaces

* fix CI issues

* remove extra lines

* fix indent

* Added RandomUniform reference implementation.

* Corrected comments.

* Small correction.

* Code style correction.

* Added has_evaluate() method.

* Added comments, added names to consts.

* Small fix.

* Replaced arrays with vectors.

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Code refactoring.

* Corrected tests, code style.

* Added comment.

* Added comments.

* Temporarily added debug output.

* Temporarily added debug output.

* Removed debug output.

* Added comment.

* Added comment.

* Enabled state saving for RandomUniform.

* Code style.

* Used to template to convert types.

* Added comments.

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Propose new Slice-8 operation

(cherry picked from commit a44ed32)

* Align category

* Update detailed descripiton

* Update Inputs/Outputs description

* Add no attributes info

* Precise range of axis values

* Update descriptions

* More details about negative steps and slicing backwards

* Add more details

* Add examples

* Change step input to Required

* Apply spell check comments

* Add missing commas

* Add separate T_AXIS type for axis input

* Make example data 2D

* Remove duplicated example

* Apply review suggestions

Co-authored-by: Michal Karzynski <michal.karzynski@intel.com>

* Moved operations M-P to ov namespace

* Fixed code style

* Fixed build

* Fixed comments

openvinotoolkit#7214)

* [FrontEnd][PaddlePaddle] fix fill_constant_batch_size_like when attribute str_value be empty.

This happens when export ppyolo with PaddleDetection release/2.2.

* code refactor.

* remove uncertain comments

* Add a warning

* Remove quotes

* Replace outputs with output(s)

* Moved operations M-P to ov namespace

* Fixed code style

* Fixed build

* Fixed comments

* Moved operations R-Z to ov namespace

* Fixed build

* Fixed comments

Co-authored-by: y <ilya.lavrenov@intel.com>

…it#7208)

* initial matcher pass

* write test implementation; + add unit tests

* base

* add unit tests

* code review fixes

* code review fixes

* fix

* fix

* move RemoveSingleInputConcat before opset to legacy conversion

…lkit#5574)

* Reenable AddFakeQuantizeFusion and MulFakeQuantizeFusion

* remove unused variable

* is_single_value simplify

* skip transformations for low precision types

* add comment regarding restriction in AddFakeQuantizeFusion

* remove fp16 test

* remove negative const handling

* CVS-56144 Enable all OMZ scope

* [CVS-55368] Change nets version to v10

* [CVS-55386] Fix some coments

* [CVS-55386] Added float param to LSTM net

* Updated nets

* [CVS-55386] Change to ngraph way

* Merge tools folders

* Fixed docs

* Moved deployment_manager

* Fixed path to benchmark_tool docs

* python_tools -> python_tools_benchmark

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (openvinotoolkit#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (openvinotoolkit#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac5.

* Updated legal info (openvinotoolkit#6409)

# Conflicts:
#	thirdparty/ade

* Cherry-pick 4833c8d

[DOCS]Changed DL WB related docs and tips (openvinotoolkit#6318)

* changed DL WB related docs and tips

* added two tips to benchmark and changed layout

* changed layout

* changed links

* page title added

* changed tips

* ie layout fixed

* updated diagram and hints

* changed tooltip and ref link

* changet tooltip link

* changed DL WB description

* typo fix
# Conflicts:
#	docs/doxygen/ie_docs.xml
#	thirdparty/ade

* Cherry-pick 6405

Feature/azaytsev/mo devguide changes (openvinotoolkit#6405)

* MO devguide edits

* MO devguide edits

* MO devguide edits

* MO devguide edits

* MO devguide edits

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Additional edits

* Additional edits

* Updated the workflow diagram

* Minor fix

* Experimenting with videos

* Updated the workflow diagram

* Removed  Prepare_Trained_Model, changed the title for Config_Model_Optimizer

* Rolled back

* Revert "Rolled back"

This reverts commit 6a4a3e1.

* Revert "Removed  Prepare_Trained_Model, changed the title for Config_Model_Optimizer"

This reverts commit 0810bd5.

* Fixed ie_docs.xml, Removed  Prepare_Trained_Model, changed the title for Config_Model_Optimizer

* Fixed ie_docs.xml

* Minor fix

* <details> tag issue

* <details> tag issue

* Fix <details> tag issue

* Fix <details> tag issue

* Fix <details> tag issue
# Conflicts:
#	thirdparty/ade

* Cherry-pick openvinotoolkit#6419

* [Runtime] INT8 inference documentation update

* [Runtime] INT8 inference documentation: typo was fixed

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Table of Contents was removed

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
# Conflicts:
#	docs/IE_DG/Int8Inference.md
#	thirdparty/ade

* Cherry pick (openvinotoolkit#6437)

* Q2 changes

* Changed Convert_RNNT.md

Co-authored-by: baychub <cbay@yahoo.com>
# Conflicts:
#	docs/IE_DG/Int8Inference.md
#	docs/install_guides/installing-openvino-conda.md
#	docs/install_guides/pypi-openvino-dev.md
#	thirdparty/ade

* Cherry-pick (openvinotoolkit#6447)

* Added benchmark page changes

* Make the picture smaller

* Added Intel® Iris® Xe MAX Graphics

* Changed the TIP about DL WB

* Added Note on the driver for Intel® Iris® Xe MAX Graphics

* Fixed formatting

* Added the link to Intel® software for general purpose GPU capabilities

* OVSA ovsa_get_started updates

* Fixed link
# Conflicts:
#	thirdparty/ade

* Cherry-pick openvinotoolkit#6450

* fix layout

* 4
# Conflicts:
#	thirdparty/ade

* Cherry-pick openvinotoolkit#6466

* Cherry-pick openvinotoolkit#6548

* install docs fixes

* changed video width

* CMake reference added

* fixed table

* added backtics and table formating

* new table changes

* GPU table changes

* added more backtics and changed table format

* gpu table changes

* Update get_started_dl_workbench.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
# Conflicts:
#	thirdparty/ade

* [Runtime] INT8 inference documentation update (openvinotoolkit#6419)

* [Runtime] INT8 inference documentation update

* [Runtime] INT8 inference documentation: typo was fixed

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Table of Contents was removed

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
# Conflicts:
#	docs/IE_DG/Int8Inference.md
#	thirdparty/ade

* Cherry-pick openvinotoolkit#6651

* Edits to MO

Per findings spreadsheet

* macOS changes

per issue spreadsheet

* Fixes from review spreadsheet

Mostly IE_DG fixes

* Consistency changes

* Make doc fixes from last round of review

* Add GSG build-all details

* Fix links to samples and demos pages

* Make MO_DG v2 changes

* Add image view step to classify demo

* Put MO dependency with others

* Edit docs per issues spreadsheet

* Add file to pytorch_specific

* More fixes per spreadsheet

* Prototype sample page

* Add build section

* Update README.md

* Batch download/convert by default

* Add detail to How It Works

* Minor change

* Temporary restored topics

* corrected layout

* Resized

* Added white background into the picture

* fixed link to omz_tools_downloader

* fixed title in the layout

Co-authored-by: baychub <cbay@yahoo.com>
Co-authored-by: baychub <31420038+baychub@users.noreply.github.com>
# Conflicts:
#	docs/doxygen/ie_docs.xml

* Cherry-pick  (openvinotoolkit#6789) [59449][DOCS] GPU table layout change

* changed argument display

* added br tag to more arguments

* changed argument display in GPU table

* changed more arguments

* changed Quantized_ models display
# Conflicts:
#	thirdparty/ade

* Sync doxygen-ignore

* Removed ref to FPGA.md

* Fixed link to ONNX format doc

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Edward Shogulin <edward.shogulin@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>

* move all utils to common folder

* add utils install in CMakeLists.txt

* revert plugin utils

* add log info: test

* add logging info: test

* test imports

* change imports: test

* fix file name

…ersion (openvinotoolkit#7377)

* Refactored code, updated comments and documentation related to TF OD API models pre-processing.

* Improved MO messages related to pre-processor block removal during conversion of the TD OD API models. Remove mean/scale if padding is used and mean/scale is applied before resize

* Updated TF OD API transformation and documentation for SSD models

* Updated comments and documentation for the ObjectDetectionAPIMaskRCNNSigmoidReplacement transformation

* Updated comments and documentation for the ObjectDetectionAPIMaskRCNNROIPoolingSecondReplacement transformation

* Updated comments and documentation for the ObjectDetectionAPIPSROIPoolingReplacement transformation

* Updated comments and documentation for the ObjectDetectionAPIProposalReplacement transformation

* Updated comments and documentation for the ObjectDetectionAPIDetectionOutputReplacement transformation

* Minor code style fixes

* Fixed unit tests for ObjectDetectionAPIPreprocessor2Replacement transformation

* Improved unit test for pipeline.config parser. Fixed very long bug with incorrect test data for the PipelineConfig parser class

* Code style fixes

* Get rid of "coordinates_swap_method" parameter in the JSON configuration file for TF OD API models

* Code style fixes and minor refactoring

* Simplied code related to swapping Proposal coordinates

* Removed incorrectly removed code

* Fixed code review comments about the code comments

…lkit#6882)

… inputs ranges (openvinotoolkit#7305)

* [GNA] Fix scale factors propogation for Eltwise with very different inputs ranges

* [GNA] Added test

* [GNA] Added exception for scale factor <= 0

* [GNA] Disable tests with integer weights

* [GNA] Added assert for CNNLayer in getScaleFactor()

* [GNA] Added check if scale factor is inf

* [GNA] Fixed legacy tests

* Hiding the problem, Validate() changes 'function'

* Template plugin tests

* Undo the changes that are not necessary

* Align code style

* Added \n at end of file

* Removing an unused implementation

* New version with Code Style checking

* Cleaning backend tests

* Reworked the tests the right way

* Removed visit_attributes()

* Removed visit_attributes() in source file

* Added NGRAPH_CHECK macros to evaluate()

* Removed zero_sized_not_equal mention from unit_test.manifest

* Added function name to the constants.py

* Revert "Added function name to the constants.py"

This reverts commit 5b74780.

* Return visit_attributes() for op::v1::NotEqual due to NotEqual being moved to another location

* Changed ov::PartialShape to ov::Shape

* Renamed ngraph::Shape to ov::StaticShape

* Fixed code style

* Fix python API

* Fixed typo

* Fixed test

* Fixed comments

* Fixed tests

* Fixed merge conflicts

* Try to fix build

* Fixed build

* Changed ov::Shape to ngraph::PartialSHape

* Fixed build

* Moved new API to StaticShape and Shape

…ative values (openvinotoolkit#7347)

…nvinotoolkit#7702)

See https://cmake.org/pipermail/cmake/2004-May/005136.html

Signed-off-by: Karol Trzcinski <karolx.trzcinski@intel.com>

* fix convert_reduce_to_pooling transformation

* Fix codestyle

* add/delete spaces

* Fix code style

* fix code style

…toolkit#7570)

* FQDecomposition: added check on unique friendly names after transformation

* NormalizeL2Transformation: added check on unique friendly names after transformation

* ti to sequences conversion: naming fix

* [LPT][TESTS] Check on unique names added to functional tests

* compilation error fix

* compilation error fix

* Init rt info deserialization

* Add RT Info attributes deserialization

* Add RT Info attributes serialization

* Add Serialization and Deserialization tests

* Code style

* Fix AttributeAdapter place

* Extended rt_info section; added support for multi-field attrs; use version for attr serialization/deserialization

* Align attributes and their usage

* Fix LPT

* Add missing #pragma one

* Fix build

* Change version delimiter to have valid xml

* Fix PromitivesPriority

* Fix tests

* Fix test

* Fix IR Reader; remove empty rt_info

* More explicit attribute name and version representation

…it#7720)

* fixed failed to inserting transpose after matmul

* added verifier for matmul

…otoolkit#7754)

It receives space-separated parameter. Currently, only first argument is
received in case of string argument.

* Initial version

* Added 'network' layout to preprocessing info
Moved existing resize tests to template plugin

* Fix clang

* More tests for 'resize' reference implementation + CPU tests + error cases
Coverage is 100%

* Align with new base_reference_test implementation

* Fixed comments

* Add assert to check that desired size is not out of bounds

* CPU: skip failed test

…penvinotoolkit#7710)

* Unify sample_value between max/avg mode

* Fix mkldnn roi_align impl

* Update test

* Revert missing assert

…ing CI. (openvinotoolkit#7757)

Further investigation required. JIRA tracking.

* Expose ngraph_version_string as ngraph.__version__

* Fix linking error on CentOS

* Adds two switches `use_new_frontend` and `use_legacy_frontend` to override defaults.
* Rename ONNX frontend from `onnx_experimental` to `onnx`

* Fixed precisions conversion in new API

* Added tests

* Fixed old IR cases

* Disable FP16

* Fixed regex for CentoOS

* Refactored tests to use new API

* Temp

* Fixed tests

* Moved smart reshape related sources to ngraph

* Added tests for invalid names

* Moved reshape to tensor_names

* clang-format

* Fixed CC build

* Removed IEConv, IEDeconv from primitives pririty

openvinotoolkit#7601)

* Reference implementation for NV12toRGB and NV12toBGR operations
Tests:
- ngraph: visitor + type_prop
- template plugin: reference implementation
- inference-engine: shared tests for plugins
- cpu plugin: compare with ref implementation tests

* Fix clang

* Serialization tests

* Fix clang-format

* Changed 'f32' to 'any supported floating-point type'
Added appropriate shape inference tests
Added error test for >2 inputs
Fixed failed CI tests

* Updates after rebase
+ Try to fix Ninja build

* Fix CI

* Support endianness + potential fix of win32 test fails

* Fix review comment

* Fix review comments

* Fix unit test build

* Fix unit test build #2

* Possible build fix 3

* Simplified reference tests
Observed issue with shuffling Y pixels on little-endian systems, added tests

…e_on_master