* pad_image_tensor

* pad_mask and pad_bounding_box

* resize_{image_tensor, mask, bounding_box}

* center_crop_{image_tensor, mask}

* {five, ten}_crop_image_tensor

* crop_{image_tensor, mask}

* convert_color_space_image_tensor

* affine_{image_tensor, mask, bounding_box}

* rotate_{image_tensor, mask}

* gaussian_blur_image_tensor

* cleanup

* Avoid recommuting the affine matrix in bbox rotate

* Fix linter

* inverted=True for estimating image size

* Update the image size estimation to match the one from the image kernel

* Nits

* Address comments.

* Center=0,0 when expand=true

* Fix windows python 3.8

* Update torchvision/extension.py

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Update torchvision/extension.py

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* close streams in prototype datasets

* refactor prototype SBD to avoid closing demux streams at construction time

* mypy

* add video feature

* add video kernels

* add video testing utils

* add one kernel info

* fix kernel names in Video feature

* use only uint8 for video testing

* require at least 4 dims for Video feature

* add TODO for image_size -> spatial_size

* image -> video in feature constructor

* introduce new combined images and video type

* add video to transform utils

* fix transforms test

* fix auto augment

* cleanup

* address review comments

* add remaining video kernel infos

* add batch dimension squashing to some kernels

* fix tests and kernel infos

* add xfails for arbitrary batch sizes on some kernels

* fix test setup

* fix equalize_image_tensor for multi batch dims

* fix adjust_sharpness_image_tensor for multi batch dims

* address review comments

* replace new_like with wrap_like

* fix videos

* revert casting in favor of ignoring mypy

* Rewrite `get_dimensions`, `get_num_channels` and `get_spatial_size`

* Remove `get_chw`

* Remove comments

* Make `get_spatial_size` support non-image input

* Reduce the unnecessary use of `get_dimensions*`

* Fix linters

* Fix merge bug

* Linter

* Fix linter

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* enable arbitrary batch size for all prototype kernels

* put back perspective dispatcher

* make args and kwargs in ArgsKwargs more accessible

* refactor KernelInfo and DispatcherInfo

* remove ArgsKwargs __getitem__ shortcut again

* Remove performance workaround for mask resize

* Fix linter

* bug fixes

* remove unnecessary import

* Fixing linter

…6724)

* Adding support of Video to missed Transforms and Kernels

* Fixing Grayscale Transform.

* Fixing FiveCrop and TenCrop Transforms.

* Fix Linter

* Fix more kernels.

* Add `five_crop_video` and `ten_crop_video` kernels

* Added a TODO.

* Missed Video isinstance

* nits

* Fix bug on AugMix

* Nits and TODOs.

* Reapply Philip's recommendation

* Fix mypy and JIT

* Fixing test

* Add video support on MixUp and CutMix

* Switch back to roll

* Fix tests and mypy

* Another mypy fix

* Use the variable name sizes instead of scales for consistency

* Add the missing type hints

* Restore the naming back to scales instead of sizes to avoid backwards incompatibility

* Change `image_size` to `spatial_size`

* Fix linter

* Fixing more tests.

* Adding get_num_channels_video and get_spatial_size_* kernels for video, masks and bboxes.

* Refactor get_spatial_size

* Reduce the usage of `query_chw` where possible

* Rename `query_chw` to `query_spatial_size`

* Adding `get_num_frames` dispatcher and kernel.

* Adding jit-scriptability tests

…orch#6741)

* Add seeds on Kernel Info and reduce randomness for Gaussian Blur

* Fix linter

* Increase inactivity timeout for binary build jobs

* Fix binary build steo

* [proto] Small improvement for tensor equalize op

* Fix code formatting

* Added a comment on the ops

* Revert "Add seeds on Kernel Info and reduce randomness for Gaussian Blur (pytorch#6741)"

This reverts commit 6e72f2f.

* add fixture to fix the RNG seed

* re-add changes to gaussian_blur_* sample input shapes

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Removing unnecessary methods/classes.

* Unions instead of ImageOrVideo types

* Fixing JIT issue.

* [proto] Performance improvements for equalize op

* Added tests

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* expand ToDtype to support multiple conversions at once

* simplify

* introduce nearest-exact interpolation

* update prototype tests

* update stable tests

…rch#6503)

* introduce _check method for type checks on prototype transforms

* cleanup

* Update torchvision/prototype/transforms/_geometry.py

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* introduce _check on new transforms

* _check -> _check_inputs

* always check inputs in _RandomApplyTransform

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

…augmentation (pytorch#6770)

* Extend RandomShortestSize to support Video specific flavour of the augmentation

* Adding a test.

* Apply changes from code review

…n `Transform` (pytorch#6773)

* Fix `ToDtype` to avoid errors when a type is not defined.

* Nit `(features.is_simple_tensor, features._Feature)` to `(Tensor,)`

* Fixing linter

* Adding comment.

* Switch back to indexing. Python's default dict seems to have a nasty behaviour.

* [proto] Reduce number of calls of __torch_function__

* Use DisableTorchFunction and super

* Use self._tensor

* Fixes mypy and color space handling

* revert Image.new_like

* WIP

* Perf opt with ref to tensor and properties

* Removed requires_grad property

* Use _tensor ref

* Revert "Use _tensor ref"

This reverts commit 38f8e21.

* Update torchvision/prototype/features/_feature.py

Co-authored-by: Philip Meier <github.pmeier@posteo.de>

Co-authored-by: Philip Meier <github.pmeier@posteo.de>

)

* Use softmax in _get_gaussian_kernel1d

* Revert "Use softmax in _get_gaussian_kernel1d"

This reverts commit eb8fba3.

* Code update

* Relaxed tolerance in consistency tests for GaussianBlur and ElasticTransform

* Code review updates

* Update test_prototype_transforms_consistency.py

* [Nova][WIP] Add Linux CPU Unittests for Torchvision

* use conda-builder image since conda installation is needed

* install torch dep with conda instead

* use circleCI command to run tests

* larger instance to avoid OOM issues

* proper syntax for self-hosted runners

* 4xlarge instance

* 8xlarge

* 12xlarge

* use setup-miniconda job

* add back PATH change to help setup py detect conda

* run conda shell script

* install other deps up front

* git config and undo path change

* revert to local conda install

* conda-builder image

* support for whole python version matrix

* clean up the conda env once we are done with the job

* Add raft_stereo weights

* Update the metrics layout

* fix, ignore, or assert warnings for consistency tests

* fix, ignore, or assert warnings for kernel infos

* fix to_image_tensor for numpy inputs

* make image from numpy contiguous

* fix test

* pin pyav to <10

* pin av in GHA workflows as well

* also pin in M1 workflow

* improve perf on convert_image_dtype and add tests

* add reference tests

* use bitshifts for int to int

* revert bitshifts for int to int upscale

* fix warning ignore

* [Nova] Migrate Linux CPU job to Generic Job

* branch ref for composite action job

* move checkout step to separate job

* added runs-on

* nit fixes

* no need to run conda sheel script thing

* Channel is set inside the script

* add remaining env vars

* nit env var fix

* cleanup

* simplify unneeded jobs

* name of the conda env should be the path

* remove main ref to use PR

* add tensor as optional param

* add init from memory

* fix bug

* fix bug

* first working version

* apply formatting and add tests

* simplify tests

* fix tests

* fix wrong variable name

* add path as optional parameter

* add src as optional

* address pr comments

* Fix warning messages

* address pr comments

* make tests stricter

* Revert "make tests stricter"

This reverts commit 6c92e94.

* WIP

* _blend optim v1

* _blend and color ops optims: v2

* updated a/r tol and configs to make tests pass

* Loose a/r tolerance in AA tests

* Use custom rgb_to_grayscale

* Renamed img -> image

* nit code update

* PR review

* adjust_contrast convert to float32 earlier

* Revert "adjust_contrast convert to float32 earlier"

This reverts commit a82cf8c.

* perf improvements for equalize

Co-authored-by: lezcano <lezcano-93@hotmail.com>

* improve reference tests

* add extensive comments and minor fixes to the kernel

* improve comments

Co-authored-by: lezcano <lezcano-93@hotmail.com>

* [proto][WIP] Enable GPU tests on prototype

* Update prototype-tests.yml

* tests on gpu as separate file

* Removed matrix setup

* Update prototype-tests-gpu.yml

* Update prototype-tests-gpu.yml

* Added --gpus=all flag

* Added xfail for cuda vs cpu tolerance issue

* Update prototype-tests-gpu.yml

* unwrap features before calling the kernels

* revert double unwrapping

* cleanup

* remove debug raise

* more cleanup

* Add PermuteDimensions and TransposeDimensions transforms

* Strip Subclass info.

* Apply changes from code review.

…h#6809)

This reverts commit d0de55d.

* remove copy from convert_color_space

* remove copy from convert_format_bounding_box

* remove .to_* methods from features

* remove unnecessary clones

* add perf todos

* refactor convert_color_space

* lint

* remove another clone

* and another clone

* remove a missed copy

[FBcode->GH]

…ch#6783)

* add KernelInfo

* split dtype and device consistency tests

* add proper support for video

* fix tests and add DispatcherInfo

* add aliases

* cleanup

* fix typo