Rationale to add optional memory format to resize_as_ and resize_ operators is the fact that they are frequently used as inplace empty_like and empty operators inside of our code base. So having them to accept memory format similarly to empty_like and empty seems to be logical.

We could also add two new operators, but it will be more confusing (taking into account that renaming existing operators in not an option).

Stack from ghstack:

• [WIP] Experiments #29461 [WIP] Experiments
• [WIP] Switch default of clone, to, *_like ops #29460 [WIP] Switch default of clone, to, *_like ops
• [WIP] Prepare copy op to switch memory format preservation defaults #29459 [WIP] Prepare copy op to switch memory format preservation defaults
• Adding function to convert Module to channels last #28991 Adding function to convert Module to channels last
• Add torch.memory_format support to the TorchScript #28544 Add torch.memory_format support to the TorchScript
• Add memory format support to the resize_ op. #28292 Add memory format support to the resize_ op.
• TensroIterator preserve format for binary, ternary operators. #28291 TensroIterator preserve format for binary, ternary operators.
• Add channels last support to cuda.comm.scatter and gather #28077 Add channels last support to cuda.comm.scatter and gather
• Kill operator== of TensorOptions as confusing one #28076 Kill operator== of TensorOptions as confusing one
• Add memory format support to resize_as_ operator #27979 Add memory format support to resize_as_ operator

Adds memory_format keyword argument (positional for cpp).

'Preserve' behavior now follows next rules:

1. If tensor is non-overlapping and dense - output tensor will have the same strides as input tensor.
2. If not (1) and tensor is stored in the channels last format, output tensor going to have channels last format.
3. Output tensor is going to be contiguous in all other cases.

Dense tensor is the tensor that store values in a contiguous block of memory.
Non-overlapping tensor is the tensor in which elements occupy individual non-repetitive memory.

Differential Revision: D17980311