Refs: #240024 and #240027

• anyOS @sbatten
• anyOS @rzhao271
• anyOS @alexdima

Complexity: 2

Create Issue

This iteration includes many improvements to vision in chat. One of these includes the omission warning for files that are generally not valid in chat. This includes SVG, PDFs, MOVs, MP4s, MP3s, etc - anything that is not a "text document". This warning will be shown in the chat input and also in the chat context attachments after submitting.
 

Sanity testing section

1. Attach some files that might not be valid. Examples include SVG, PDFs, MOVs, MP4s, MP3s, or any non-supported image type (HEIC, CR2, etc).
2. Note that there should be warnings and hovering over it will show a warning reason.
3. After submitting, warnings should also be shown.
4. Note that in the case of attaching files that CAN be attached, sometimes they will be limited by context window limitations if they are too large (ie, an extension data MD file like below) and the attachment will not be crossed out or show a warning until after submitting.
5. Try attaching an image that is over 30mb. There should be a notification that the image was too large to be processed.
6. History for images should also work in this scenario!

extensionData_2025-02-23_22-24-25.md

General notes

1. Feel free to try a bunch of differnt file types and see what is expected or not expected!
2. Remember that for now, images only work in GPT4o for regular users (Claude and Gemini should work for dual accessed).