When it’s a brand new AI block, don’t include the Cancel button.

But opening AI on an existing paragraph or other type of block, show Cancel, since you are dismissing the UI and not deleting the block.