That sounds more like it’s a surrounding element. This will probably be predetermined by your theme, which is why you can’t customise it so easily.
Have a look at the files of your theme. The element is probably in one of these files. To customise the file, you need a child theme and would have to overload the file there. See: https://developer.wordpress.org/themes/advanced-topics/child-themes/
This is coming from wp-includes folder block-template.php.
To this code. It is fixed here: https://github.com/WordPress/WordPress/blob/master/wp-includes/block-template.php#L273 – so you cannot change it at this point.
In this case, you could just take the sledgehammer and cache the entire output and adapt the code to your needs before outputting it. The first answer here could be helpful: https://stackoverflow.com/questions/74210751/woocommerce-how-to-change-chunks-of-text-in-the-final-html
If, however, you would like to make a change to the core file for future versions, create a ticket in the core for the developers here: https://core.trac.wordpress.org/newticket
