This doesn't change yaml files, only changes on dev.azure.com.

I'm not sure if this will work as intended, but I tested on a small repo, and it seems to work?

The check is required and it's not showing the "Use your administrator privileges to merge this pull request without waiting for requirements to be met." message.

@jaredpar Would you be able to test this and see if it works?