We should add a define that allows compilation of trace/debug messages independent of NDEBUG. I'm undecided on whether this should be the default, but we should probably set it in CI for the release images that get pushed. I think this creates too much friction for new people that expect more logging.
@mrice32 not sure if you feel like covering this in the context of the other logging work you are doing.