As it's possible to custom badge background color for default, danger, and all others. There may be also a variable for text color in each case. By this way, the user can ensure that the contrast ratio between font color and background is all time okay with WCAG requirements.

You can see a proposition here :
Lausselloic@ec75282