I override the default color for the form labels.
Then i noticed my custom control label didn't had the same color.
The 'fix' was adding following to my code:

.custom-control-label {
color: $custom-control-label-color;
cursor: pointer;
}

Where the variable had the same color as my form labels.
What i also added was a cursor pointer but that's more of a preference.