We currently support decimal points at any point in the duration. In principle, this should only be allowed in the smallest value.

As a side effect, this would make it easier to properly manipulate the milliseconds part of the datetime in arithmetic operations.