If you pass a url to load a preload from currently it seems it will give up fairly fast on encountering most likely transient http error codes.

Preferably on encountering these codes, exponential backoff should be employed with a configurable maximum wait time (or possibly infinite).

429 - rate limit
504 - gateway timeout
503 - service unavailable
502 - bad gateway

If you don't want to make explicit decisions on which codes to retry, being able to provide it via configuration would be ideal.