Background

Right now, for a mix of technical and social reasons, storage providers are failing to absorb uploads reliably. There are discussions ongoing about how to address this, but its not clear exactly when they will conclude and materialize.

Proposal

1. Smarter clients side logic: I hate to make the client thicker, but perhaps this one intervention won't be too bad. Perhaps, before the upload begins, the app can try to simultaneously connect to all the storage providers assigned to the given bag where the dataobjects are landing, i.e. the bag for their channel, and try to quickly establish which one is most responsive, and which one has decent speed. Not sure if it would even be possible to do like a trial upload of some rubbish payload just to check how they are working? In fact, perhaps such a trial endpoint sort of could be of utility anyway, e.g. for lead/operator to test how well uploads are working. Would be constrained do a very small payload.
2. Error reporting: I assume currently this is not being reported, but being able to send the alert to gateway operator and to some second endpoint, e.g. like lead, could be useful for better analytics powering debugging and performance monitoring.

┆Issue is synchronized with this Asana task by Unito