You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Aug 2, 2021. It is now read-only.
The http reader is suboptimal since it downloads in syncronous batches translating to range queries for the LazyChunkReader. Previously we optimised for buffersize in this reader, however, this still leaves longer latencies since each batch is blocking until the slowest chunk arrives.
A low hanging fruit to improve is to extend this reader with an asyncronous lookahead that brings concurrent network retrieval across batches and thereby significantly reduce download latencies.
The http reader is suboptimal since it downloads in syncronous batches translating to range queries for the
LazyChunkReader. Previously we optimised for buffersize in this reader, however, this still leaves longer latencies since each batch is blocking until the slowest chunk arrives.A low hanging fruit to improve is to extend this reader with an asyncronous lookahead that brings concurrent network retrieval across batches and thereby significantly reduce download latencies.