-
-
Notifications
You must be signed in to change notification settings - Fork 202
Investigate and Optimize Stream Proxy Performance #9187
Copy link
Copy link
Closed
Labels
aienhancementNew feature or requestNew feature or requestperformancePerformance improvements and optimizationsPerformance improvements and optimizations
Description
The Neo.data.proxy.Stream implementation shows significant performance degradation when using small chunk sizes (500 items) compared to large ones (10k items) for a 13.87MB dataset (10s vs 2s).
Objectives:
- Instrument
src/data/proxy/Stream.mjswithperformance.now()to profile the bottleneck. - Analyze the overhead of the
timeout(5)delay per chunk. - Analyze the cost of
Store.add()and the event chain (data->load->grid.render). - Optimize the proxy and store interaction to handle small chunks efficiently or dynamic chunk sizing.
Proposed Changes:
- Add performance logging to
Stream.mjs. - Make the
timeoutconfigurable or adaptive. - Investigate
Store's handling ofpostChunkLoadevents.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
aienhancementNew feature or requestNew feature or requestperformancePerformance improvements and optimizationsPerformance improvements and optimizations