Skip to content

Investigate and Optimize Stream Proxy Performance #9187

@tobiu

Description

@tobiu

The Neo.data.proxy.Stream implementation shows significant performance degradation when using small chunk sizes (500 items) compared to large ones (10k items) for a 13.87MB dataset (10s vs 2s).

Objectives:

  1. Instrument src/data/proxy/Stream.mjs with performance.now() to profile the bottleneck.
  2. Analyze the overhead of the timeout(5) delay per chunk.
  3. Analyze the cost of Store.add() and the event chain (data -> load -> grid.render).
  4. Optimize the proxy and store interaction to handle small chunks efficiently or dynamic chunk sizing.

Proposed Changes:

  • Add performance logging to Stream.mjs.
  • Make the timeout configurable or adaptive.
  • Investigate Store's handling of postChunkLoad events.

Metadata

Metadata

Assignees

Labels

aienhancementNew feature or requestperformancePerformance improvements and optimizations

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions