Skip to content

Continue #70105: Reduce port header memcpy#83381

Merged
Algunenano merged 4 commits intoClickHouse:masterfrom
Algunenano:reduce_port_header_memcpy
Jul 10, 2025
Merged

Continue #70105: Reduce port header memcpy#83381
Algunenano merged 4 commits intoClickHouse:masterfrom
Algunenano:reduce_port_header_memcpy

Conversation

@Algunenano
Copy link
Copy Markdown
Member

Changelog category (leave one):

  • Performance Improvement

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Minimize memory copy in port headers during pipeline construction. Original PR by heymind

Documentation entry for user-facing changes

  • Documentation is written (mandatory for new features)

@clickhouse-gh
Copy link
Copy Markdown
Contributor

clickhouse-gh bot commented Jul 7, 2025

Workflow [PR], commit [9751702]

Summary:

job_name test_name status info comment
Build (fuzzers) error
Integration tests (release, 1/4) failure
test_cluster_discovery/test_password.py::test_connect_with_password FAIL
Integration tests (aarch64, distributed plan, 1/4) failure
test_memory_limit/test.py::test_multiple_queries FAIL

@Algunenano Algunenano self-assigned this Jul 7, 2025
@clickhouse-gh clickhouse-gh bot added the pr-performance Pull request with some performance improvements label Jul 7, 2025
@Algunenano
Copy link
Copy Markdown
Member Author

The change makes sense and would avoid excessive copy of headers in pipeline generation (specially noticeable with large pipelines). I'll try to extend it to the full pipeline

@Algunenano
Copy link
Copy Markdown
Member Author

I'll try to extend it to the full pipeline

I underestimated how many changes this requires. I'll move it to a different, massive, PR

The performance tests are so unstable that's impossible to determine anything. The only test I see has slowed down in both ARM and x86 is merge_tree_many_partitions and it's a bad test (creates many partitions, but does not block merges). I'll check just to confirm.

@Algunenano
Copy link
Copy Markdown
Member Author

Multiple CI issues already fixed in master. Merging master to confirm it's clean

@Algunenano
Copy link
Copy Markdown
Member Author

@Algunenano Algunenano added this pull request to the merge queue Jul 10, 2025
Merged via the queue into ClickHouse:master with commit 97aa10b Jul 10, 2025
117 of 123 checks passed
@Algunenano Algunenano deleted the reduce_port_header_memcpy branch July 10, 2025 18:52
@robot-clickhouse-ci-1 robot-clickhouse-ci-1 added the pr-synced-to-cloud The PR is synced to the cloud repo label Jul 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-performance Pull request with some performance improvements pr-synced-to-cloud The PR is synced to the cloud repo

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants