Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

Fixed

Changed

  • Updated dependencies

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+------------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev           |
+-----------------------+-------------------+------+-----+------------------+------------------+------------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.159mb -0.01%  | 755.824ms -1.24% | ±1.19% -57.71%   |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.801mb +0.01%   | 345.497ms +1.08% | ±3.13% +2055.92% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.899mb +0.01%   | 990.845ms +1.43% | ±0.29% -11.75%   |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.605mb -0.00% | 1.195s +5.43%    | ±0.77% -35.65%   |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.668mb +0.01%   | 57.029ms +0.04%  | ±0.85% +60.49%   |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.669mb +0.01%   | 474.733ms +1.13% | ±2.83% -13.86%   |
+-----------------------+-------------------+------+-----+------------------+------------------+------------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.391mb +0.00% | 65.482ms +4.28% | ±0.64% -29.92% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev         |
+--------------------+----------------+------+-----+------------------+------------------+----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.763mb +0.00%  | 466.400ms +3.36% | ±0.95% +88.04% |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.841mb +0.00%  | 73.656ms +1.93%  | ±0.48% -80.61% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.357mb +0.00% | 57.496ms +0.23%  | ±0.36% -73.52% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.568mb -0.00% | 1.287s +2.97%    | ±0.14% -35.74% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.718mb +0.00%  | 41.685ms +0.79%  | ±0.45% +56.39% |
+--------------------+----------------+------+-----+------------------+------------------+----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev                       |
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------------------+
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 116.011mb +0.00% | 391.321ms +1.16% | ±0.68% -67.42%               |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.729mb +0.00%  | 197.867ms -1.20% | ±1.34% +3.60%                |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.854mb +0.00%  | 42.811ms +1.60%  | ±1.02% -53.77%               |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.402mb +0.00%  | 334.587ms +0.46% | ±1.62% +86.60%               |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.325mb +0.00%  | 66.004ms +0.07%  | ±0.17% -77.11%               |
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.468mb +0.00%  | 4.174ms +5.76%   | ±1.59% +3.63%                |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.260mb +0.00%  | 180.772ms -0.97% | ±0.18% -82.69%               |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.786mb +0.00%  | 18.158ms +1.83%  | ±0.70% -26.29%               |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.708mb +0.00%  | 1.857ms +3.56%   | ±3.21% -2.38%                |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.708mb +0.00%  | 1.776ms -3.21%   | ±1.93% +299.55%              |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.820mb +0.00%  | 2.757ms +8.23%   | ±1.65% +139.44%              |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.349mb +0.00%  | 15.187ms +3.93%  | ±0.80% +33.98%               |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.349mb +0.00%  | 14.869ms +0.35%  | ±0.82% -64.16%               |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.252mb +0.00%  | 1.900μs +12.16%  | ±0.00% -100.00%              |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.252mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%                 |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.875mb +0.00%  | 13.740ms +7.66%  | ±2.51% +76.96%               |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.168mb +0.00% | 63.633ms +1.00%  | ±2.69% +165.34%              |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.869mb +0.00%  | 1.365ms +7.00%   | ±2.68% +21.28%               |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 78.142mb +0.00%  | 38.646ms +4.53%  | ±0.97% +51.85%               |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.970mb +0.00%  | 3.911ms +1.01%   | ±0.47% -66.12%               |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.397mb +0.00%  | 41.109ms +3.07%  | ±1.65% +178.85%              |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.398mb +0.00%  | 40.502ms -0.34%  | ±1.68% -8.05%                |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.397mb +0.00%  | 40.081ms -1.30%  | ±0.62% -38.05%               |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.695mb +0.00%  | 7.293ms -2.65%   | ±0.69% -68.07%               |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.252mb +0.00%  | 29.853ms +1.58%  | ±1.60% +889.96%              |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.252mb +0.00%  | 13.488μs +1.41%  | ±0.70% +5254862732294700.00% |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.252mb +0.00%  | 16.320μs +2.56%  | ±1.05% +77.32%               |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.262mb +0.00%  | 180.820ms -3.46% | ±0.54% -50.78%               |
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------------------+

@norberttech norberttech merged commit 8864eb7 into flow-php:1.x Dec 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant