Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

Fixed

Changed

  • Simplified partitioning datasets by DateTimeEntry

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+------------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev           |
+-----------------------+-------------------+------+-----+------------------+------------------+------------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.157mb -0.02%  | 771.254ms +1.69% | ±0.72% +2677.63% |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.799mb +0.03%   | 344.851ms +0.14% | ±0.34% -39.56%   |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.897mb +0.03%   | 982.821ms -1.62% | ±0.49% -78.96%   |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.603mb +0.00% | 1.154s +0.87%    | ±0.75% +44.99%   |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.666mb +0.01%   | 57.496ms -0.10%  | ±0.42% -5.38%    |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.667mb +0.01%   | 467.317ms -0.09% | ±0.77% +219.29%  |
+-----------------------+-------------------+------+-----+------------------+------------------+------------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.389mb -0.00% | 63.736ms -1.80% | ±0.36% -69.71% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev         |
+--------------------+----------------+------+-----+------------------+------------------+----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.761mb +0.00%  | 452.026ms +0.89% | ±1.03% +65.87% |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.839mb +0.00%  | 71.428ms -5.73%  | ±0.76% -45.32% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.355mb +0.00% | 56.860ms -3.31%  | ±1.75% +63.13% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.565mb +0.00% | 1.246s -3.34%    | ±0.09% -87.68% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.716mb +0.01%  | 40.466ms -5.08%  | ±0.42% -70.68% |
+--------------------+----------------+------+-----+------------------+------------------+----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 116.015mb -0.00% | 392.527ms +0.12% | ±0.98% +60.35%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.734mb -0.00%  | 199.159ms +0.23% | ±0.72% +85.73%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.859mb -0.01%  | 42.114ms -2.20%  | ±1.91% +208.42% |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.407mb +0.00%  | 333.363ms -0.19% | ±0.79% -52.24%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.330mb +0.00%  | 65.325ms -1.63%  | ±0.61% +8.89%   |
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.473mb -0.00%  | 3.982ms -17.08%  | ±1.42% +6.82%   |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.267mb -0.00%  | 185.897ms +1.59% | ±0.16% -82.23%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.792mb -0.00%  | 18.974ms +0.95%  | ±0.28% -79.52%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.713mb -0.00%  | 1.668ms -12.45%  | ±1.05% -42.64%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.713mb -0.00%  | 1.733ms -8.01%   | ±3.35% +211.37% |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.824mb -0.00%  | 2.525ms -10.51%  | ±0.54% -72.31%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.354mb -0.00%  | 14.905ms -2.00%  | ±1.21% +96.86%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.354mb -0.00%  | 14.374ms -6.24%  | ±1.35% +42.81%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.256mb -0.00%  | 1.806μs -5.25%   | ±2.57% +5.45%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.256mb -0.00%  | 0.300μs -25.00%  | ±0.00% -100.00% |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.879mb -0.00%  | 13.284ms -8.73%  | ±2.46% +39.47%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.238mb -0.06% | 63.253ms -2.91%  | ±1.21% +29.57%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.873mb -0.00%  | 1.355ms -18.21%  | ±1.36% -48.83%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 78.149mb +1.37%  | 59.021ms +58.27% | ±1.02% -24.64%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.975mb -0.00%  | 3.923ms -10.27%  | ±1.60% +179.22% |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.403mb -0.00%  | 39.977ms -4.39%  | ±0.25% -79.99%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.404mb -0.00%  | 40.918ms -0.94%  | ±0.73% -46.91%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.403mb -0.00%  | 40.768ms -1.35%  | ±1.26% +13.47%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.699mb -0.00%  | 7.402ms -2.04%   | ±2.15% +71.98%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.256mb -0.00%  | 29.402ms -4.02%  | ±0.74% -69.80%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.256mb -0.00%  | 13.634μs -3.17%  | ±1.51% +26.24%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.256mb -0.00%  | 15.912μs -3.90%  | ±0.59% -60.55%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.268mb -0.00%  | 185.626ms -1.29% | ±0.27% -31.40%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 8e87785 into flow-php:1.x Dec 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant