Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

Fixed

Changed

  • Updated infection configuration to focus it at core only

Removed

Deprecated

Security


Description

Since Adapters/Bridges in most cases are tested with integration tests anyway I removed them from infection testsuite in order to focus it only at Unit Tests of core building blocks.

There is still some space for improvement, especially around excluding Parquet Binary reading/writing/thrift files from it.

I also added HTML report to simplify debugging what's still missing.

@github-actions
Copy link
Contributor

github-actions bot commented Dec 29, 2024

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak        | mode             | rstdev          |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.715mb +0.01%  | 517.993ms -0.12% | ±0.34% -20.35%  |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.819mb +0.01%  | 1.107s -1.14%    | ±0.58% -81.97%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 86.465mb +0.00% | 910.281ms -0.60% | ±0.31% +83.63%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.448mb +0.01%  | 33.642ms -0.34%  | ±1.00% +20.77%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.424mb +0.01%  | 667.334ms +0.02% | ±1.85% +150.01% |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+---------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev        |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+---------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 114.445mb +0.00% | 61.122ms -1.22% | ±0.88% +9.75% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+---------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 55.188mb +0.00%  | 112.696ms -2.03% | ±2.90% +271.23% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 85.655mb +0.00%  | 102.578ms -0.24% | ±2.04% +288.93% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 167.441mb +0.00% | 19.179s +0.08%   | ±0.03% -88.33%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.273mb +0.00%  | 44.039ms -0.40%  | ±0.27% -36.94%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 85.501mb +0.00%  | 3.133ms +2.36%   | ±1.87% +36.96%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 102.771mb +0.00% | 186.207ms +0.38% | ±0.54% +34.85%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 85.491mb +0.00%  | 18.502ms -1.23%  | ±0.22% -87.32%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 86.376mb +0.00%  | 1.429ms -1.65%   | ±2.65% +117.42% |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 86.376mb +0.00%  | 1.342ms -8.32%   | ±2.23% -8.36%   |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 84.537mb +0.00%  | 2.290ms -2.29%   | ±0.51% -57.20%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 85.066mb +0.00%  | 15.290ms +0.64%  | ±1.54% +255.06% |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 85.066mb +0.00%  | 14.906ms -3.06%  | ±0.63% -7.64%   |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 83.757mb +0.00%  | 1.794μs +5.15%   | ±2.67% -1.89%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 83.757mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 92.335mb +0.00%  | 12.786ms -1.33%  | ±1.25% +315.80% |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 120.642mb +0.00% | 59.385ms -2.98%  | ±0.63% -23.44%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 85.586mb +0.00%  | 1.155ms -11.40%  | ±2.83% -20.96%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 88.874mb +0.00%  | 58.966ms -2.60%  | ±1.91% -12.12%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 86.638mb +0.00%  | 3.431ms -1.89%   | ±0.48% -70.93%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 84.032mb +0.00%  | 40.981ms +2.57%  | ±0.89% +162.26% |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 84.033mb +0.00%  | 41.408ms +2.88%  | ±0.61% +91.08%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 84.032mb +0.00%  | 40.371ms +0.10%  | ±0.83% -57.18%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 86.198mb +0.00%  | 7.643ms -2.19%   | ±0.50% -65.03%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 83.947mb +0.00%  | 29.858ms -0.62%  | ±0.61% -54.27%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 83.757mb +0.00%  | 12.666μs -2.83%  | ±1.61% -49.03%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 83.757mb +0.00%  | 14.900μs -1.87%  | ±0.00% -100.00% |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 102.776mb +0.00% | 190.890ms +0.38% | ±0.60% +20.43%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 50.656mb +0.00%  | 398.931ms -0.00% | ±0.20% +15.04%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 13.071mb +0.00%  | 81.251ms +0.72%  | ±0.46% -29.53%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 105.913mb +0.00% | 481.563ms -0.53% | ±0.19% -16.14%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 55.104mb +0.00%  | 240.692ms -1.17% | ±0.89% +486.07% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.626mb +0.00%  | 51.427ms -1.82%  | ±0.43% -41.06%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@codecov
Copy link

codecov bot commented Dec 29, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Please upload report for BASE (1.x@9bd9d51). Learn more about missing BASE report.
Report is 2 commits behind head on 1.x.

Additional details and impacted files
@@          Coverage Diff           @@
##             1.x    #1302   +/-   ##
======================================
  Coverage       ?   80.81%           
======================================
  Files          ?      583           
  Lines          ?    16037           
  Branches       ?        0           
======================================
  Hits           ?    12961           
  Misses         ?     3076           
  Partials       ?        0           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@norberttech norberttech merged commit 7fdbdea into flow-php:1.x Dec 29, 2024
22 checks passed
@norberttech
Copy link
Member Author

Related to #1286

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant