Added elasticsearch examples #1384

norberttech · 2025-01-16T17:07:41Z

Change Log

Added

elasticsearch examples

Fixed

Changed

Removed

Deprecated

Security

Description

github-actions · 2025-01-16T17:18:22Z

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak        | mode             | rstdev          |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.758mb +0.03%  | 537.870ms -1.46% | ±0.67% -8.28%   |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.825mb +0.03%  | 1.049s +0.06%    | ±0.11% -79.97%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 86.479mb +0.00% | 906.087ms -4.17% | ±1.26% +110.68% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.491mb +0.03%  | 33.527ms -0.72%  | ±2.52% +609.70% |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.468mb +0.03%  | 601.855ms -0.95% | ±3.47% +423.13% |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+

Transformers

+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 108.486mb +0.00% | 61.138ms -1.84% | ±0.84% -14.35% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+

Loaders

+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.034mb +0.00%  | 103.644ms +0.26% | ±1.63% +219.79% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 76.794mb +0.00%  | 92.779ms -4.51%  | ±1.42% -55.42%  |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 166.977mb +0.00% | 20.711s -9.48%   | ±0.75% +94.62%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.077mb +0.01%  | 30.159ms -5.35%  | ±2.32% +229.14% |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+

Building Blocks

+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 80.251mb +0.00%  | 3.307ms -27.50%  | ±2.82% +225.56% |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 97.529mb +0.00%  | 190.571ms -1.85% | ±1.87% +50.16%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 80.249mb +0.00%  | 18.972ms -2.69%  | ±1.87% +24.68%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 81.126mb +0.00%  | 1.531ms -30.06%  | ±0.59% -81.44%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 81.126mb +0.00%  | 1.510ms -39.02%  | ±2.60% +31.20%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 79.286mb +0.00%  | 3.744ms -22.87%  | ±2.66% -15.41%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 79.815mb +0.00%  | 14.964ms -6.88%  | ±1.09% -19.50%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 79.815mb +0.00%  | 14.973ms -5.48%  | ±0.35% -77.67%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 78.507mb +0.00%  | 1.906μs -4.70%   | ±2.44% +0.00%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 78.507mb +0.00%  | 0.400μs -20.00%  | ±0.00% +0.00%   |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.844mb +0.00%  | 12.571ms -14.14% | ±1.14% -45.82%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 114.191mb +0.00% | 58.932ms -10.28% | ±0.57% -50.08%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 80.335mb +0.00%  | 1.349ms -42.67%  | ±0.30% -86.21%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 83.628mb +0.00%  | 62.461ms -4.92%  | ±0.98% +144.90% |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 81.388mb +0.00%  | 3.703ms -34.79%  | ±2.57% +29.36%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 78.790mb +0.00%  | 42.045ms -8.22%  | ±2.13% +125.87% |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 78.791mb +0.00%  | 42.975ms -8.85%  | ±1.20% +28.59%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 78.790mb +0.00%  | 42.235ms -10.69% | ±1.48% +39.75%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 80.947mb +0.00%  | 8.212ms -9.42%   | ±0.10% -92.39%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 78.697mb +0.00%  | 29.600ms -5.50%  | ±1.04% +2.21%   |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 78.507mb +0.00%  | 14.960μs -8.32%  | ±3.47% +302.25% |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 78.507mb +0.00%  | 16.120μs -17.36% | ±1.06% -69.50%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 97.530mb +0.00%  | 194.224ms -0.82% | ±1.85% +107.63% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 98.642mb +0.00%  | 447.649ms -1.48% | ±0.65% -30.48%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 51.472mb +0.00%  | 225.725ms -0.40% | ±0.68% -37.85%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 13.644mb +0.01%  | 48.903ms -3.27%  | ±0.72% -44.88%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 43.776mb +0.00%  | 363.403ms -1.68% | ±0.47% -14.30%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 11.586mb +0.01%  | 73.941ms -0.86%  | ±0.86% +147.69% |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

codecov · 2025-01-16T19:00:57Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 82.51%. Comparing base (b4d30c6) to head (0ad13c0).
Report is 4 commits behind head on 1.x.

Additional details and impacted files

@@           Coverage Diff           @@
##              1.x    #1384   +/-   ##
=======================================
  Coverage   82.51%   82.51%           
=======================================
  Files         648      648           
  Lines       17395    17395           
=======================================
  Hits        14354    14354           
  Misses       3041     3041

Components	Coverage Δ
etl	`85.82% <ø> (ø)`
cli	`85.17% <ø> (ø)`
lib-array-dot	`94.53% <ø> (ø)`
lib-azure-sdk	`62.56% <ø> (ø)`
lib-doctrine-dbal-bulk	`97.36% <ø> (ø)`
lib-filesystem	`76.23% <ø> (ø)`
lib-parquet	`84.57% <ø> (ø)`
lib-parquet-viewer	`82.02% <ø> (ø)`
lib-rdsl	`87.09% <ø> (ø)`
lib-snappy	`91.16% <ø> (ø)`
bridge-filesystem-async-aws	`90.38% <ø> (ø)`
bridge-filesystem-azure	`89.92% <ø> (ø)`
bridge-monolog-http	`96.38% <ø> (ø)`
symfony-http-foundation	`77.10% <ø> (ø)`
adapter-chartjs	`86.45% <ø> (ø)`
adapter-csv	`89.49% <ø> (ø)`
adapter-doctrine	`90.14% <ø> (ø)`
adapter-elasticsearch	`97.19% <ø> (ø)`
adapter-google-sheet	`78.04% <ø> (ø)`
adapter-http	`59.15% <ø> (ø)`
adapter-json	`92.85% <ø> (ø)`
adapter-logger	`53.84% <ø> (ø)`
adapter-meilisearch	`97.75% <ø> (ø)`
adapter-parquet	`59.88% <ø> (ø)`
adapter-text	`84.44% <ø> (ø)`
adapter-xml	`83.15% <ø> (ø)`

* Update PHPUnit to v11.5.3 * Constructor of TestCase is now final * In PHPUnit11 providers need to be static * In PHPUnit11 providers need to be static * Fix styling * CacheResultFile is removed. See sebastianbergmann/phpunit#4600 * PHPStan complain that readonly properties must be handled inside the constructor * Fix cache issues * Invalidate cache * Remove composer cache * Revert changed environment variable * Call parent to initialise variables * Revert changes in Github Action * Bump symfonycasts/tailwind-bundle from 0.5.3 to 0.6.1 in /web/landing (#1376) Bumps [symfonycasts/tailwind-bundle](https://github.com/SymfonyCasts/tailwind-bundle) from 0.5.3 to 0.6.1. - [Release notes](https://github.com/SymfonyCasts/tailwind-bundle/releases) - [Commits](SymfonyCasts/tailwind-bundle@v0.5.3...v0.6.1) --- updated-dependencies: - dependency-name: symfonycasts/tailwind-bundle dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Updated CHANGELOG.md * Added and/or/andNot/orNot to ScalarFunctionsChain (#1378) * Bump coduo/php-humanizer from 4.0.3 to 5.0.0 in /web/landing (#1373) Bumps [coduo/php-humanizer](https://github.com/coduo/php-humanizer) from 4.0.3 to 5.0.0. - [Release notes](https://github.com/coduo/php-humanizer/releases) - [Changelog](https://github.com/coduo/php-humanizer/blob/5.x/CHANGELOG.md) - [Upgrade guide](https://github.com/coduo/php-humanizer/blob/5.x/UPGRADE.md) - [Commits](coduo/php-humanizer@4.0.3...5.0.0) --- updated-dependencies: - dependency-name: coduo/php-humanizer dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Updated CHANGELOG.md * Fix conflicts * Updated CHANGELOG.md * Bump async-aws/s3 from 2.6.0 to 2.7.0 (#1381) Bumps [async-aws/s3](https://github.com/async-aws/s3) from 2.6.0 to 2.7.0. - [Release notes](https://github.com/async-aws/s3/releases) - [Changelog](https://github.com/async-aws/s3/blob/master/CHANGELOG.md) - [Commits](async-aws/s3@2.6.0...2.7.0) --- updated-dependencies: - dependency-name: async-aws/s3 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Added elasticsearch examples (#1384) * Updated CHANGELOG.md * Fix dependencies * Fix styling * Remove duplicated path --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: aeon-automation <automation-bot@aeon-php.org> Co-authored-by: Norbert Orzechowicz <1921950+norberttech@users.noreply.github.com>

Added elasticsearch examples

0ad13c0

github-actions bot added the size: L label Jan 16, 2025

norberttech merged commit ee5f5fa into flow-php:1.x Jan 16, 2025
20 of 21 checks passed

Bellangelo pushed a commit to Bellangelo/flow that referenced this pull request Jan 16, 2025

Added elasticsearch examples (flow-php#1384)

17133ea

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Added elasticsearch examples #1384

Added elasticsearch examples #1384

Uh oh!

norberttech commented Jan 16, 2025

Uh oh!

github-actions bot commented Jan 16, 2025

Uh oh!

Uh oh!

codecov bot commented Jan 16, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Added elasticsearch examples #1384

Added elasticsearch examples #1384

Uh oh!

Conversation

norberttech commented Jan 16, 2025

Change Log

Added

Fixed

Changed

Removed

Deprecated

Security

Description

Uh oh!

github-actions bot commented Jan 16, 2025

Flow PHP - Benchmarks

Uh oh!

Uh oh!

codecov bot commented Jan 16, 2025

Codecov Report

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant