Skip to content

Conversation

@PragTob
Copy link
Member

@PragTob PragTob commented Dec 19, 2023

This reverts commit dfa6987.

It turned out that the parallel processing wasn't the issue
with memory consumption we faced but instead copying data
to processes.

See:
* #408
* #414
* https://pragtob.wordpress.com/2023/12/18/careful-what-data-you-send-or-how-to-tank-your-performance-with-task-async/
PragTob added a commit to bencheeorg/benchee_html that referenced this pull request Dec 19, 2023
Turned out, that really wasn't our biggest problem - it worked
by accident as it was used as a "function formatter" and hence
did not launch in its own separate process and hence did not
cause the memory copying problem.

See: bencheeorg/benchee#415
PragTob added a commit that referenced this pull request Dec 19, 2023
So #415 is failing and it shouldn't, see:

https://github.com/bencheeorg/benchee/actions/runs/7259274594/job/19776364305?pr=415

Error is weird/missing cache or something?

> :dialyzer.run error: File not found: /opt/hostedtoolcache/otp/ubuntu-20.04/OTP-24.3.4.14/x64/lib/dialyzer-4.4.4.1/ebin/erl_bif_types.beam

See if it's also happening here!
@PragTob PragTob merged commit 2409a89 into main Dec 19, 2023
@PragTob PragTob deleted the remove-sequential-output branch December 19, 2023 09:11
PragTob added a commit to bencheeorg/benchee_html that referenced this pull request Dec 19, 2023
Turned out, that really wasn't our biggest problem - it worked
by accident as it was used as a "function formatter" and hence
did not launch in its own separate process and hence did not
cause the memory copying problem.

See: bencheeorg/benchee#415
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants