Skip to content

[Improvement] Add a similar util method like ThreadUtils.parmap in the Spark #851

@jerqi

Description

@jerqi

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

We usaully use multiple threads to send rpc requests, we should have a method similar to https://github.com/apache/spark/blob/d157b2d9a71c8370612342b298f0e6757c9b9b78/core/src/main/scala/org/apache/spark/util/ThreadUtils.scala#LL388C11-L388C11
Uniffle have similar logic in many places, like
https://github.com/apache/incubator-uniffle/blob/a3ca2585487265cf791d5a0c6f401041eb3f4b55/client/src/main/java/org/apache/uniffle/client/impl/ShuffleWriteClientImpl.java#L744
We can add a method parmap in the ThreadUtil to reduce repeated logic.

How should we improve?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions