Skip to content

Show better performance improvement in examples/stream/map_reduce.py#2588

Merged
emcastillo merged 1 commit intocupy:masterfrom
leofang:improve_demo
Nov 5, 2019
Merged

Show better performance improvement in examples/stream/map_reduce.py#2588
emcastillo merged 1 commit intocupy:masterfrom
leofang:improve_demo

Conversation

@leofang
Copy link
Copy Markdown
Member

@leofang leofang commented Oct 30, 2019

Closes #1695. Closes #2524.

In #1695 it was reported by @mrocklin that no concurrency was seen in the demo even with multiple streams. In #2524 it was found by @emcastillo that it was simply because the workload was too small. Increasing the workload helps observe stream overlap, see below.

Before this PR:
螢幕快照 2019-10-30 下午1 53 29

With this PR:
螢幕快照 2019-10-30 下午1 49 58

Tested on P100.

@emcastillo emcastillo self-assigned this Oct 31, 2019
Copy link
Copy Markdown
Member

@emcastillo emcastillo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@emcastillo
Copy link
Copy Markdown
Member

Jenkins, test this please

@chainer-ci
Copy link
Copy Markdown
Member

Jenkins CI test (for commit 4f861c2, target branch master) succeeded!

@emcastillo emcastillo added the cat:example Examples label Nov 5, 2019
@emcastillo emcastillo added this to the v7.0.0 milestone Nov 5, 2019
@emcastillo emcastillo added the to-be-backported Pull-requests to be backported to stable branch label Nov 5, 2019
@emcastillo emcastillo merged commit 519900a into cupy:master Nov 5, 2019
emcastillo pushed a commit to emcastillo/cupy that referenced this pull request Nov 5, 2019
Show better performance improvement in `examples/stream/map_reduce.py`
@leofang leofang deleted the improve_demo branch November 5, 2019 02:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cat:example Examples to-be-backported Pull-requests to be backported to stable branch

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Stream in the context-manager form is not used in ElementwiseKernel or ReductionKernel How to get concurrency from cupy Streams

3 participants