[Experimental] Support AMD GPU via HIP (ROCm2.7.0+) by okuta · Pull Request #1094 · cupy/cupy

okuta · 2018-04-04T08:31:26Z

I want to support AMD GPU environment via HIP.
This PR is related to #1117 .

Step 1: Install ROCm 2.7.0+

Please read this document
And, please install hipblas and rocrand.

sudo apt install hipblas hipsparse rocrand

Step 2: Set environment variables

export HCC_AMDGPU_TARGET=gfx900

export ROCM_HOME=/opt/rocm
export CUPY_INSTALL_USE_HIP=1

And, please set PATH.

export PATH=$ROCM_HOME/bin:$PATH

Step3: Install CuPy

python setup.py install

or

python setup.py develop

Feature

jedwards-AMD · 2018-09-21T20:57:18Z

I am trying to use this pull request, but I am getting the following install error when using 'python setup.py install':
,
,
,
.
running install_lib
running build_py
running build_ext
Traceback (most recent call last):
File "setup.py", line 122, in
'sdist': sdist},
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/init.py", line 140, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/usr/lib/python2.7/distutils/command/install_lib.py", line 111, in build
self.run_command('build_ext')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/git/cupy/cupy_setup_build.py", line 815, in run
check_extensions(self.extensions)
File "/home/user1/git/cupy/cupy_setup_build.py", line 619, in check_extensions
'''.format(f, required_cython_version))
RuntimeError: Missing file: cupy/core/_dtype.cpp
Please install Cythrunning install_lib
running build_py
running build_ext
Traceback (most recent call last):
File "setup.py", line 122, in
'sdist': sdist},
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/init.py", line 140, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/usr/lib/python2.7/distutils/command/install_lib.py", line 111, in build
self.run_command('build_ext')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/git/cupy/cupy_setup_build.py", line 815, in run
check_extensions(self.extensions)
File "/home/user1/git/cupy/cupy_setup_build.py", line 619, in check_extensions
'''.format(f, required_cython_version))
RuntimeError: Misrunning install_lib
running build_py
running build_ext
Traceback (most recent call last):
File "setup.py", line 122, in
'sdist': sdist},
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/init.py", line 140, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/usr/lib/python2.7/distutils/command/install_lib.py", line 111, in build
self.run_command('build_ext')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/git/cupy/cupy_setup_build.py", line 815, in run
check_extensions(self.extensions)
File "/home/user1/git/cupy/cupy_setup_build.py", line 619, in check_extensions
'''.format(f, required_cython_version))
RuntimeError: running install_lib
running build_py
running build_ext
Traceback (most recent call last):
File "setup.py", line 122, in
'sdist': sdist},
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/init.py", line 140, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/usr/lib/python2.7/distutils/command/install_lib.py", line 111, in build
self.run_command('build_ext')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/git/cupy/cupy_setup_build.py", line 815, in run
check_extensions(self.extensions)
File "/home/user1/git/cupy/cupy_setup_build.py", line 619, in check_extensions
'''.running install_lib
running build_py
running build_ext
Traceback (most recent call last):
File "setup.py", line 122, in
'sdist': sdist},
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/init.py", line 140, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/.local/lib/python2.7/site-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/usr/lib/python2.7/distutils/command/install_lib.py", line 111, in build
self.run_command('build_ext')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/user1/git/cupy/cupy_setup_build.py", line 815, in run
check_extensions(self.extensions)
File "/home/user1/git/cupy/cupy_setup_build.py", line 619, in check_extensions
'''.format(f, required_cython_version))
RuntimeError: Missing file: cupy/core/_dtype.cpp
Please install Cython 0.28.0 or later. Please also check the version of Cython.
See https://docs-cupy.chainer.org/en/stable/install.html for details.format(f, required_cython_version))
RuntimeError: Missing file: cupy/core/_dtype.cpp
Please install Cython 0.28.0 or later. Please also check the version of Cython.
See https://docs-cupy.chainer.org/en/stable/install.html for details.Missing file: cupy/core/_dtype.cpp
Please install Cython 0.28.0 or later. Please also check the version of Cython.
See https://docs-cupy.chainer.org/en/stable/install.html for details.sing file: cupy/core/_dtype.cpp
Please install Cython 0.28.0 or later. Please also check the version of Cython.
See https://docs-cupy.chainer.org/en/stable/install.html for details.on 0.28.0 or later. Please also check the version of Cython.
See https://docs-cupy.chainer.org/en/stable/install.html for details.
.
Is Cython 0.28 really needed? I have 0.23 installed on the system, and Cython 0.28 is post 18.04.

okuta · 2019-08-15T12:25:30Z

/test

pfn-ci-bot · 2019-08-15T12:25:33Z

Successfully created a job for commit 87bccb2:

Dashboard for commit 87bccb2

okuta · 2019-08-15T12:39:50Z

/test

pfn-ci-bot · 2019-08-15T12:39:52Z

Successfully created a job for commit 87bccb2:

Dashboard for commit 87bccb2

mitmul · 2019-09-04T02:11:50Z

/test

pfn-ci-bot · 2019-09-04T02:11:54Z

Successfully created a job for commit 87bccb2:

Dashboard for commit 87bccb2

mitmul

Just revising the document part. I will see the other part later.

docs/source/install_rocm.rst

Fix document Co-Authored-By: Shunta Saito <shunta.saito@gmail.com>

mitmul · 2019-09-11T05:22:05Z

/test

pfn-ci-bot · 2019-09-11T05:22:09Z

Successfully created a job for commit 89fc5ac:

Dashboard for commit 89fc5ac

mitmul · 2019-09-11T05:25:56Z

I discussed with @okuta offline and we concluded that this PR will be merged soon after confirming there's no critical issue in the current source and it can successfully be compiled. Then with other PRs, we'll add more tests for checking the calculation results using this feature and add more features like functions for sort/argsort etc.

okuta · 2019-09-18T02:06:19Z

/test

pfn-ci-bot · 2019-09-18T02:06:22Z

Successfully created a job for commit 6508fea:

Dashboard for commit 6508fea

mitmul · 2019-09-18T03:21:16Z

All tests have succeeded.

okuta · 2019-10-02T02:57:41Z

Thank you very much!

avimanyu786 · 2019-11-21T09:49:50Z

Thank you so much for implementing this in v7.0.0rc1! Greatly appreciated!

okuta added the cat:feature New features/APIs label Apr 4, 2018

okuta force-pushed the support-hip branch 2 times, most recently from 06f68ce to 65ff9cc Compare April 4, 2018 17:53

okuta changed the title ~~Support AMD GPU via HIP~~ [WIP] Support AMD GPU via HIP Apr 9, 2018

This was referenced Apr 9, 2018

Use fmin and fmax for HIP environment #1116

Merged

Support HIP #1117

Closed

okuta added the st:blocked-by-another-pr Blocked by another pull-request label Apr 9, 2018

okuta force-pushed the support-hip branch 5 times, most recently from 2e598b0 to 441304b Compare April 16, 2018 10:02

okuta force-pushed the support-hip branch from 1a85568 to e3b4ee2 Compare July 1, 2018 16:24

okuta changed the title ~~[WIP] Support AMD GPU via HIP~~ [WIP] Support AMD GPU via HIP (ROCm1.8.1+) Jul 1, 2018

okuta force-pushed the support-hip branch 5 times, most recently from 3ab6577 to d42d634 Compare July 8, 2018 14:57

okuta force-pushed the support-hip branch from d42d634 to 63ebaf0 Compare July 9, 2018 05:27

okuta force-pushed the support-hip branch 3 times, most recently from 7804c13 to b91b6d5 Compare July 22, 2018 06:19

okuta force-pushed the support-hip branch from b91b6d5 to 663b084 Compare August 26, 2018 18:17

okuta removed the st:blocked-by-another-pr Blocked by another pull-request label Aug 27, 2018

okuta force-pushed the support-hip branch from 663b084 to 46165c2 Compare August 31, 2018 16:32

okuta added this to the v5 milestone Sep 10, 2018

okuta force-pushed the support-hip branch from 46165c2 to 7546424 Compare September 10, 2018 02:12

okuta force-pushed the support-hip branch from 7546424 to 76b7a67 Compare September 19, 2018 14:17

cupy deleted a comment from pfn-ci-bot Aug 15, 2019

okuta changed the title ~~[Experimental] Support AMD GPU via HIP (ROCm2.6.0+)~~ [Experimental] Support AMD GPU via HIP (ROCm2.7.0+) Aug 15, 2019

mitmul suggested changes Sep 4, 2019

View reviewed changes

okuta and others added 2 commits September 10, 2019 09:41

Update docs/source/install_rocm.rst

995b030

Fix document Co-Authored-By: Shunta Saito <shunta.saito@gmail.com>

Merge branch 'master' into support-hip

89fc5ac

leofang mentioned this pull request Sep 13, 2019

Define __cuda_array_interface__ equivalent for ROC GPUs? numba/numba#4566

Closed

Fix NAN

6508fea

mitmul approved these changes Oct 1, 2019

View reviewed changes

This was referenced Oct 1, 2019

Adds nvcc as a RawKernel backend #1941

Merged

test_check_*_version() errors #2513

Closed

avimanyu786 mentioned this pull request Oct 5, 2019

Request to implement CuPy [Codebase linked as attachment] cellmodeller/CellModeller#17

Closed

Uh oh!

Conversation

okuta commented Apr 4, 2018 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Step 1: Install ROCm 2.7.0+

Step 2: Set environment variables

Step3: Install CuPy

Feature

Uh oh!

jedwards-AMD commented Sep 21, 2018

Uh oh!

okuta commented Aug 15, 2019

Uh oh!

pfn-ci-bot commented Aug 15, 2019

Uh oh!

okuta commented Aug 15, 2019

Uh oh!

pfn-ci-bot commented Aug 15, 2019

Uh oh!

mitmul commented Sep 4, 2019

Uh oh!

pfn-ci-bot commented Sep 4, 2019

Uh oh!

mitmul left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mitmul commented Sep 11, 2019

Uh oh!

pfn-ci-bot commented Sep 11, 2019

Uh oh!

mitmul commented Sep 11, 2019

Uh oh!

okuta commented Sep 18, 2019

Uh oh!

pfn-ci-bot commented Sep 18, 2019

Uh oh!

mitmul commented Sep 18, 2019

Uh oh!

okuta commented Oct 2, 2019

Uh oh!

avimanyu786 commented Nov 21, 2019

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

okuta commented Apr 4, 2018 •

edited

Loading