Skip to content

bugfix: Distribute mulitcompartment reaction fluxes in MPI.#728

Merged
ramcdougal merged 11 commits into
neuronsimulator:masterfrom
adamjhn:rxdmpifix
Sep 16, 2020
Merged

bugfix: Distribute mulitcompartment reaction fluxes in MPI.#728
ramcdougal merged 11 commits into
neuronsimulator:masterfrom
adamjhn:rxdmpifix

Conversation

@adamjhn

@adamjhn adamjhn commented Aug 26, 2020

Copy link
Copy Markdown
Member

Previously only currents where being gathered by all nodes. In order to avoid double counting rxd currents, the currents generated by rxd are also distributed to all nodes.

Previously only currents where being gathered by all nodes. In order to avoid double counting rxd currents, the currents generated by rxd are also distributed to all nodes.
@adamjhn adamjhn requested a review from ramcdougal August 26, 2020 16:25
@pramodk

pramodk commented Aug 26, 2020

Copy link
Copy Markdown
Member

@adamjhn : seems like builds are failing because of IV submodule update. If it's not needed in this PR, you can revert IV to older commit and we can fix IV specific build issues separately.

@pramodk

pramodk commented Sep 13, 2020

Copy link
Copy Markdown
Member

@adamjhn : I didn't change anything. Seems like it was temporary issue on travis which got resolved.

@pramodk

pramodk commented Sep 13, 2020

Copy link
Copy Markdown
Member

In travis CI log I am randomly seeing:

Thread Safe
6078make: write error: stdout

I thought we discussed and workaround it in #559 (comment).

For now, I am just re-triggering failed build.

@ramcdougal ramcdougal merged commit 1101017 into neuronsimulator:master Sep 16, 2020
@ramcdougal ramcdougal deleted the rxdmpifix branch September 16, 2020 01:22
nrnhines pushed a commit that referenced this pull request Dec 9, 2020
* bugfix: Distribute mulitcompartment reaction fluxes in MPI.
Previously only currents were being gathered by all nodes. In order to avoid double counting rxd currents, the currents generated by rxd are also distributed to all nodes.

* Fixed some initialization problems.

* Update test results due to a change in when multicompartment fluxes are added.

* Fixed a memory problem in the variable step method.

* Fix an initialization problem.

* Update test data.

* Revert external/iv changes.
nrnhines pushed a commit that referenced this pull request Dec 10, 2020
* bugfix: Distribute mulitcompartment reaction fluxes in MPI.
Previously only currents were being gathered by all nodes. In order to avoid double counting rxd currents, the currents generated by rxd are also distributed to all nodes.

* Fixed some initialization problems.

* Update test results due to a change in when multicompartment fluxes are added.

* Fixed a memory problem in the variable step method.

* Fix an initialization problem.

* Update test data.

* Revert external/iv changes.
olupton pushed a commit that referenced this pull request Dec 7, 2022
* Two factors contribute to the above solution:
   - New eigen branch (version 3.5 and above). Currently we are
      using a mirrored version of Eigen in BlueBrain organisation
      https://github.com/BlueBrain/eigen/releases/tag/v3.5-alpha
   - An API that makes possible to call any Eigen `__device__` 
      function from within OpenACC regions.
* More details: Eigen-3.5+ provides better GPU support; however,
   some functions cannot be called directly from within OpenACC regions.
   Therefore, we need to wrap them in a special API (decorate them with 
    `__device__` & `acc routine` tokens), which allows us to eventually call
    them from OpenACC. Calling these functions from CUDA kernels presents
    no issue.
*  From #726: Avoid use `[]` operator with eigen Matrix objects. This results
    into runtime error with OpenACC and PGI compiler.
* Note that this should works in combination with BlueBrain/CoreNeuron/pull/624

fixes #311 
fixes #135
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants