Skip to content
This repository was archived by the owner on Feb 26, 2025. It is now read-only.

Deploy upcoming 9.0a release#1781

Merged
pramodk merged 12 commits into
developfrom
pramodk/neuron-9.a1
Dec 14, 2022
Merged

Deploy upcoming 9.0a release#1781
pramodk merged 12 commits into
developfrom
pramodk/neuron-9.a1

Conversation

@pramodk

@pramodk pramodk commented Dec 1, 2022

Copy link
Copy Markdown

Also add knl variant in order to enable deployment of KNL modules. We will remove this variant when CMake of NEURON handles cross-compiling aspects where nocmodl should be compiled without ARCH specific optimization flags.

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

Thank you for your pull request!

Should you want to clear the PR build directory after failures, please use this pipeline. Before running the cleanup pipeline, please ensure that any PR building pipelines have been cancelled or finished running.

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

@pramodk pramodk force-pushed the pramodk/neuron-9.a1 branch from 065b1a0 to 2f653f4 Compare December 1, 2022 12:24
@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

@pramodk pramodk force-pushed the pramodk/neuron-9.a1 branch from 2f653f4 to 0f7b5e6 Compare December 1, 2022 14:19
Also add knl variant in order to enable deployment of KNL
modules. We will remove this variant when CMake of NEURON
handles cross-compiling aspects where nocmodl should be
compiled without ARCH specific optimization flags.
@pramodk pramodk force-pushed the pramodk/neuron-9.a1 branch from 0f7b5e6 to b9b1467 Compare December 1, 2022 14:46
@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

Please fix the following packages that failed to build:

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

Please fix the following packages that failed to build:

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

Please fix the following packages that failed to build:

@pramodk pramodk force-pushed the pramodk/neuron-9.a1 branch from 06b0540 to 6e9e869 Compare December 2, 2022 07:33
@pramodk pramodk force-pushed the pramodk/neuron-9.a1 branch from 6e9e869 to 8b57a57 Compare December 2, 2022 07:34
@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

Please fix the following packages that failed to build:

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

Please fix the following packages that failed to build:

of the external spack package

- `nrnivmodl -coreneuron mod` with neuron/8.2.2a currently deployed
  isn't working because of that
@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

Please fix the following packages that failed to build:

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

The following build jobs of the deployment for this PR failed:

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

To test your PR, use the following on BlueBrain5:

unset MODULEPATH
. /gpfs/bbp.cscs.ch/ssd/apps/bsd/pulls/1781/config/modules.sh
module load unstable

Please test the following updated modules:

  • asciitoh5/1.0
  • brainbuilder/0.18.0
  • connectome-tools/0.6.2
  • neurodamus-core/3.4.1
  • neurodamus-core/3.4.1-commonmods
  • neurodamus-hippocampus-knl/1.8-2.12.10
  • neurodamus-hippocampus/1.8-2.12.10
  • neurodamus-mousify/1.6-2.12.10
  • neurodamus-neocortex-knl/1.10a-2.12.10
  • neurodamus-neocortex-multiscale/1.10a-2.12.10
  • neurodamus-neocortex-plasticity/1.10a-2.12.10
  • neurodamus-neocortex/1.10a-2.12.10
  • neurodamus-thalamus-knl/1.6-2.12.10
  • neurodamus-thalamus/1.6-2.12.10
  • neuron/9.0.a1
  • placement-algorithm/2.3.0
  • psp-validation/0.5.0
  • py-archngv/2.0.2
  • py-bbp-analysis-framework/1.6.42
  • py-bbp-workflow/3.1.0
  • py-bglibpy/4.8.2
  • py-bluepy/2.4.5
  • py-bluepyemodel/0.0.8.2021-12-22
  • py-bluepymm/0.7.65
  • py-bluepyopt/1.10.38
  • py-bluepysnap/0.13.2
  • py-currentscape/0.0.10
  • py-minis-validation/0.0.5
  • py-morph-tool/2.9.0
  • py-morphology-repair-workflow/2.0.3
  • py-region-grower/0.3.0
  • py-sonata-network-reduction/0.1.8

The following module tests failed:

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

To test your PR, use the following on BlueBrain5:

unset MODULEPATH
. /gpfs/bbp.cscs.ch/ssd/apps/bsd/pulls/1781/config/modules.sh
module load unstable

Please test the following updated modules:

  • asciitoh5/1.0
  • brainbuilder/0.18.0
  • connectome-tools/0.6.2
  • neurodamus-core/3.4.1
  • neurodamus-core/3.4.1-commonmods
  • neurodamus-hippocampus-knl/1.8-2.12.10
  • neurodamus-hippocampus/1.8-2.12.10
  • neurodamus-mousify/1.6-2.12.10
  • neurodamus-neocortex-knl/1.10-2.12.10
  • neurodamus-neocortex-multiscale/1.10-2.12.10
  • neurodamus-neocortex-plasticity/1.10-2.12.10
  • neurodamus-neocortex/1.10-2.12.10
  • neurodamus-thalamus-knl/1.6-2.12.10
  • neurodamus-thalamus/1.6-2.12.10
  • neuron/9.0.a1
  • placement-algorithm/2.3.0
  • psp-validation/0.5.0
  • py-archngv/2.0.2
  • py-bbp-analysis-framework/1.6.42
  • py-bbp-workflow/3.1.0
  • py-bglibpy/4.8.2
  • py-bluepy/2.4.5
  • py-bluepyemodel/0.0.8.2021-12-22
  • py-bluepymm/0.7.65
  • py-bluepyopt/1.10.38
  • py-bluepysnap/0.13.2
  • py-currentscape/0.0.10
  • py-minis-validation/0.0.5
  • py-morph-tool/2.9.0
  • py-morphology-repair-workflow/2.0.3
  • py-region-grower/0.3.0
  • py-sonata-network-reduction/0.1.8

Comment thread bluebrain/deployment/environments/applications_hpc.yaml
Comment thread bluebrain/repo-patches/packages/neuron/package.py
pramodk added a commit that referenced this pull request Dec 14, 2022
* In #1777 we have made coreneuron optional for upcoming neuron > 8
  releases:
```
    depends_on("coreneuron+legacy-unit~caliper", when="@:8.99+coreneuron+legacy-unit~caliper")
    ...
```
* Because of this change, spack is now preferring develop version of
  neuron when we mix gcc with intel:

```
$ spack spec -I py-bluepyopt%gcc ^neuron%intel
Input spec
--------------------------------
 -   py-bluepyopt%gcc
 -       ^neuron%intel

Concretized
--------------------------------
 -   py-bluepyopt@1.10.38%gcc@11.2.0+neuron patches=dc37639246b3a3320c840f1c4f635940b8510a896a667d4707c3d355d9c6fb81 arch=linux-rhel7-skylake
 -       ^neuron@develop%intel@2021.4.0+binary~caliper~codegenopt+coreneuron~debug~gpu~interviews~ipo+legacy-fr+legacy-unit+memacs+mod-compatibility+mpi~nmodl~openmp+python+report+rx3d+shared~sympy~sympyopt~tests~unified build_type=RelWithDebInfo model_tests=None patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c sanitizers=None arch=linux-rhel7-skylake
```
  but with single compiler, it uses last release correctly

```
$ spack spec -I py-bluepyopt ^neuron%intel
Input spec
--------------------------------
 -   py-bluepyopt
 -       ^neuron%intel

Concretized
--------------------------------
 -   py-bluepyopt@1.10.38%intel@2021.4.0+neuron patches=dc37639246b3a3320c840f1c4f635940b8510a896a667d4707c3d355d9c6fb81 arch=linux-rhel7-skylake
 -       ^neuron@8.2.1%intel@2021.4.0+binary~caliper~codegenopt+coreneuron~debug~gpu~interviews~ipo+legacy-fr+legacy-unit+memacs+mod-compatibility+mpi~nmodl~openmp+python+report+rx3d+shared~sympy~sympyopt~tests~unified build_type=RelWithDebInfo model_tests=None patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c sanitizers=None arch=linux-rhel7-skylake
 -           ^bison@3.8.2%intel@2021.4.0 arch=linux-rhel7-skylake
```
* I tried various spec changes in neuron and coreneuron but don't see
  any satisfactory change to force spack to use last release than
  develop. So as part of this commit, pin the last release whenever
  we are mixing compilers. ANYWAY, this will be removed with #1781.
pramodk added a commit that referenced this pull request Dec 14, 2022
* In #1777 we have made coreneuron optional for upcoming neuron > 8
  releases:
```
    depends_on("coreneuron+legacy-unit~caliper", when="@:8.99+coreneuron+legacy-unit~caliper")
    ...
```
* Because of this change, spack is now preferring develop version of
  neuron when we mix gcc with intel:

```
$ spack spec -I py-bluepyopt%gcc ^neuron%intel
Input spec
--------------------------------
 -   py-bluepyopt%gcc
 -       ^neuron%intel

Concretized
--------------------------------
 -   py-bluepyopt@1.10.38%gcc@11.2.0+neuron patches=dc37639246b3a3320c840f1c4f635940b8510a896a667d4707c3d355d9c6fb81 arch=linux-rhel7-skylake
 -       ^neuron@develop%intel@2021.4.0+binary~caliper~codegenopt+coreneuron~debug~gpu~interviews~ipo+legacy-fr+legacy-unit+memacs+mod-compatibility+mpi~nmodl~openmp+python+report+rx3d+shared~sympy~sympyopt~tests~unified build_type=RelWithDebInfo model_tests=None patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c sanitizers=None arch=linux-rhel7-skylake
```
  but with single compiler, it uses last release correctly

```
$ spack spec -I py-bluepyopt ^neuron%intel
Input spec
--------------------------------
 -   py-bluepyopt
 -       ^neuron%intel

Concretized
--------------------------------
 -   py-bluepyopt@1.10.38%intel@2021.4.0+neuron patches=dc37639246b3a3320c840f1c4f635940b8510a896a667d4707c3d355d9c6fb81 arch=linux-rhel7-skylake
 -       ^neuron@8.2.1%intel@2021.4.0+binary~caliper~codegenopt+coreneuron~debug~gpu~interviews~ipo+legacy-fr+legacy-unit+memacs+mod-compatibility+mpi~nmodl~openmp+python+report+rx3d+shared~sympy~sympyopt~tests~unified build_type=RelWithDebInfo model_tests=None patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c sanitizers=None arch=linux-rhel7-skylake
 -           ^bison@3.8.2%intel@2021.4.0 arch=linux-rhel7-skylake
```
* I tried various spec changes in neuron and coreneuron but don't see
  any satisfactory change to force spack to use last release than
  develop. So as part of this commit, pin the last release whenever
  we are mixing compilers. ANYWAY, this will be removed with #1781.
@pramodk pramodk marked this pull request as ready for review December 14, 2022 08:58
@pramodk

pramodk commented Dec 14, 2022

Copy link
Copy Markdown
Author

I verified that neuron@9.0.a1 (and not neuron@develop) is being used now in science and nse packages:

iomaganaris
iomaganaris previously approved these changes Dec 14, 2022
Comment thread bluebrain/repo-bluebrain/packages/model-neocortex/package.py
Comment thread bluebrain/repo-patches/packages/neuron/package.py Outdated
Co-authored-by: Matthias Wolf <matthias.wolf@epfl.ch>
matz-e
matz-e previously approved these changes Dec 14, 2022
Comment thread bluebrain/repo-patches/packages/neuron/package.py
@bbpbuildbot

Copy link
Copy Markdown
Collaborator

To test your PR, use the following on BlueBrain5:

unset MODULEPATH
. /gpfs/bbp.cscs.ch/ssd/apps/bsd/pulls/1781/config/modules.sh
module load unstable

Please test the following updated modules:

  • asciitoh5/1.0
  • brainbuilder/0.18.0
  • connectome-tools/0.6.2
  • neurodamus-core/3.4.1
  • neurodamus-core/3.4.1-commonmods
  • neurodamus-hippocampus-knl/1.8-2.12.10
  • neurodamus-hippocampus/1.8-2.12.10
  • neurodamus-mousify/1.6-2.12.10
  • neurodamus-neocortex-knl/1.10-2.12.10
  • neurodamus-neocortex-multiscale/1.10-2.12.10
  • neurodamus-neocortex-plasticity/1.10-2.12.10
  • neurodamus-neocortex/1.10-2.12.10
  • neurodamus-thalamus-knl/1.6-2.12.10
  • neurodamus-thalamus/1.6-2.12.10
  • neuron/9.0.a1
  • placement-algorithm/2.3.0
  • psp-validation/0.5.0
  • py-archngv/2.0.2
  • py-bbp-analysis-framework/1.6.42
  • py-bbp-workflow/3.1.0
  • py-bglibpy/4.8.2
  • py-bluepy/2.4.5
  • py-bluepyemodel/0.0.8.2021-12-22
  • py-bluepymm/0.7.65
  • py-bluepyopt/1.10.38
  • py-bluepysnap/0.13.2
  • py-currentscape/0.0.10
  • py-minis-validation/0.0.5
  • py-morph-tool/2.9.0
  • py-morphology-repair-workflow/2.0.3
  • py-region-grower/0.3.0
  • py-sonata-network-reduction/0.1.8

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

To test your PR, use the following on BlueBrain5:

unset MODULEPATH
. /gpfs/bbp.cscs.ch/ssd/apps/bsd/pulls/1781/config/modules.sh
module load unstable

Please test the following updated modules:

  • asciitoh5/1.0
  • brainbuilder/0.18.1
  • connectome-tools/0.6.2
  • neurodamus-core/3.4.1
  • neurodamus-core/3.4.1-commonmods
  • neurodamus-hippocampus-knl/1.8-2.12.10
  • neurodamus-hippocampus/1.8-2.12.10
  • neurodamus-mousify/1.6-2.12.10
  • neurodamus-neocortex-knl/1.10-2.12.10
  • neurodamus-neocortex-multiscale/1.10-2.12.10
  • neurodamus-neocortex-plasticity/1.10-2.12.10
  • neurodamus-neocortex/1.10-2.12.10
  • neurodamus-thalamus-knl/1.6-2.12.10
  • neurodamus-thalamus/1.6-2.12.10
  • neuron/9.0.a1
  • placement-algorithm/2.3.0
  • psp-validation/0.5.0
  • py-archngv/2.0.2
  • py-bbp-analysis-framework/1.6.42
  • py-bbp-workflow/3.1.0
  • py-bglibpy/4.8.2
  • py-bluepy/2.4.5
  • py-bluepyemodel/0.0.8.2021-12-22
  • py-bluepymm/0.7.65
  • py-bluepyopt/1.10.38
  • py-bluepysnap/0.13.2
  • py-currentscape/0.0.10
  • py-minis-validation/0.0.5
  • py-morph-tool/2.9.0
  • py-morphology-repair-workflow/2.0.3
  • py-region-grower/0.3.0
  • py-sonata-network-reduction/0.1.8

@pramodk pramodk merged commit 7d3f316 into develop Dec 14, 2022
@pramodk pramodk deleted the pramodk/neuron-9.a1 branch December 14, 2022 12:25
heerener pushed a commit that referenced this pull request Jan 17, 2023
* Updated model-neocortex packages with latest 1.10 tag
* add nmodl 0.5.a
* remove coreneuron packages

Co-authored-by: Ioannis Magkanaris <iomagkanaris@gmail.com>
Co-authored-by: Matthias Wolf <matthias.wolf@epfl.ch>
heerener pushed a commit that referenced this pull request Jan 23, 2023
CoreNEURON: reduce memory usage in report initialization (#1776)

Recipe changes to combine coreneuron into NEURON (#1777)

* Bring coreneuron recipe options into neuron for coreneuron merge
* remove dependency with coreneuron when neuron>=9.0 or develop
* coreneuron variant is on by default in neuron
* coreneuron mechanism library should always have different name than
   libcorenrnmech.so as it's now part of NEURON installation
* do not add arch specific opt flags with +debug
* Automatically bring coreneuron build_type=Debug when neuron+debug
  is used. This will simplify logic in blueconfig CI where we don't
  have to explicitly specify coreneuron dependency (especially as we
  have merged neuron and coreneuron)
* Find "right" nrnivmodl-core binary for neurodamus building

See relevant PR: neuronsimulator/nrn#2055

Deploy NEURON's upcoming 9.0a release (#1781)

* Updated model-neocortex packages with latest 1.10 tag
* add nmodl 0.5.a
* remove coreneuron packages

Co-authored-by: Ioannis Magkanaris <iomagkanaris@gmail.com>
Co-authored-by: Matthias Wolf <matthias.wolf@epfl.ch>

Update NEURON version (#1792)

- Create NEURON version 9.0.a2 that includes bug fixes

[Core]NEURON 8.2.2 (#1802)

coreneuron: so long, and thanks for the fish.

Coreneuron has been folded into neuRon and should not be referred to as
a standalone package any more.

Add py-sympy dependency at neuron package level

newer spack doesn't seem to propogate python package
dependencies (as PYTHONPATH) during build phase.

neuron: omitted link flag for Caliper
heerener pushed a commit that referenced this pull request Jan 23, 2023
CoreNEURON: reduce memory usage in report initialization (#1776)

Recipe changes to combine coreneuron into NEURON (#1777)

* Bring coreneuron recipe options into neuron for coreneuron merge
* remove dependency with coreneuron when neuron>=9.0 or develop
* coreneuron variant is on by default in neuron
* coreneuron mechanism library should always have different name than
   libcorenrnmech.so as it's now part of NEURON installation
* do not add arch specific opt flags with +debug
* Automatically bring coreneuron build_type=Debug when neuron+debug
  is used. This will simplify logic in blueconfig CI where we don't
  have to explicitly specify coreneuron dependency (especially as we
  have merged neuron and coreneuron)
* Find "right" nrnivmodl-core binary for neurodamus building

See relevant PR: neuronsimulator/nrn#2055

Deploy NEURON's upcoming 9.0a release (#1781)

* Updated model-neocortex packages with latest 1.10 tag
* add nmodl 0.5.a
* remove coreneuron packages

Co-authored-by: Ioannis Magkanaris <iomagkanaris@gmail.com>
Co-authored-by: Matthias Wolf <matthias.wolf@epfl.ch>

Update NEURON version (#1792)

- Create NEURON version 9.0.a2 that includes bug fixes

[Core]NEURON 8.2.2 (#1802)

coreneuron: so long, and thanks for the fish.

Coreneuron has been folded into neuRon and should not be referred to as
a standalone package any more.

Add py-sympy dependency at neuron package level

newer spack doesn't seem to propogate python package
dependencies (as PYTHONPATH) during build phase.

neuron: omitted link flag for Caliper
matz-e pushed a commit that referenced this pull request Jan 25, 2023
CoreNEURON: reduce memory usage in report initialization (#1776)

Recipe changes to combine coreneuron into NEURON (#1777)

* Bring coreneuron recipe options into neuron for coreneuron merge
* remove dependency with coreneuron when neuron>=9.0 or develop
* coreneuron variant is on by default in neuron
* coreneuron mechanism library should always have different name than
   libcorenrnmech.so as it's now part of NEURON installation
* do not add arch specific opt flags with +debug
* Automatically bring coreneuron build_type=Debug when neuron+debug
  is used. This will simplify logic in blueconfig CI where we don't
  have to explicitly specify coreneuron dependency (especially as we
  have merged neuron and coreneuron)
* Find "right" nrnivmodl-core binary for neurodamus building

See relevant PR: neuronsimulator/nrn#2055

Deploy NEURON's upcoming 9.0a release (#1781)

* Updated model-neocortex packages with latest 1.10 tag
* add nmodl 0.5.a
* remove coreneuron packages

Co-authored-by: Ioannis Magkanaris <iomagkanaris@gmail.com>
Co-authored-by: Matthias Wolf <matthias.wolf@epfl.ch>

Update NEURON version (#1792)

- Create NEURON version 9.0.a2 that includes bug fixes

[Core]NEURON 8.2.2 (#1802)

coreneuron: so long, and thanks for the fish.

Coreneuron has been folded into neuRon and should not be referred to as
a standalone package any more.

Add py-sympy dependency at neuron package level

newer spack doesn't seem to propogate python package
dependencies (as PYTHONPATH) during build phase.

neuron: omitted link flag for Caliper
ferdonline pushed a commit to BlueBrain/neurodamus-models that referenced this pull request Feb 14, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants