Skip to content
This repository was archived by the owner on Mar 25, 2025. It is now read-only.

Update usecase tests so they compare outputs with NOCMODL#1231

Closed
JCGoran wants to merge 2 commits into
masterfrom
jelic/test_outputs
Closed

Update usecase tests so they compare outputs with NOCMODL#1231
JCGoran wants to merge 2 commits into
masterfrom
jelic/test_outputs

Conversation

@JCGoran

@JCGoran JCGoran commented Apr 2, 2024

Copy link
Copy Markdown
Contributor

This PR modifies the testing of usecases as follows:

  • instead of calling [arch]/special, we directly call Python, which allows us to actually parse command-line args (is there some downside/side-effect of doing this?)
  • if there is an extra command line argument, some (not all!) of the tests they will create an output file (either nocmodl.txt or nmodl.txt, depending on which one we use for the codegen) with the relevant quantities of interest (voltage as function of time, etc.)
  • if the files differ, the run_test.sh script exits with an error code

All of the above should allow us to catch any differences between NEURON + NOCMODL and NEURON + NMODL (with NEURON codegen) a bit more easily.

Note that the nonspecific current test is not modified until #1218 is merged as the test fails.

@JCGoran JCGoran marked this pull request as ready for review April 2, 2024 14:51
@1uc

1uc commented Apr 2, 2024

Copy link
Copy Markdown
Collaborator

This type of diffing has caused considerable pain in the past, in is in many ways the opposite of what I'd like to build.

If there's a particular test success when is should fail, then the test should be made more strict. Once we implement enough functionality we'll gain access to ModelDB CI which does these types of checks.

@bbpbuildbot

Copy link
Copy Markdown
Collaborator

Logfiles from GitLab pipeline #203118 (:white_check_mark:) have been uploaded here!

Status and direct links:

@JCGoran JCGoran mentioned this pull request Apr 25, 2024
2 tasks
@1uc 1uc closed this May 10, 2024
@1uc 1uc deleted the jelic/test_outputs branch July 12, 2024 14:05
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants