You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Mar 20, 2023. It is now read-only.
Describe the issue
In GPU-enabled builds that combine NMODL, GPU offload using OpenACC, and OpenMP host-side threading, the coreneuron_modtests::datareturn_py_gpu test hangs.
Expected behaviour
This shouldn't hang. https://gitlab.com/QEF/q-e/-/issues/452 seems to show a similar issue, but the comments there indicate the issue was fixed in NVHPC 22.3, which is the same version I see the above hang with.
System (please complete the following information)
OS: BB5
Compiler: NVHPC 22.3
Version: master
Backend: GPU
The text was updated successfully, but these errors were encountered:
Describe the issue
In GPU-enabled builds that combine NMODL, GPU offload using OpenACC, and OpenMP host-side threading, the
coreneuron_modtests::datareturn_py_gpu
test hangs.The hang occurs at
apparently during initialisation of the second CoreNEURON run that has 2 threads:
Setting
OMP_NUM_THREADS=1
avoids the problem, as does removing the OpenMP parallelism from this line:CoreNeuron/coreneuron/sim/fadvance_core.cpp
Line 99 in d07bae0
This datareturn test runs various combinations of psolve-direct mode, number of threads, and cell permutation scheme:
https://github.com/neuronsimulator/nrn/blob/3cc83cf7b09044a478665490d52acfc31f606036/test/coreneuron/test_datareturn.py#L184-L186
The current CI does not include this configuration. We have:
CoreNeuron/.gitlab-ci.yml
Lines 84 to 89 in d07bae0
CoreNeuron/.gitlab-ci.yml
Lines 91 to 97 in d07bae0
CoreNeuron/.gitlab-ci.yml
Lines 112 to 118 in d07bae0
CoreNeuron/.gitlab-ci.yml
Lines 120 to 127 in d07bae0
To Reproduce
Configure + build NEURON + CoreNEURON + NMODL:
cmake .. -G Ninja \ -DNRN_ENABLE_RX3D=OFF \ -DNRN_ENABLE_TESTS=ON \ -DNRN_ENABLE_CORENEURON=ON \ -DNRN_ENABLE_INTERVIEWS=OFF \ -DCORENRN_ENABLE_GPU=ON \ -DCORENRN_ENABLE_NMODL=ON \ -DCORENRN_ENABLE_OPENMP=ON \ -DCORENRN_ENABLE_OPENMP_OFFLOAD=OFF \ -DPYTHON_EXECUTABLE=$(command -v python3) ninja ctest -R datareturn_py_gpu -V
Expected behaviour
This shouldn't hang. https://gitlab.com/QEF/q-e/-/issues/452 seems to show a similar issue, but the comments there indicate the issue was fixed in NVHPC 22.3, which is the same version I see the above hang with.
System (please complete the following information)
The text was updated successfully, but these errors were encountered: