Error with threading

HPC Technical
1

I am trying to run a python code that uses with multiprocessing Pool. i have always used this in my codes and didnt have issues until today where i get the error below on both yggdrasil and baobab

OpenBLAS blas_thread_init: pthread_create failed for thread 96 of 98: Resource temporarily unavailable
OpenBLAS blas_thread_init: RLIMIT_NPROC 4096 current, -1 max

my slurm script is as below:

#SBATCH --partition=shared-cpu
#SBATCH --nodes=1
#SBATCH --time=0-12
#SBATCH --ntasks-per-node=1
#SBATCH --cpus-per-task=98
#SBATCH --mem=392G

# Run code

python phase_curve-spline_roll_noGp.py

i have tried reducing number of of cores and memory requested but no difference. is this an admin limitation on threading?

2

Hi @Tunde.Akinsanmi,

Could you provide the complete sbatch ? with all module you are trying to load ?