Python not available on all the nodes

HPC Support HPC issues
1

hello,

I have a very similar problem, but without using venv:

I module load GCCcore/12.3.0 Python/3.11.3 for which I have pip installed snakemake together with the slurm-adaptor.

when launching jobs I get the error

/var/spool/slurmd/job14437715/slurm_script: line 4: /opt/ebsofts/Python/3.11.3-GCCcore-12.3.0/bin/python: No such file or directory

on a non-deterministic basis (depending on the time 20-100% of jobs failing)

thank you

2

adding that since a couple of hours all of my jobs fail with that error message

3

I have had the same error starting this week

Cheers,
Malte

4

On which cluster you have this error ?

5

Hi again

Its on baobab

Malte

6

Hi, I’ve split the original post at this are two distinct problems I guess.

In your case, the software that isn’t seen is /opt/ebsofts/Python/3.11.3-GCCcore-12.3.0/bin/python which is hosted on a central NFS share, thus not related with your home directory.

I’ve checked if this location is reachable from all the nodes… and no! It wasn’t reachable from cpu333 which was the node you used! This is now fixed.

Best