RuntimeError: CUDA unknown error

Dear @Debajyoti.Sengupta

As announced, here, please do not use singularity from module anymore.

Please give a try with apptainer:

What CUDA toolkit do you have in your image?