Run Jupyter notebook server hosting on baobab

[Dimitrios.Proios]

Hello I would like to ask if there is the possibility to run and expose to the web. Jupyter notebook pages that use cpus/gpus of baobab.

The idea would be to go to go to eg baobab2.hpc.unige.ch:8888/myjupyter_page

and live edit code.

If not are there some alternative to create notebooks in baobab server environment ?

Thank you in advance

[Pablo.Strasser]

I have in the past used ssh tunneling to make services accessible ( https://www.ssh.com/ssh/tunneling/example ) using the login node as entry point. However, I’m not sure this is a recommended way to do it in baobab. And I don’t know if this approach still work.

[Dimitrios.Proios]

@Pablo.Strasser thanks for your respnse. I tried some similar ssh with visual studio code but the server doesnt let me and connect after for some minutes I cant login. (I guess its automatic ban of ip of some sort, fyi thats how I tried: https://code.visualstudio.com/docs/remote/ssh.)

Also pycharm has a remote connection mode but I couldnt manage either.
Fir now I push code and pull there to run it (for big data size and gpus) for now, or edit with vim but I guess there are more efficiecnt workflows.

If anyone has better recommendations I would like to hear

[Pablo.Strasser]

For editing code, you can use sshfs or an ftp client and directly edit from your computer. I also know they have a gui connection which is possible but never tried it.

[Yann.Sagon]

Dear Dimitrios,

I wrote this tutorial right now, maybe this will help you.

[tutorial] Jupyter notebook

As Jupyter notebook is getting more and more popular, it’s time to write a small tutorial explaining how you could launch a Jupyter notebook on Baobab. Jupyter notebook is a web based interface. In this tutorial, we expect that you will connect to Baobab through x2go. Once connected to Baobab through x2go, you need to write a sbatch script like this one. Adapt it to your need. Be sure to not specify the port number is it may happens it’s already in use and the job will then fail. Jupyter noteb…

[Yann.Sagon]

@Dimitrios.Proios

I tried some similar ssh with visual studio code but the server doesnt let me and connect after for some minutes I cant login. (I guess its automatic ban of ip of some sort

We are banning ssh connections when you do too much attempt to connect using the wrong password.
Maybe you were connected to Baobab and you connected again from another way using wrong password multiple time and in this case, all your sessions are killed.

Feel free to create a new thread if you want to try again and you need help.

[Dimitrios.Proios]

Is there a way to expose it also online (with external ip)?

[Yann.Sagon]

You have the right to expose it online using baobab2.hpc.unige.ch ip, but for the moment we won’t explain how to do it nor support it as there is not clean way to do it.
hint: ssh and tunnel or ProxyJump. Feel free to discuss about your success/failure here as this may interest other users.

[Dimitrios.Proios]

Sounds interesting I will write if I manage it thanks for the info