11

I have an instance with various environment and some notebooks are compatible with different environment for e.g. notebook1 is for MXNet and notebook2 is for Tensorflow.

How do I jump to new environment when I move from notebook1 to notebook2? I tried doing that but this doesn't quite work with Jupyter notebook? Any suggestion?

So I need to do it from conda environment but looks like jupyter notebook UI doesn't respect (calls right activation function) to set the path.

rgaut
  • 3,159
  • 5
  • 25
  • 29
  • Have you tried setting up virtual environments? You could have one for MXNet and another for Tensoflow. https://virtualenv.pypa.io/en/stable/ – jss367 Nov 08 '17 at 23:17
  • If I'm understanding what you're saying, you need to active the environment before you call jupyter notebook. So you would do `activate pytf` then `jupyter notebook`. Then you would have your notebook open in the correct environment. – jss367 Nov 08 '17 at 23:25
  • Thanks but installing environment_kernels package has helped to achieve this. – rgaut Nov 10 '17 at 09:03

5 Answers5

15

You could use the nb_conda_kernels package, which provides a separate jupyter kernel for each conda environment, along with the appropriate code to handle their setup. This makes switching conda environment as simple as switching jupyter kernel (e.g. from the kernel menu), which I find very convenient. You can get it from the conda-forge channel, using

conda install -c conda-forge nb_conda_kernels
jcb91
  • 639
  • 4
  • 8
  • Yes along with this package I think also need to change the ~/.jupyter/jupyter_notebook_config.py file with following config c.NotebookApp.kernel_spec_manager_class = 'environment_kernels.EnvironmentKernelSpecManager' – rgaut Nov 14 '17 at 02:48
  • This (setting the kernel_spec_manager_class value in config) is done automatically by the nb_conda_kernels.install module (see https://github.com/Anaconda-Platform/nb_conda_kernels/blob/3478523f366b11dd62ed6bd1535196c7c5a7e8c5/nb_conda_kernels/install.py#L76-L77), which is called automatically as part of the conda package installation (see the post-link script in the conda recipe at https://github.com/Anaconda-Platform/nb_conda_kernels/blob/3478523f366b11dd62ed6bd1535196c7c5a7e8c5/conda.recipe/post-link.sh) – jcb91 Nov 14 '17 at 18:33
  • the `conda-forge` channel uses really old packages. Using this channel, you may also be forced to downgrade your python version. To be on the safe side, use the default anaconda channel, i.e use `-c defaults` – Shailen Jan 19 '19 at 09:59
  • Also, as of 01.2019, the comment from @rgaut does not seem to to work. You need to edit `~/.jupyter/jupyter_notebook_config.py` and set: `c.NotebookApp.kernel_spec_manager_class = 'nb_conda_kernels.CondaKernelSpecManager'` – Shailen Jan 19 '19 at 10:38
3

Installing the nb_conda_kernels package as suggested by user @jcb91 worked for me. I did have to install it both in my root (base) environment as well as the virtual environment with which I wanted to use it. To do this, run the following in the Anaconda prompt (in your base environment):

conda install nb_conda_kernels

Then, activate your virtual environment (in the code below named 'myenv') and install the nb_conda_kernels package there as well. You can do this by running in the Anaconda prompt:

conda activate myenv
conda install nb_conda_kernels

You now should be able to switch to your different environment using:

Kernel -> Change Kernel
Jeremy Caney
  • 7,102
  • 69
  • 48
  • 77
Anne
  • 51
  • 1
  • 4
2

When you start a jupyter notebook within an environment, it will only have access to the modules installed in that particular enviroment. If you need two specific environments for two different notebooks, you will need to start a jupyter notebook within the two environments separately.

If you are using anaconda, you would do the following in a terminal:

source activate MXNET
jupyter notebook

Then in a second terminal:

 source activate Tensorflow
 jupyter notebook
Mark Hannel
  • 767
  • 5
  • 12
  • Yes without using these command by just going through the UI, I want to switch the env – rgaut Nov 10 '17 at 09:01
  • 1
    not sure if this is what you're looking for, but you can try changing the environment in Jupyter Notebook menu, in Kernel -> Change Kernel -> [... available kernels ...] – Amade Jun 05 '18 at 01:06
  • 1
    @Amade - that does not work for me. Changing the kernels always uses the python of a certain activated python. The `kernel.json` for each of the kernels in the list point to different python paths in their respective environments. Still, `!which python` always uses the one in the currently activated env where jupyter notebook was started. – Shailen Jan 19 '19 at 10:12
1

I don't really know the definition and relationship between kernel and conda env, but I beleive we can set a kernel for each env.

I got a problem similar to you: I clean my data in data_cleaning.ipynb under env_without_lgb. However, I have lightgbm installed under env_lightgbm. So, I want to switch kernel/env from env_without_lgb to env_lightgbm, which we can use Kernel -> Change Kernel:

enter image description here

If there is not a kernel you want, create a kernel under the right env according to this guide. For me, I only have a Pure Python 3 kernel and R kernel at first and then I create a kernel under env_lightgbm. At last, we can switch kernel when we editing our code.

However, I still can not figure out the relationship between kernel and env.

Travis
  • 1,152
  • 9
  • 25
0

Along with this package I think also need to change the ~/.jupyter/jupyter_notebook_config.py file with following config

c.NotebookApp.kernel_spec_manager_class = 'environment_kernels.EnvironmentKernelSpecManager'
rgaut
  • 3,159
  • 5
  • 25
  • 29