Running jupyter notebook installed inside a virtualenv

[jnoortheen]

I have setup my Python project using virtualenv using python.poetry package. Not yet moved to nix-shell. the installation of all packages went without any errors. But I am not able to run jupyter notebook.

I was getting some errors related to czmq. I have installed the pacakge globally with environment.systemPackages. After I am getting the following error

I haven’t done systems programming and don’t know much about LD_LIBRARY_PATH. I have checked other posts that told to set the LD_LIBRARYPATH. But that doesn’t work for me.

Could anyone help me get it setup and running ?

[shamrocklee]

I’ve just find a way to run Jupyter Notebook managed by Poetry in NixOS.
Create the environment package first with mkPoetryEnv and then send it to buildFHSUserEnv.

Here is what I do:

Jupyter notebook dependency management with Poetry

Poetry is a declarative project manager for Python. However, if you install Jupyter notebook with poetry on NixOS, it might fail to find some .so files from the environment. Combining the buildFHSUserEnv solution in another topic here with poetry2nix.mkPoetryEnv, we can get a working Jupyter environment with declarative dependency management portable to non-Nix environment. Just place two files in the top-level directory of the Poetry project: poetry-env.nix {pkgs ? import <nixpkgs> {} }: l…

The two pieces of code are borrowed from other people (one from this forum and and another from the poetry2nix documentation) with a few modifications, as I’m also a newbie here.

BTW, it seems better to categorize this topic as Help instead of howto.

[jonringer]

you can follow my post from Jupyter notebook dependency management with Poetry - #2 by jonringer . You will want nixpkgs to supply you with a version of pyzmq which has been linked against libstdc++.so

Your underlying issue is that nixos only exposes the libc libraries, but not the c++ libraries, which is why some .so’s will work fine, but many c++ ones will not.

I also made a video demonstrating nix python package usage with nix-shell here: https://youtu.be/jXd-hkP4xnU?t=1497 . I fast forwarded to roughly the correct spot.

[jnoortheen]

Thanks very much I will check it out. Is there anyway to set these variables correctly without nix-shell ?

like we used to in other distros. Also that way the IDEs will be working with notebooks without having to start from commandline .

[jonringer]

if all of your dependencies are in nixpkgs, you could use python.withPackages, and build a ipykernel which references it. Poetry2nix will probably allow you to do similar things, I just don’t have any experience with it.

[shamrocklee]

You may also be interested in mach-nix
I haven’t tested it yet, but it sounds interesding.

Mach-nix: Create python environments quick and easy

Mach-nix makes the process of creating a python environment from a requirements.txt file a no-brainer. Motivation: When I started using NixOS, I was amazed! (Thanks BTW!) But what I was missing was a quick way to set up a python environment from a requirements.txt file. There are amazing tools like pypi2nix which simplify the task a lot, but the whole experience is still far from perfect. Non-pythonic build inputs are not handled, which often makes it a long manual process of rebuilding stuff o…