Determinate Nix 3.5: introducing lazy trees

lucperkins · May 16, 2025, 6:40pm

paperdigits · May 16, 2025, 6:56pm

wow you guys are so fast, 3.0 to 3.5 already?

lucperkins · May 16, 2025, 7:04pm

Yep! A lot of hard work and substantial changes

paperdigits · May 16, 2025, 7:16pm

I am sure! Is all this hard work for the cooperate version of nix or is there hope of seeing it in the canonical version of nix as well?

lucperkins · May 16, 2025, 7:22pm

As always, we’d love to see this in upstream Nix! There will be more PRs soon. Right now, we’re getting lots of useful feedback and, as always, the code is right here: GitHub - DeterminateSystems/nix-src: Nix, the purely functional package manager.

lucperkins · May 18, 2025, 1:10pm

github.com/NixOS/nix

Lazy trees v2

master ← lazy-trees-v2

opened 09:33PM - 17 May 25 UTC

edolstra

+533 -133

## Motivation This adds a setting `lazy-trees` that causes flake inputs to be… "mounted" as virtual filesystems on top of /nix/store as random "virtual" store paths. Only when the store path is actually used as a dependency of a store derivation do we materialize ("devirtualize") the input by copying it to its content-addressed location in the store. String contexts determine when devirtualization happens. One wrinkle is that there are cases where we had store paths without proper contexts, in particular when the user does `toString <path>` (where `<path>` is a source tree in the Nix store) and passes the result to a derivation. This usage was always broken, since it can result in derivations that lack correct references. But to ensure that we don't change evaluation results, we introduce a new type of context that results in devirtualization but not in store references. We also now print a warning about this. Supersedes/incorporates #12432 and #12915. It replaces #6530. The big difference with #6530 is that the latter treated each source tree as its own root filesystem, which caused a lot of backward compatibility issues that required ugly hacks. With the new approach, lazy source trees appear under `/nix/store`, just using a virtual store path that doesn't exist in the real filesystem. TODO: run the test suite with `lazy-trees = true`. ## Context --- Add :+1: to [pull requests you find important](https://github.com/NixOS/nix/pulls?q=is%3Aopen+sort%3Areactions-%2B1-desc). The Nix maintainer team uses a [GitHub project board](https://github.com/orgs/NixOS/projects/19) to [schedule and track reviews](https://github.com/NixOS/nix/tree/master/maintainers#project-board-protocol).