Other AI large local models for NixOS

I’ve been using Ollama with various LLMs, and with Oterm and WebUI, for about a year now, and it’s been amazing.

I wanted to ask, are there any other forms of AI large local models for NixOS?

I’ve seen some other open source projects, like MusicGPT, and was wondering if something like that could be incorporated into Nixpkgs: GitHub - gabotechs/MusicGPT: Generate music based on natural language prompts using LLMs running locally

What do you mean by that? We don’t deliver model files unless they are integrated into the project. If you mean apps and web services that consume them, we have some, and we’re open to packaging more, as long as someone is willing to do it.

3 Likes