I’ve been using Ollama with various LLMs, and with Oterm and WebUI, for about a year now, and it’s been amazing.
I wanted to ask, are there any other forms of AI large local models for NixOS?
I’ve seen some other open source projects, like MusicGPT, and was wondering if something like that could be incorporated into Nixpkgs: GitHub - gabotechs/MusicGPT: Generate music based on natural language prompts using LLMs running locally