If that is your opinion please communicate that directly next time. The way this was structured as an answer to chemonke led me to believe that you implied that this applied specifically to repeated contributors as an issue of trustworthiness, not generally to everyone as an issue of capability.
Edit: I apologize that came out harsher than intended.
I wonder how this thread will look in 5 years. We are far past the point whether LLMs are useful. Outright banning LLMs will leave NixOS project boxing with one arm behind the back. And I think this poll all but helps bringing discussion about the real issues (I am guessing that sloppy overly large PRs are one), instead it polarizes people further. Of course that was not the author’s intent.
LLMs won’t replace judgement. An idiot with a tool is still an idiot. Yet I sense here deeply religious sentiments. It sounds to me like how some people would like to keep Nix/NixOS an elitist project for those with Masters Thesis in pure functional programming.
I think I would have given up NixOS without LLMs that have been hugely useful in debugging my config and helping me to grasp the Nix-language.
I love the idea of Nix and NixOS. My biggest concern have always been the community “culture wars”.
I disagree with LLMs being anywhere near this project, but ive madw that abundantly clear.
I will respond to one thing:
It sounds to me like how some people would like to keep Nix/NixOS an elitist project for those with Masters Thesis in pure functional programming.
No, in fact I dont have a masters degree myself. I was planning to, but I couldnt stand the bullshit.
A lot of folks that are well respected dont have a masters degree, many dont have a bachelor either. Education isnt a requirement to participate and never will be.
I am sorry that you had to resort to LLMs to debug your config. I view that as a failure of the Nix community in two different ways:
Our documentation wasn’t sufficient to help you
We didn’t build a friendly enough space for you to reach out
Please reach out to a human instead of an LLM, we would all be happy to help you and perhaps build a friendship on a mutual interest (Nix or other things).
Just why would I reach out to the community where even a quick answers mean 30min of waiting if my option is to ask LLM and get an immediate answer?
NixOS documentation leaves a lot to hope for, yet the repo itself is very understandable by the LLMs. I’m a person who always wants to understand how things work instead of outsourcing all thinking to LLMs. I use LLMs to learn and ask them references to documentation or source code.
And why does it bother you if my LLM-assisted configs are applied to the computers I own? It’s kind of my private matter, isn’t it? I get it it’s a different thing if I start to contribute sloppy AI-PRs to NixPkgs. I definitely won’t do that.
And apologies for sounding bit hostile. From my point of view people seeking to “ban LLMs” indirectly are about “to take NixOS away from me”. NixOS is a big deal for me. I have used Linux since 1996 and tried many distros. Yet NixOS blew my mind and I fell in love with it.
Just why would I reach out to the community where even a quick answers mean 30min of waiting if my option is to ask LLM and get an immediate answer?
Because we would be happy to help you and the reason why i know so many great folks online and many now offline, is because I asked for help. I am just worried about what we’re loosing as a community and society by talking to statistical models instead of each other.
NixOS documentation leaves a lot to hope for, yet the repo itself is very understandable by the LLMs. I’m a person who always wants to understand how things work instead of outsourcing all thinking to LLMs. I use LLMs to learn and ask them references to documentation or source code.
Every person asking an LLM burns energy and their money instead of us having docs and everyone being able to cheaply seatch those. Generating the docs with an LLM would still be better for the environment than everyone asking their own LLM.
NixOS documentation leaves a lot to hope for, yet the repo itself is very understandable by the LLMs. I’m a person who always wants to understand how things work instead of outsourcing all thinking to LLMs. I use LLMs to learn and ask them references to documentation or source code.
I mean as you said, I don’t. I would for my own code, because code I write I license under a strong copyleft license, which should prohibit training an LLM on said code, who am I to know that by copy pasting my code into a LLM they don’t treat it as free real estate for training .
But in the nixpkgs I truly shouldn’t care and don’t have the right to prohibit you anyway. But as I have said, i fear what we’re loosing here as a society and community.
And apologies for sounding bit hostile. From my point of view people seeking to “ban LLMs” indirectly are about “to take NixOS away from me”. NixOS is a big deal for me. I have used Linux since 1996 and tried many distros. Yet NixOS blew my mind and I fell in love with it.
No worries, you did sound a bit hostile, but so do I a lot of the time
This anti-LLM mood feels a lot like the old monolithic vs microkernel, Linux vs BSD, Vi vs Emacs arguments. I am also concerned of LLM use without human judgement and getting flooded buy sloppily written documents, emails and messages. But yet LLMs are technical progress and very useful when used correctly. The fight against LLMs is a futile fight against the windmills.
This sentiment resembles the emergence of other technologies like how e.g. UK introduced a “Red Flag Law” (Locomotives Act 1865) when the first self-propelled (steam) vehicles emerged at the roads requiring a red flag being carried in front of the vehicle. I would love to see the focus being in how LLMs could be useful and how to limit the adverse effects. My 50c.
This sentiment resembles the emergence of other technologies like how e.g. UK introduced a “Red Flag Law” (Locomotives Act 1865) when the first self-propelled (steam) vehicles emerged at the roads requiring a red flag being carried in front of the vehicle. I would love to see the focus being in how LLMs could be useful and how to limit the adverse effects. My 50c.
And wouldn’t you know it, the red flag law was correct. Personal cars should be banned from all cities. The earth is here for creatuers (including humans) to walk on, not cars to drive on.
Unclear, published Nix configs seem to be easier to average into something pointing to the correct function of the source code than the talking-past-each-other flamewars or firehose ten-lines-of-discussion-hashed-together (and I don’t think there are any large Nix-related discussion channels that are on the open web but don’t have either property)
I would imagine that help questions and answers would be more closely associated with each other, and data from these threads, while presumably part of the same dataset, would likely not be invoked. But I haven’t looked deeply into the implementations of these models in the last few years, so my knowledge might be outdated on that All I’m familiar with is their output and very high-level theory, which from experience, requires massive cleaning up and double-checking to the point that I haven’t found them acceptable for use in a large complex codebase with limited training data (especially given a fair % of nix code on github doesn’t eval).
EDIT: to be clear, my knowledge of LLM output is not outdated, as I observe it daily. I just have not read the maths papers backing their design.
I really wish we could all try to learn from each other a bit more rather than driving this community to further polarization. I was thankful to learn about the cognitive decline studies posted earlier in this thread, for instance, and the discussion of differing environmental impacts of self-hosted vs frontier-lab models was also thought-provoking to me. It makes me very sad how many messages in this thread are not willing to engage in good faith.
This all feels far too familiar as someone who was raised as a conservative Christian and had to learn that in fact the people I was told to hate as a kid are not actually evil.
On a more constructive note, I’d really recommend the book High Conflict by Amanda Ripley. It’s helped me reframe how I think about these sorts of “hill to die on” situations.
This thread isn’t about the ethical dilemmas of LLMs. If you want a reasoned critique on those, they are all bad, as they rely on abusive labour practices. This is about whether to use LLMs in nixpkgs and I can verifiably say they are woefully inadequate from observing them at work and the slop on github. That’s not outdated since I am observing it every day…
Let’s keep religion out of this (as multiple people insist on bringing up for some reason) and keep in the regular plane of conversation.
EDIT: not engaging with pointless ad hominems. Stick to facts, or get blocked.