Should commercial actors ship telemetry in nixpkgs?

The interest here is to improve the generation to give more accurate results over time.

Here’s the table of what we collect into an sqlite database:

CREATE TABLE `runs`(
	`id` INTEGER NOT NULL PRIMARY KEY,
	`source` TEXT NOT NULL,
	`duration_sec` INTEGER NOT NULL,
	`finished_at` TIMESTAMP NOT NULL,
	`devenv_nix` TEXT NOT NULL,
	`devenv_yaml` TEXT NOT NULL
);

The issue with AI models is that they are extremely unpredictable, so when you update to a newer model you need to understand if the results you’re getting are at least equally good.

That’s not an easy task to do, given that the output from AI is non-deterministic.

The interest here is that the results get more accurate over time and AI generation is something I pay out of my pocket and is offered for free.

Do you think that maybe users of devenv might benefit from the work we’re doing?

Or do you believe we have some ill intentions, and which?

Domen

1 Like