Kubernetes on Nix Community Organization

Hello,

This thread is to gather interest for Kubernetes on Nix. So far I am aware of a few others who are using either k8s or k3s on nix and I think it would be useful to create a centralized place to discuss issues and ideas. Currently there are no actively developed nix tools for managing cluster state and I think it would be good to either start a new tool or pickup one of the existing ones.

A matrix channel would be a great way to start this initiative but I’m unsure of how to go about getting one in the Nix space.

Pinging a few people who might be interested.
@euank
@superherointj
@Mic92
@bryanasdev000
@kalbasit

5 Likes

I’d like to register interest :slight_smile:

I personally run a small bare-metal Kubernetes cluster on NixOS (via the k3s module), and I’m looking to improve my setup and develop some tooling around managing it.

What you’re talking about sounds pretty closely related to that.

I’m using k3s as well! I would prefer to use this discourse as a central place to discuss… Having many matrix channels open is becoming …overwhelming.

I’m in the same boat as you as far as a bare-metal cluster. My idea for running applications is similar to helm where you define all your manifests and simply substitute variables where needed. Perhaps this is a good use case for nickel+nix? :thinking:

@azazel75
Maybe discourse works for now while we’re still in the planning phase but when it comes time for active development synchronous chatting will be essential. :grinning_face_with_smiling_eyes:

My idea for running applications is similar to helm where you define all your manifests and simply substitute variables where needed

Kubenix uses the module approach for configuring resources, which is nice, IMO. It does not appear to be maintained currently, and there apparently a few open PRs that need attention. But it still looks like an excellent starting point.

There was Kubenix: call to rejuvenate last year.

2 Likes

We use kubernixos https://github.com/DBCDK/kubernixos.

This seems like what I’m looking for. There’s that big PR that updates Kubernetes that looks like it’s been stalled :frowning_face:. I’ll add this link to my original post for visibility.

This weekend I’ll see if I can get this running on my local system and maybe we can go from there. Kubernixos looks interesting too but I’m worried about creating some mangled state with it but I don’t know much about it right now.

Edit: hmm looks like I can’t edit my original post. :thinking:

1 Like

For me the terraform abstraction seems to be good enough for k8s cluster state to not look into nix-based solutions too much, also I miss the nix module system in terraform.

Maybe @jmgilman Nixago project could help here. Also @blaggacao old ambition to dig kubenix/terranix for a builtin JSON schema validator.

Hosted by Flying Circus.