XDG Portal unable to be setup without gnome

Hello!

I was wanting to finish moving away from gnome and swapped my greeter but when i removed my gnome configuration, my XDG portal configuration completely broke, with the time for the service taking well over a minute and places such as discord being unable to find it, stating
Failed to create settings proxy: Error calling StartServiceByName for org.freedesktop.impl.portal.desktop.gtk: Timeout was reached
and

Jan 09 01:08:40 jericho dbus-daemon[1894]: [session uid=1000 pid=1894] Activating via systemd: service name='org.freedesktop.portal.Documents' unit='xdg-document-portal.service' requested by ':1.6' (uid=1000 pid=2045 comm="/nix/store/8n6dj7s695glyfpg52px9dsmhvggs291-xdg-de")
Jan 09 01:08:40 jericho dbus-daemon[1894]: [session uid=1000 pid=1894] Successfully activated service 'org.freedesktop.portal.Documents'
Jan 09 01:08:40 jericho dbus-daemon[1894]: [session uid=1000 pid=1894] Activating via systemd: service name='org.freedesktop.impl.portal.desktop.gnome' unit='xdg-desktop-portal-gnome.service' requested by ':1.6' (uid=1000 pid=2045 comm="/nix/store/8n6dj7s695glyfpg52px9dsmhvggs291-xdg-de")
Jan 09 01:08:40 jericho dbus-daemon[1894]: [session uid=1000 pid=1894] Activating via systemd: service name='org.gtk.vfs.Daemon' unit='gvfs-daemon.service' requested by ':1.9' (uid=1000 pid=2082 comm="/nix/store/7smqhblgm57ndps0p7sgrbv4nhv499if-xdg-de")
Jan 09 01:08:40 jericho dbus-daemon[1894]: [session uid=1000 pid=1894] Successfully activated service 'org.gtk.vfs.Daemon'
Jan 09 01:08:40 jericho dbus-daemon[1894]: [session uid=1000 pid=1894] Successfully activated service 'org.freedesktop.impl.portal.desktop.gnome'
Jan 09 01:08:40 jericho dbus-daemon[1894]: [session uid=1000 pid=1894] Activating via systemd: service name='org.freedesktop.impl.portal.desktop.gtk' unit='xdg-desktop-portal-gtk.service' requested by ':1.6' (uid=1000 pid=2045 comm="/nix/store/8n6dj7s695glyfpg52px9dsmhvggs291-xdg-de")
Jan 09 01:09:30 jericho dbus-daemon[1894]: [session uid=1000 pid=1894] Successfully activated service 'org.freedesktop.portal.Desktop'
Jan 09 01:10:40 jericho dbus-daemon[1894]: [session uid=1000 pid=1894] Failed to activate service 'org.freedesktop.impl.portal.desktop.gtk': timed out (service_start_timeout=120000ms)

This is my configuration.

    enable = true;
    configPackages = [
      pkgs.gnome-session
    ];
    extraPortals = [
      pkgs.xdg-desktop-portal-gnome
      pkgs.xdg-desktop-portal-gtk
    ];
  };

I tried wlr.enable and xdgOpenUsePortal but sadly neither helped.

If it helps I was using Niri with the ly greeter when trying to move away from gnome and niri + gnome + gdm otherwise.

Any help would be appreciated

Update: ly breaks xdg portal for whatever reason, using something else like gdm works.