I’ve played with the binary overlays and rPi kernels and now I think the solution to this is to bring back the old way of applying overlay to all raspberrypi overlays without checking for compatible as the binary rpi overlays are all using compatible brcm,bcm2835.
I think I’ll reintroduce the old way as hardware.deviceTree.raspberrypi.overlays as it is quite rPi specific.