Why does nouveau GSP fail with 'invalid native reply 0x03' on RTX 2000 Ada DP-5, preventing third monitor detection?

Subject: RTX 2000 Ada Generation - Continuous DP-5 DisplayPort GSP failures preventing multi-monitor setup

Summary

Nouveau driver experiencing continuous DisplayPort communication failures on RTX 2000 Ada Generation GPU, specifically on DP-5 port. The GSP (GPU System Processor) repeatedly fails with command 0x00731341, resulting in “invalid native reply 0x03” errors. This prevents reliable multi-monitor detection and may cause display instability.

Hardware

  • GPU: NVIDIA RTX 2000 / 2000E Ada Generation (AD107GL) (rev a1) [PCI 01:00.0]
  • Architecture: Ada Lovelace (AD107)
  • System: NixOS 25.05 (Warbler)
  • Kernel: 6.16.12
  • Driver: nouveau

Current Display Setup

  • DP-4: 1920x1080 (working normally)
  • DP-5: 3840x1080 ultrawide (working but with continuous errors)
  • Third monitor: Not detected (likely due to DP communication issues)

Problem Details

Continuous kernel errors occurring every few seconds:

nouveau 0000:01:00.0: gsp: cli:0xc1d00001 obj:0x00730000 ctrl cmd:0x00731341 failed: 0x0000ffff
nouveau 0000:01:00.0: [drm] *ERROR* DP-5: invalid native reply 0x03

Pattern observed:

  • Errors occur in clusters every ~30 seconds
  • Always on DP-5 port specifically
  • GSP command 0x00731341 consistently failing
  • Error code 0x0000ffff suggests communication timeout/failure

Impact

  1. Third DisplayPort monitor not detected by xrandr
  2. Potential display instability (flickering, disconnections)
  3. System log spam (continuous error messages)
  4. Unreliable multi-monitor configuration

Expected vs Actual

  • Expected: All connected DisplayPort monitors detected and stable
  • Actual: Only 2/3 monitors detected, continuous DP communication errors

Technical Analysis

  • GSP command 0x00731341 appears to be DisplayPort-related control command
  • “Invalid native reply 0x03” suggests DisplayPort AUX channel communication failure
  • RTX 2000 Ada is very recent hardware (2024) - potential firmware/support issue
  • Issue specific to DP-5 port while DP-4 works normally

Reproduction Steps

  1. Connect RTX 2000 Ada Generation GPU to system
  2. Connect multiple DisplayPort monitors
  3. Boot with nouveau driver
  4. Observe continuous kernel errors in dmesg
  5. Third monitor not detected in xrandr output

System Information

  • Distribution: NixOS 25.05 (BUILD_ID: 25.05.20251017.81b927b)
  • Kernel: Linux 6.16.12 #1-NixOS SMP PREEMPT_DYNAMIC
  • Nouveau module: loaded successfully, basic functionality working
  • X11: Working with detected monitors

Additional Context

  • This is likely new hardware support issue rather than regression
  • RTX 2000 Ada uses newer GSP firmware requirements
  • Similar Ada Lovelace GPUs may experience same issue
  • Issue prevents proper multi-monitor professional workflows

Firmware Information

Nouveau module references these firmware files:

  • nvidia/gp100/acr/ucode_load.bin
  • nvidia/gp100/acr/bl.bin
  • nvidia/gm206/acr/ucode_load.bin

(Possible missing Ada-specific firmware)

Sample Error Log

[ 1007.424520] nouveau 0000:01:00.0: gsp: cli:0xc1d00001 obj:0x00730000 ctrl cmd:0x00731341 failed: 0x0000ffff
[ 1007.424525] nouveau 0000:01:00.0: [drm] *ERROR* DP-5: invalid native reply 0x03
[ 1007.431884] nouveau 0000:01:00.0: gsp: cli:0xc1d00001 obj:0x00730000 ctrl cmd:0x00731341 failed: 0x0000ffff
[ 1007.431886] nouveau 0000:01:00.0: [drm] *ERROR* DP-5: invalid native reply 0x03
[ 1007.439248] nouveau 0000:01:00.0: gsp: cli:0xc1d00001 obj:0x00730000 ctrl cmd:0x00731341 failed: 0x0000ffff
[ 1007.439250] nouveau 0000:01:00.0: [drm] *ERROR* DP-5: invalid native reply 0x03

Display Configuration

Screen 0: minimum 320 x 200, current 5760 x 1080, maximum 16384 x 16384
DP-4 connected 1920x1080+0+0 (normal left inverted right x axis y axis) 597mm x 336mm
DP-5 connected 3840x1080+1920+0 (normal left inverted right x axis y axis) 1190mm x 340mm
DP-6 disconnected (normal left inverted right x axis y axis)
HDMI-1-1 disconnected (normal left inverted right x axis y axis)
DP-1-1 disconnected (normal left inverted right x axis y axis)

Severity

High - Prevents proper multi-monitor setup on professional GPU hardware

Keywords

nouveau, ada-lovelace, ad107, displayport, gsp, rtx-2000, multi-monitor