Configure how xdg-open opens html files?

Do you mean whatever program was using xdg-open should have checked the BROWSER environment variable first instead? Because setting the BROWSER environment variable doesn’t seem to have any effect on xdg-open AFAICS.