I noticed VRR works on the desktop which enables "Low Framerate Compensation" due to the low frame rate causing the desktop to flicker. On Windows the screen just locks itself at the selected refresh rate until games are launched. This occurs on both AMD and Nvidia cards using Vesa Adaptive Sync with monitors that support Low Framerate Compensation.
I noticed this happens on Budgie, Gnome and Plasma along on Solus. I did notice this issue on other distributions but also a few distributions with the expected behavior of the desktop just staying at the selected refresh rate. KDE Neon, Fedora 32 and openSUSE Tumbleweed are the distros I've noticed with the expected behavior using KDE Plasma and Gnome.