X11 connection rejected

Hi,
This issue is also observed by nearly all of our lab members, including myself. This happens sporadically, sometimes it will be fine for days, and once in a while one of my ssh logins will continuously spew out this error message, while other simultaneously active logins will be fine. This happens when connected with -X or -Y and authenticated via a key or password. Also seems to be OS independent since I have observed this using ssh on Linux (Ubuntu 20.04), Mac OS (big sur), and Windows 10.
Best,
Halit