I've also been having a couple issues with glitchy display behavior along these lines but unsure if the causes/solutions are the same. The issues occurred with version 2019 and appear to continue in version 2020. I checked my graphics card and it is operating without issues and has the latest updates. For reference, the file size is about 78 MB. Here are the issues:
1. After working in my file for a few minutes and clicking into either a "saved view" or directly onto a design layer, only the active design layer will appear, even though the layer options are set to "Show/Snap/Modify Others". When I move my cursor over the missing site elements, they become highlighted but are otherwise not showing (see snapshot attached). Also note the blue screen background that sometimes appears with this problem but not always. The only way to correct the issue to set the layer options to "Active Only" at which point the graphic display shows the information I am asking for without the blue background. That said, when I pan the view of the screen with layer options set to "Show/Snap/Modify Others", the graphic display corrects itself (correct design layers showing w/out blue background) but only while panning and goes back blue background with disappearing layers when I stop panning. Note that the lines appearing in the snapshot for some reason are not from the active design layer. I don't have any issues with sheet layers.
2. The other issue is that when I rotate the model into an orthogonal view, the active design layer's view rotates but other layers appear to stay in plan view. See other attached snapshot.