Hi Roland,
I have been having the exact issue as well. It started with 2023 and has continued through SP1 and SP2. My setup is similar to yours, v2023, MacBook Pro, M1 Max chip, Mac Ventura 13.0.1. For myself nearly all of my details become unreadable as the callouts get huge. See attached, left image is before and right image is after. I too have found the workaround is to ungroup any symbol but this results in the loss of the symbol functionality. Sorry to say but I am glad you reached out, at least this is not a singular case.
Anyone out there who has some suggestions?