In Set 3D View, it's the viewpoint and view angle that are critical, regardless of the origin.
In perspective, the 'normal' cone of vision is about 60 degrees, so put the viewpoint quite far away and don't drag the cursor far, in the direction of the subject, once the viewpoint is set by the cursor, or there will be distortion.
Always use 'Normal', and not 'Current'. (Why are there options?)
And, Set Viewer Ht, or adjust real time.
And, always set the viewer ht. and look toward ht. at the same elevation, or you will suffer extreme parallax (3pt. perspective, for which the eye, or mind, under normal circumstances, corrects).
You sometimes/usually have to adjust the crop corner marks to get the image into view.
Much of the above could/should be set as VW defaults. This would make the process much easier, and then you could make editing adjustments later.
When you get it the way you want it, be sure you save the view, so as not to have to do this whole sequence again.
Once you get the hang of it, you'll realize it is all very subjective (like art), and you will experience less trial-and-error.