Okay, I tried something... If you hold down the left mouse key to grab and move an object in perspective view, you can simultaneously hold down the mouse-pan button, go to the opposite side of the screen (with the object now moved to the opposite side of the screen) and pan the view without dropping the object.
Then you can mooooove your object back over and continue.

So I know what I'm thinking about might work, it would just have to know you're going "over there" too without having to click and hold the mouse pan button.