Well, that's gotta be driving you crazy! Click on the images of the screens in the control panel, you'll see you can drag them around so that they match your physical setup.
(This has nothing to do with calibration, I'm just helping before you tear out your hair )
Randomly when, exactly? After calibration again? Or just ... randomly?