E-M5 focus point won't stay where I put it!!!!

Yes, touch screen is turned off completely. There is no icon on the screen for the touch screen - I was aware that the way I carry the camera around my neck with the screen hitting close to my belt buckle, I could inadvertently change settings so I've been using the camera with touch screen disabled.
--
1943Mike