EM-5 Focus Area Keeps Moving

I think I am somehow unintentionally hitting the arrow button on the back of my OMD EM5 with my palm moving the area of focus. I have to keep going back and moving it back to the center of the frame. Is there a way to prevent this from happening?