A77 and Buttons
It's not you - it is complicated!
Gary Friedman has a table in his book where he lists what happens when the switch at the lens is set:
screw driver lens: camera has control
SSM lens: set to AF, camera has control, if it's set to MF it's MF
SAM lens: lens switch has control (AF means AF, MF means MF)
It's a confusing issue, but the book is great! (And so is the A77)