105 2.8 VR auto focus accuracy

I get accurate focus if the lens acquires auto focus from near to far but slightly off focus if the lens acquires focus from far to near. The camera is D800E, tested many times on tripod on buildings at long distance (about 2 miles away), and not in live view.

Is this a tip to get accurate focus or it's just my lens needs servicing?

Thanks.