Beginner's question: opinion on cropping

There is one situation where I will take a photograph in which I actually plan the cropping as I take the photograph. This situation occurs whenI use an ultra wide lens to capture a tall object from close up, say a church from the opposite side of a street. It can be captured at 10mm but if taken horizontally will fill half the picture with the street, a large area of black tarmac rarely adds to a composition.

On the other hand if I tilt the camera to exclude the street I get a case of extreme verticals. The answer is to photograph horizontally to capture the best image possible of the church but knowing that the bottom half of the photograph will be removed in post processing to create the desired image.

Of course if you could afford it the best answer would be to buy a tilt/shift lens but not everyone can justify that expense.

Another alternative would be to tilt the camera, accept the converging verticals and remove them with Photoshop but that would require even more post processing manipulation than cropping.