Which is more damaging: Increasing Exposure or Decreasing it?

I hope this answer isn't as simple as I anticipate it to be.

If I have a dim image and I increase the exposure in Photoshop and I have an overexposed image that I decrease the exposure of, which image is more "damaged" (which image loses more resolution)?