How do you all set your monitor brightness when processing photos?

My desktop setup at work is a 27 inch imac and 2 27 inch apple displays. I used to do all my post-processing at full brightness, but the resulting photos are dim everywhere else. I moved it to 50% brightness, which is ok for some people and too bright for others. Am I needlessly obsessing over this? I googled around but I have a feeling I'm just not phrasing it properly.