Question about the Wide-Angle adapter and lens filter

Hi.

I think I know the answer (no) -- but will ask anyway....

I have a B&W UV filter on the x100 to protect the glass  -- and just ordered the WCL-x100 today.

Is it reasonable to leave the filter on the 23mm lens and screw the adapter on over?

I envision myself using the adapter on/off frequently based on my needs - but won't want to keep messing with the filter (and I'm more concerned about the attached lens then the adapter)

Thanks.....