you have to decide by how you treat your camera.
I like having the adapter on - that way when the lens is extended, the adapter is protecting it from bumps. If you bump the extended lens and put it out of alignment - erk! Could be bad news.
Because I carry mine turned on when I am bird hunting, I
might bump it against...myself? a bush? whatever! So with the adapter plus the uv filter, I feel I have protected my camera somewhat.
If you ever decide that you want to put a teleconverter, or wide angle or macro lens on , then you should look at Glitchbit's comment, and get a metal pemaraal adapter - it is much safer/ sturdier to attach any lens to.
I have an FZ20 with the pemaraal adapter, and I use that with my Tcon, wcon, and mcon lenses. It is much heavier though, and I want to keep the fz7 as light as possible, thats why I bought it!
--
---------
Lynn