Using pre AFL lenses on the D5100 or 3100

I'm thinking of upgrading from my D40 to one of the 16 megapixel startup Nikons like the D5100 or the D3100. I have a lot of pre AFL lenses that I use manually on the D40. Will I still be able to use those lenses without damaging the camera if I upgrade?

--
Nikon D40 with Nikkor 50mm 1.8D, Nikkor 10.5 mm fisheye, NikkorQ 35-70mm f3.5, Nikkor Q 135mm f3.5, Vivitar 28 mm f2.5, ProOptic 500 mm f6.3 mirror lens