I owned the older kit mk2 18-55 kit, and now a Tamron 17-50, but I have done several comparisons of online samples of the new IS kit and the 17-55 F2.8 IS as well. From what I have seen, the new IS kit has greatly improved sharpness, but contrast, color, bokeh and AF haven't really seem to be improved. When I compared the my Tamron to my kit, I found everything to be better on the Tamron, except the field curvature, but on the originial kit, The kit was still softer in the corners than the Tamron's field curvature made it appear.
Is the 17-55 F2.8IS worth 6x the cost of the 18-55 F3.5-5.6 IS? That's a matter of opinion and usage. It's kind of like askingis the 85mm F1.2L worth 4x the price of the 85mm F1.8. For me, I like having F2.8 available at all focal lengths, and excellent IQ about 2/3 - 1 stop down. The Tamron 17-50 F2.8 and Canon 17-55 have that. The kit is quite a bit slower, 2/3 - 2 stops. Outdoors, it's not a big difference as far as lighting, but for DOF, bokeh, contrast, and color, there is a more significant difference.
The Tamron is an excellent in between IMHO. It's 2x the price of the kit, you sacrifice IS, but get F2.8 and better IQ. I also have better luck with the AF of my Tamron than my Canon non-IS kit once I got a copy that focused properly at wide angle. Now, is the Canon 17-55 F2.8 worth 2.5x the price of the Tamron? It adds IS and USM and has a flatter focus plane, yet it is bigger and heavier.
So my conclusion is, as most probably found as well, it depends on budget, usage, etc.
--
Main Albums:
http://picasaweb.google.com/Carskick/
Older Albums:
http://www.flickr.com/photos/carskick