Can I live with the X100s as my only camera?

Hi

I have been into photography for some years now. I started as most other people with a simple Canon P&S and last year I ditched the Canon to get a Sony A57. First of all, I love the camera, however I find it too bulky and heavy for my casual trips and travel photography. I often find myself taking photos in the streets and some landscape. I also travel quite a lot with family and friends, and it is important to me that I can capture all those special moments with as good image quality as possible.

The last couple of months there has been a growing tendency for me to bring only the crappy old Canon Ixus 75, because I don't want to be lugging the heavy DSLR.

So my question is: Can I really live with the X100s as my only camera? What kind of gear do other people that carry these cameras have in their arsenal?

Of course i will always have my trusty P&S as a backup, but I can't imagine the reach of that thing is not going to be compensated by a step forward/backwards.

What do you guys think?