I have Peak Design 5L, and I really like it so far. It is _very_ compact (for what it is), but I find that a big plus, being aware that it also means I probably can`t take everything I might have thought I may need...
That said, I can fit X-T3 and up to 4 lenses in it (one attached to the body and up to three extra) - and that should really be more than enough even for a moderate photo walk, not to mention a casual (non-photo oriented) one.
If we imagine the main compartment consisting of 6 "cells" (separated with two multi-fold dividers), X-T3 with a lens (18-55, for example) takes 3 "cells". Under the X-T3 body grip, I`m left with one separate "cell" for a smaller lens (like 23 f/2, Samyang 8mm, etc). On the opposite side, I have two connected "cells" for either two more smaller lenses, or one bigger (like Canon 100mm f/2.8L or Canon 135mm f/2, with Fringer adapter attached - I guess Fuji`s 50-140 should also fit).
Just for comparison, in your case where you carry the camera outside, the bag itself should be able to fit (almost) 6 smaller lenses, like your 23 f/2, but even bigger 18-55 could be fitted inside a single "cell" only (of 6 in total), paired with a small lens on top of it (separated with unfolded divider). Might be 3 bigger lenses wouldn`t fit together alone, each taking two cells vertically (full height of the bag) but needing some more width...?
But anyway, you get the picture - not sure how many lenses you need for a single casual outing, but if small size, convenient shape and inconspicuous looks are important, it doesn`t seem to get any better than Peak Design 5L.
Of course, at the end of the day, if you find that you just can`t fit in everything you _really_ need/want, then it`s clearly not for you, no need for anyone else to tell you that