Just the answer I'm looking for. So the presence of mirror mostly affect the form factor and user experience, while image quality affected mostly by sensor size and quality. Got it. Thanks!
I'm going to disagree with those that assert that image quality is the same between dSLRs and MILCs.
Image quality is more then the product of sensor characteristics. It depends also upon autofocus systems, metering, lens attributes, processors and technique, among many factors. It is more or less true that there should be no inherent difference in image quality due to sensors between dSLRs and MILCs, nor due to metering or processors. Areas where there can be a difference in image quality between MLCs and dSLRS include autofocus systems, lens attributes and technique.
MILCs use on-sensor contrast detect autofocus systems. These tend to be slower but more accurate than the phase detect autofocus systems dSLRs use with their mirrors. MILCs currently are more likely to miss focus on moving targets than dSLRs. MILCs will tend to focus more accurately on stationary targets. The current difference in performance wrt moving targets seems to be more significant than the difference wrt stationary targets.
The optical viewfinder in dSLRs presents a truer colour and higher resolution view of the composition, with no lag. The EVF in MILCs can present a more representative view of how the photograph to be taken will look. EVFs lag. EVFs can overlay more information on the image, rather than around it. EVFs tend to black out as the picture is being taken for longer than OVFs, except at slow shutter speeds. The net result is that it is harder for a photographer to track rapidly moving subjects with an EVF, but easier for photographers to visualize the final product of an immobile scene with an EVF.
Mirrorless systems currently have few specialty lenses, like long telephotos, macros, tilt-shift, and defocus control lenses. If you need one of these to get the shot, you might have to shoot a dSLR. Mirrorless camera lenses tend to cost more for equivalent performance, due to differences in market size and market penetration. Wide-angle lenses for mirrorless can be a bit smaller than equivalent lenses for dSLRs. Even excluding specialty lenses, dSLRs have a wider and deeper range of lenses available (more focal lengths and focal length ranges, and more variation for a given length/range).
Mirrorless systems tend to be smaller and lighter when using normal or wide-angle lenses. This means they can be more easily transported to a site. The larger and heavier dSLR is often easier to hold because of the bigger grip, and having more inertia to overcome reduces camera shake. OTOH, prolonged handholding of a heavier cameras can increase cameras shake due to muscle fatigue. Composing handheld from the LCD screen on either mirrorless or dSLR tends to increase camera shake due to a less stable hold. DSLR's larger bodies have more room for external controls. Larger bodies without EVFs tend to have significantly longer battery life.
One last thing to consider is that the size of the sensor has a significant effect on image quality. The comparisons above hold true between MILCs and dSLRs of identical sensor size. There are relatively few full frame mirrorless cameras, lots of mirrorless cameras smaller than APS-C and no current dSLRs smaller than APS-C. In general, all current dSLRS and any current mirrorless cameras larger than micro four thirds will have superior still image quality due to sensor characteristics, compared to current micro four thirds mirrorless cameras. In general, current FF cameras will have better IQ than current APS-C cameras. An exception to this size equivalency is that the best current FF dSLRs seem to be better than the few currently available FF MILCs in most still image applications.
The takeaway should be that image quality is not the same between dSLRs and mirrorless. Sometimes one is better and sometime the other.