I've had for a long time a D2Hs and D700. No D3s but I see how it is.
Now I have a GX85 so I can compare.
1-digit-D (and to some extent D700) are built like tanks. They have all the possible controls with dedicated buttons/levers/switches, and that's amazing. I can tell you already that you gonna miss that. Going with a GX85 can be a little brutal and I'm afraid you will be frustrated. I strongly suggest to go for something with more controls like GX8, G85 or Oly EM1.
Beside that, MFT offers a lot of amazing features that you can't even dream of with your DSLRs. Face/eye AF, focus peaking, AF points all across the frame, focus bracketing... The latest Panasonics also have a better low light AF than those Nikons (although they where the best of the world at the time of their release). So beside price and weight, feature-wise you will gain a lot with MFT.
Now the most important: IQ.
Resolution-wise, any 16 or 20 mpx MFT camera will easily beat your Nikons at low ISO. The 12-32mm has an impressive center sharpness even wide open, it's a good lens to start with. BTW if you want a fast wide prime, I suggest the PL 15mm f1.7. Small, fast, sharp and excellent contrast. If you want wider, the Oly 12mm f2 is extremely sharp across the frame wide open.
So at low ISO, advantage to Panasonic. But beyond 1600 ISO, the old 12mp Nikon sensor paired with a good lens and a little PP can still beat MFT, being able to better retain some small details... Subjectively, I also find that the files from the Nikon have a better color gradation. I have found that skin tones, for example, can be tuned more precisely (when shooting RAW). For architecture and real estate, though, I'd take Panasonic over Nikon without hesitation. For events, unless you have very high expectations on skin tones rendering, MFT will do the job as well.
I use MFT 90% of the time (because most of my pictures don't need extreme color accuracy and are only published online), it's so small that I can carry it anywhere and I really have fun using it. For more serious works, I use a Sony A7II who combines the features of a mirrorless camera with the IQ of FF. But it's noticeably heavier and bigger than MFT and much more expensive...
If you have any specific question, feel free to ask.