Handheld for a shaky oldster?

My current kit  includes an X-T2, Tokina ATX-m 33mm f1.4, Tokina ATX-m 56mm f1.4, and Voigtlander X-mount Nokton 35mm f1.2. Qualifying as a member of the old as dirt club and on most days, I find it outrageous difficult to handhold the X-T2 with any of these lenses steady enough to get a decent in-focus shot. So my current options include setting up and using my Monopod, which doubles as a cane when I change the head, setting up my full-sized tripod, or finding something to brace the X-T2 against. Plus, since both the monopod and tripod have Arca-Swiss compatible ball heads, I have an Arca-Swiss dovetail baseplate on the X-T2, adding more weight. One result is that I will miss some great photo opportunities that are gone before I set up, even with the monopod, or get an out of focus shot not worth keeping.

So I'm considering two other possibilities  that may make handheld shooting a reliable option again and would like to hear any opinions on this.

1. I have my eye on two mint condition X-H1s. Neither X-H1 would be returnable if I bought it. While I realize the X-H1 is larger and heavier than my X-T2, it has IBIS and the question here is would the X-H1 IBIS keep the X-H1 steady enough for me to go back to handheld shooting?
2. I keep looking at the X-E4 / 27mm f2.8 kit, almost impossible to find, but I  keep wondering if it is small and light enough to easily handhold. Or is small and light harder to keep steady? If I go for the X-E4 kit, I would sell the X-T2 and both Tokina lenses, but keep the tiny Voigtlander MF lens and probably add the FX 18mm f2 lens.