that’s not the QMK issue itself (probably it could reconnect usb device though), but hardware’s uconsole’s. Seems like less problem on CM4 than on CM5.
and seems like there is a solution, feel free to try on your own risk: Fixing uConsole power delivery limitations with CM5 - #16 by QuantumKraken