the only way I found, just wait… I clicked out the SD card once, and it seemed to go faster, but honestly not sure if that might have been just been a cooincidence.
The new boards by @vileer have an option to install a hard switch though, see here: https://forum.clockworkpi.com/t/hackergadgets-uconsole-upgrade-kit-adding-nvme-ssd-pcie-rj45-ethernet-and-usb-3-0-to-your-uconsole/