I have the same problem and I think I know what wrong with your CM4. You have purchased CM4 with MMC and you should flash it: using SD card looks like won’t work.
Check put this thread: New uConsole won't boot up - #18 by qface
My IO board will arrive on friday and I will report here if this solves the issue.