I have just tried and retried to boot your kernel using my existing install on the CM4. (I still have the previous kernel installed so I can still use it in my device.) But I get no response from the display even after a minute of power up. I might be doing my config.txt wrong.
Are there any tools I need to test for responses from the system?