I can’t reproduce the issue you’ve described on my system with a CM4 Lite 4GB, though I’m not using the kernel in this post but rather the 6.16.y kernel posted elsewhere. Here’s my $ uname -a:
Linux laika 6.16.1-1-rpi-clockwork-v8 #1 SMP PREEMPT Wed Aug 20 18:38:28 CEST 2025 aarch64 GNU/Linux
Could you post your current hardware configuration and system details?