It’s simple to make trackball mode controlled by Fn key status rather than the middle click status.
in trackball.ino, change:
const auto mode = dv->state->moveTrackball();
to:
const auto mode = dv->Keyboard_state.fn_on == 0 ? TrackballMode::Mouse : TrackballMode::Wheel;