I had this trouble after some wear on the trackball (have been using the DevTerm somewhat heavily) and eventually had to replace the trackball (see The Cheapest Keyboard Hardware Mod - #9 by omgmog for information). Basically, the ball spins and there are some tiny gears and sometimes it doesn’t generate enough friction. You might be able to fix it by cleaning if you’re very careful.