Remove undefined behaviour (right-shifting a negative integer) from
the scaler... replace with divide-by-2.  Any modern compiler should
be able to optimize that.

On the enabling the compiler front, const-ify more variables and
use types that allow removing some casts.

I have a bit more hope this will fix the macOS issue than the previous
efforts.