This is undefined behaviour in C99 and could mislead the optimizer.
This fixes the ubsan warning, and still generates optimal code
(i.e an inlined 'sar' instruction).

Change-Id: I36b20a6780532b8c9379b9fbfd970933d56b1bc5