Restore tests speed_test and end_to_end test since
quant matrices are not on by default.

Change-Id: I0baa649a91e83d62acaca099670671e0406a46ab