Commit aa77b516 authored by Alex Converse's avatar Alex Converse

ext_tx: fix a signed overflow

Change-Id: I9a08bc5da1a84c3d4b8fe2d457bb80406c0bc028
parent 42bc3a9e
......@@ -1871,7 +1871,7 @@ void av1_fwd_idtx_c(const int16_t *src_diff, tran_low_t *coeff, int stride,
const int shift = bs < 32 ? 3 : 2;
if (tx_type == IDTX) {
for (r = 0; r < bs; ++r) {
for (c = 0; c < bs; ++c) coeff[c] = src_diff[c] << shift;
for (c = 0; c < bs; ++c) coeff[c] = src_diff[c] * (1 << shift);
src_diff += stride;
coeff += bs;
}
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment