Commit 438b1dcb authored by Alex Converse's avatar Alex Converse Committed by Gerrit Code Review
Browse files

Merge "ext_tx: fix a signed overflow" into nextgenv2

parents 2b476289 aa77b516
......@@ -1871,7 +1871,7 @@ void av1_fwd_idtx_c(const int16_t *src_diff, tran_low_t *coeff, int stride,
const int shift = bs < 32 ? 3 : 2;
if (tx_type == IDTX) {
for (r = 0; r < bs; ++r) {
for (c = 0; c < bs; ++c) coeff[c] = src_diff[c] << shift;
for (c = 0; c < bs; ++c) coeff[c] = src_diff[c] * (1 << shift);
src_diff += stride;
coeff += bs;
}
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment