Skip to content
GitLab
Menu
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
Xiph.Org
aom-rav1e
Commits
438b1dcb
Commit
438b1dcb
authored
Oct 04, 2016
by
Alex Converse
Committed by
Gerrit Code Review
Oct 04, 2016
Browse files
Merge "ext_tx: fix a signed overflow" into nextgenv2
parents
2b476289
aa77b516
Changes
1
Hide whitespace changes
Inline
Side-by-side
av1/encoder/dct.c
View file @
438b1dcb
...
...
@@ -1871,7 +1871,7 @@ void av1_fwd_idtx_c(const int16_t *src_diff, tran_low_t *coeff, int stride,
const
int
shift
=
bs
<
32
?
3
:
2
;
if
(
tx_type
==
IDTX
)
{
for
(
r
=
0
;
r
<
bs
;
++
r
)
{
for
(
c
=
0
;
c
<
bs
;
++
c
)
coeff
[
c
]
=
src_diff
[
c
]
<<
shift
;
for
(
c
=
0
;
c
<
bs
;
++
c
)
coeff
[
c
]
=
src_diff
[
c
]
*
(
1
<<
shift
)
;
src_diff
+=
stride
;
coeff
+=
bs
;
}
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment