Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
Xiph.Org
aom-rav1e
Commits
0c1da40e
Commit
0c1da40e
authored
Jun 16, 2016
by
Yaowu Xu
Committed by
Gerrit Code Review
Jun 16, 2016
Browse files
Merge "Fix an ubsan warning: vp9_quantizer.c"
parents
799ab7c0
25110f28
Changes
1
Hide whitespace changes
Inline
Side-by-side
vp9/encoder/vp9_quantize.c
View file @
0c1da40e
...
...
@@ -94,7 +94,7 @@ void vp9_highbd_quantize_fp_c(const tran_low_t *coeff_ptr,
const
int
coeff_sign
=
(
coeff
>>
31
);
const
int
abs_coeff
=
(
coeff
^
coeff_sign
)
-
coeff_sign
;
const
int64_t
tmp
=
abs_coeff
+
round_ptr
[
rc
!=
0
];
const
u
int
32_t
abs_qcoeff
=
(
u
int
32_t
)((
tmp
*
quant_ptr
[
rc
!=
0
])
>>
16
);
const
int
abs_qcoeff
=
(
int
)((
tmp
*
quant_ptr
[
rc
!=
0
])
>>
16
);
qcoeff_ptr
[
rc
]
=
(
tran_low_t
)((
abs_qcoeff
^
coeff_sign
)
-
coeff_sign
);
dqcoeff_ptr
[
rc
]
=
qcoeff_ptr
[
rc
]
*
dequant_ptr
[
rc
!=
0
];
if
(
abs_qcoeff
)
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment