Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
Xiph.Org
aom-rav1e
Commits
34b0ee61
Commit
34b0ee61
authored
Sep 02, 2016
by
Yaowu Xu
Browse files
quantize.c: int->uint32_t for absolute values
Change-Id: I784f32e0e86d873655e46cf68c5c124a698af361
parent
1f9356a5
Changes
1
Hide whitespace changes
Inline
Side-by-side
aom_dsp/quantize.c
View file @
34b0ee61
...
...
@@ -416,7 +416,7 @@ void aom_highbd_quantize_dc(const tran_low_t *coeff_ptr, int n_coeffs,
const
int
coeff_sign
=
(
coeff
>>
31
);
const
int
abs_coeff
=
(
coeff
^
coeff_sign
)
-
coeff_sign
;
const
int64_t
tmp
=
abs_coeff
+
round_ptr
[
0
];
const
int
abs_qcoeff
=
(
int
)((
tmp
*
quant
)
>>
16
);
const
u
int
32_t
abs_qcoeff
=
(
u
int
32_t
)((
tmp
*
quant
)
>>
16
);
qcoeff_ptr
[
0
]
=
(
tran_low_t
)((
abs_qcoeff
^
coeff_sign
)
-
coeff_sign
);
dqcoeff_ptr
[
0
]
=
qcoeff_ptr
[
0
]
*
dequant_ptr
;
if
(
abs_qcoeff
)
eob
=
0
;
...
...
@@ -468,7 +468,7 @@ void aom_highbd_quantize_dc_32x32(const tran_low_t *coeff_ptr, int skip_block,
const
int
coeff_sign
=
(
coeff
>>
31
);
const
int
abs_coeff
=
(
coeff
^
coeff_sign
)
-
coeff_sign
;
const
int64_t
tmp
=
abs_coeff
+
ROUND_POWER_OF_TWO
(
round_ptr
[
0
],
1
);
const
int
abs_qcoeff
=
(
int
)((
tmp
*
quant
)
>>
15
);
const
u
int
32_t
abs_qcoeff
=
(
u
int
32_t
)((
tmp
*
quant
)
>>
15
);
qcoeff_ptr
[
0
]
=
(
tran_low_t
)((
abs_qcoeff
^
coeff_sign
)
-
coeff_sign
);
dqcoeff_ptr
[
0
]
=
qcoeff_ptr
[
0
]
*
dequant_ptr
/
2
;
if
(
abs_qcoeff
)
eob
=
0
;
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment