Skip to content
Snippets Groups Projects
Commit bb617786 authored by Yaowu Xu's avatar Yaowu Xu
Browse files

Change left shift to multiply

Negative distortion is used in trellis quant process for RDcost
computation, this change avoids compiler warning on "left shift
of negative values".

Change-Id: Iaea0ffebb6c9236e779e36301fbc69b180be1f3d
parent 568d0a9a
No related branches found
No related tags found
No related merge requests found
......@@ -29,7 +29,7 @@ extern "C" {
#define RDCOST(RM, R, D) \
(ROUND_POWER_OF_TWO(((int64_t)R) * (RM), AV1_PROB_COST_SHIFT) + \
(D << RDDIV_BITS))
(D * (1 << RDDIV_BITS)))
#define RDCOST_DBL(RM, R, D) \
(((((double)(R)) * (RM)) / (double)(1 << AV1_PROB_COST_SHIFT)) + \
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment