Commit 952eae29 authored by Yushin Cho's avatar Yushin Cho
Browse files

Use pixel domain skip error if possible in var-tx

When early skipped in var-tx, distortion is set the same as sse.
If so, use pixel domain sse (i.e. skip error) since is more accureate
than sse from transform domain.

Change-Id: Id3cbc66ea6318108c031413646f3d06250e75e7e
parent 2b2ad0fa
......@@ -4468,7 +4468,7 @@ void av1_tx_block_rd_b(const AV1_COMP *cpi, MACROBLOCK *x, TX_SIZE tx_size,
a, l, 1);
} else {
rd_stats->rate += rd_stats->zero_rate;
rd_stats->dist += RIGHT_SIGNED_SHIFT(tmp_sse, shift);
rd_stats->dist += tmp << 4;
rd_stats->skip = 1;
rd_stats->invalid_rate = 1;
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment