Commit d64e92c1 authored by Debargha Mukherjee's avatar Debargha Mukherjee
Browse files

Disable txfm domain dist for 64-pt transforms

Any 64-pt transforms only preserves half the coefficients.
Therefore transform domain distortion is no longer valid
for these transform sizes.

BUG=aomedia:1170

Change-Id: Ib99fad5497c766e2b9d2b432640c03cd49c99f50
parent 8d101833
......@@ -1908,6 +1908,12 @@ void av1_dist_block(const AV1_COMP *cpi, MACROBLOCK *x, int plane,
#endif // CONFIG_DIST_8X8
if (cpi->sf.use_transform_domain_distortion
#if CONFIG_TX64X64
// Any 64-pt transforms only preserves half the coefficients.
// Therefore transform domain distortion is not valid for these
// transform sizes.
&& txsize_sqr_up_map[tx_size] != TX_64X64
#endif // CONFIG_TX64X64
#if CONFIG_DIST_8X8
&& !x->using_dist_8x8
#endif
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment