• Yunqing Wang's avatar
    Modify the setting of transform skip flags in non-rd mode · 268f260d
    Yunqing Wang authored
    While searching for the best mode in non-rd case, SSE of
    a partition block is calculated and the transform size is set.
    This patch rewrites the skip checking conditions based on
    transform size instead of partition size to be more precise.
    Small gains were seen in rtc set borg test (speed 6).
    AVG PSNR: 0.087%, overall PSNR: 0.073%, SSIM: 0.146%.
    No noticeable speed change.
    Change-Id: I5603ca5339c784dfa02263f4005988ccd8c32f6e