Commit e0794b51 authored by Committed by Debargha Mukherjee
Prevent negative variance in 10/12-bit.
Due to rounding the variance can become negative. Similar behaviour has been fixed in commit b7e7c044. I have made the corresponding changes to the masked_variance code. BUG=aomedia:646 Change-Id: I21ed5a3f58080def08ac7ab9a77cbcad90318c99
Showing with 12 additions and 4 deletions