Skip to content
  • Peter de Rivaz's avatar
    Prevent negative variance in 10/12-bit. · e0794b51
    Peter de Rivaz authored
    Due to rounding the variance can become negative.
    Similar behaviour has been fixed in commit b7e7c044.
    I have made the corresponding changes to the masked_variance code.
    
    BUG=aomedia:646
    
    Change-Id: I21ed5a3f58080def08ac7ab9a77cbcad90318c99
    e0794b51