Skip to content
  • Aℓex Converse's avatar
    variance aq: Fix a variance calculation overflow bug. · 8620dea8
    Aℓex Converse authored
    This is an actual overflow where the result of the calculation is
    materially changed, not just a negative value that is stored in an
    unsigned.
    
    Caught with fsanitize=integer on the VP9/AqSegmentTest.TestNoMisMatchAQ2/1 test.
    
    Change-Id: I514b0ef4ae7ad50e3e08c0079aa204d59fa679aa
    8620dea8