• Paul Wilkins's avatar
    Use 64 bit to accumulate frame sse. · a3c1a9b4
    Paul Wilkins authored
    When testing frame sse to choose a loop filter value and
    when checking ambient error in kf Q selection, use 64 bit
    values for accumulating the sse, to avoid risk of overflow
    for large image formats.
    
    Change-Id: I03765d16c843d0ade61a45b0cd46312472697e57
    a3c1a9b4
vp9_encoder.h 17.3 KB