• James Zern's avatar
    vp9_dsubexp: remove clamp in inv_remap_prob() · 8aaf5ec4
    James Zern authored
    the max value of the lookup in expanded form is:
    (((1 << 7) - 1) << 1) - 65 + 1 + 64 = 254
    
    remove the clamp [0, 253] and add one table entry
    
    Change-Id: I0b5d0c66702fdb0b8f1cc9ab9b0dac66326e85a6
    8aaf5ec4
vp9_dsubexp.c 2.91 KB