• Urvang Joshi's avatar
    Revert of "Mark bogus palette color probabilities as zero". · eb54e0cd
    Urvang Joshi authored
    Reverted commit: f8306bfd (with some changes).
    Reason: This was triggering an assert in debug build because of zero
    probability values. So, using an "UNUSED_PROB" macro to replace these to
    retain clarity.
    Assertion failure can be reproduced as follows:
    $ make clean; extra_cflags='-O0 -g -fno-inline' ../../configure
    --enable-debug --enable-experimental --enable-palette && make -j 16
    $ ./aomenc -D --codec=av1 ~/videos/screen_content_set/gimp.y4m -o
    /tmp/foo.webm --tune-content=screen --limit=50
    Pass 1/2 frame   50/51      8976B    1436b/f   86169b/s 2902620 us
    (17.23 fps)
    Pass 2/2 frame   25/0          0B 2933053 us 8.52 fps [ETA  unknown]
    aomenc: ../../av1/encoder/cost.c:46: cost: Assertion `prob != 0' failed.
    Aborted (core dumped)
    Change-Id: I47a76b8f415060909bc8448fae3002857eb61d8e
entropymode.c 78.4 KB