Commit b13ce13c authored by Alex Converse's avatar Alex Converse

ans: Increase the base state to 1<<17.

ans_multion@2017-01-25T21:00:51.374Z ->
ans_multion_rabs17@2017-01-27T19:25:33.101Z
objective-1-fast
   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-0.0494 | -0.0494 | -0.0494 |  -0.0475 | -0.0484 | -0.0488 | -0.0497

Increasing the state any further seems to yield a compression drop.

Change-Id: Iacfd6af7e2b8a47c41033d61e338c5106bd3679c
parent 73ad5236
...@@ -33,9 +33,8 @@ typedef uint8_t AnsP8; ...@@ -33,9 +33,8 @@ typedef uint8_t AnsP8;
#define RANS_PROB_BITS 15 #define RANS_PROB_BITS 15
#define RANS_PRECISION (1u << RANS_PROB_BITS) #define RANS_PRECISION (1u << RANS_PROB_BITS)
// L_BASE % PRECISION must be 0. Increasing L_BASE beyond 2**15 will cause uabs // L_BASE is the ANS base state. L_BASE % PRECISION must be 0.
// to overflow. #define L_BASE (1u << 17)
#define L_BASE (RANS_PRECISION)
#define IO_BASE 256 #define IO_BASE 256
// Range I = { L_BASE, L_BASE + 1, ..., L_BASE * IO_BASE - 1 } // Range I = { L_BASE, L_BASE + 1, ..., L_BASE * IO_BASE - 1 }
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment