• Monty Montgomery's avatar
    Simplify Daala forward TX toplevel for constant shift · a2d40a39
    Monty Montgomery authored
    Rather than backing out all the LGT-related shifting matrices
    throughout the existing TX code, separate out and simplify Daala
    forward TX into a single dedicated entry point.  When DAALA_TX is
    enabled, CONFIG_HIGHBITDEPTH is also forced, and all of Daala TX
    (lowbd and highbd) uses this single TX dispatch.
    
    At present, this should result in no effective functional change,
    however rectangular transforms are now always column-first-- that
    has minor rounding effects.
    
    subset 1:
    monty-daalaTX-fulltest-DaalaRDO-s1@2017-11-07T00:02:56.282Z ->
     monty-daalaTX-fulltest-fwd-s1@2017-11-07T03:08:55.478Z
    
       PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
    -0.0576 |     N/A | -0.2646 |  -0.0125 | -0.0439 | -0.0479 |    -0.1798
    
    objective 1 fast:
    monty-daalaTX-fulltest-DaalaRDO-o1f4@2017-11-07T05:59:50.180Z ->
     monty-daalaTX-fulltest-fwd-o1f4@2017-11-07T06:00:08.500Z
    
      PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
    0.0036 |  0.0477 |  0.1132 |   0.0863 | -0.0017 |  0.0209 |     0.0240
    
    Change-Id: I182a5c4388c410cbea8810e2f9e36fd37a4a46e5
    a2d40a39
daala_fwd_txfm.h 885 Bytes