Rectangular 8x16 and 16x8 will now use Daala TX when CONFIG_DAALA_TX8 and
CONFIG_DAALA_TX16 are both enabled.

Change-Id: I777d5433addb8ffd4a99f7e021768d4f8651008f

Rectangular 4x8 and 8x4 will now use Daala TX when CONFIG_DAALA_TX4 and
CONFIG_DAALA_TX8 are both enabled.

Change-Id: I56659c3e98e4bbd5bd3591404f9ff72120b33d6f

Change-Id: I8fa0a67d7a198b8b24837ffc352acf77f390cffe

Change-Id: I5bff0a68602a89ce480fec049c8b2c4bce44f6bb

Change-Id: Ic4e04ef959e10b60dae6de8d6da50e7a281e654c

In this experiment, sharp image discontinuity in the predicted
block is detected. Based on this discontinuity, we choose
particular LGTs as row and column transforms.

Bitstream syntax, entropy coding, and RD search for LGT are added.
One binary symbol is used to signal whether LGT is used. This
experiment can work independently with the lgt experiment.

lowres: -0.414% for key frames, -0.151% overall
midres: -0.413% for key frames, -0.161% overall

Change-Id: Iaa2f2c2839c34ca4134fa55e77870dc3f1fa879f

Change-Id: I71c07652565c0e1ca44d73f3731459949271fe45

Change-Id: I1bea2c214f492754136854a5c48c64a7fcbd7dac

Change-Id: Idf01b14bed4701ce84fa1c127e01560f4764fadb

And assert that sizeof(tran_low_t) == sizeof(int32_t).

Change-Id: I0bf1b7f3d1ba63eeea1eee87a9a0fe0b80b95078

Change-Id: Ic843e99bd9b79cb9a0a26b95e3a48717ff2ec2a5

Change-Id: Ifa983d83a509cdfad78f6400df7d60c8f5b4f68c

This commit has no impact on metrics.

Change-Id: Iba8baae9123c88062f10deb6e1e9a709708a4f19

This commit has no impact on metrics.

Change-Id: I916ae31f2ddd3c8079291b3f01727a6565dd160d

This commit has no impact on metrics.

Change-Id: I872e29decf3dd7d9dc872d96865062c0d8d7125f

This commit has no impact on metrics.

Change-Id: I5d3dd031703b48e2efd3aaaebef070569c0c4a2d

This commit has no impact on metrics.

Change-Id: I9544083f923a94a69490f5efac6e4075db24aeb5

This commit has no impact on metrics.

Change-Id: I706b60232d45910b91f17544af20eaf8581b5ab5

This commit has no impact on metrics.

Change-Id: I7732d8cadc74e9cfec3939120abb55262a5be9aa

This commit has no impact on metrics.

Change-Id: I29e927e64938a5a88bf6b359774f92719df2a4af

This commit has no impact on metrics.

Change-Id: Iea355a67a4b689325deec320dd4b0b313befe7d1

This commit has no impact on metrics.

Change-Id: I2dabe2ab5f2050af87f82666faac4f8d8d2eb507

This commit has no impact on metrics.

Change-Id: I4e2c66d9082e1f2bdbe8851492e91c653f5da6f1

This commit has no impact on metrics.

Change-Id: I9fae08410da95dd851e33515289f9d878c43e736

This commit has no impact on metrics.

Change-Id: I58d85dc22627849657c88c082db940baff921f8d

This commit has no impact on metrics.

Change-Id: I85007ef966b9aab4545499016ed68ab5c96a417a

This commit has no impact on metrics.

Change-Id: I218f2a95542ae68491d2844becf6018eda529a1f

This patch fixes a regression introduced in 1d190950 where the encoder
 was using the 16x16 VP9/AV1 transforms for RDO, but then used the Daala
 transforms for encoding.

subset1:

master-daala_dct16@2017-09-13T12:05:18.013Z ->
  master_daala_dct16_use_c@2017-09-13T13:05:02.252Z

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-0.3654 | -0.7634 | -0.7407 |  -0.4884 | -0.4699 | -0.4945 |    -0.5104

master-no_rect_tx-no_var_tx@2017-09-12T00:23:18.153Z ->
  master_daala_dct16_use_c@2017-09-13T13:05:02.252Z

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-0.0133 |  0.1040 | -0.0440 |  -0.0492 | -0.0151 | -0.0120 |     0.0699

Change-Id: Id1830d0975db4bd0320a47fdf45b4bca20881cfb

This allows a mask for mrc-tx to be sent in the bitstream for
inter or intra 32x32 transform blocks. The option to send the mask
vs build it from the prediction signal is currently controlled with
a macro. In the future, it is likely the macro will be removed and it
will be possible for a block to select either method. The mask building
functions are still placeholders and will be filled in in a followup.

Change-Id: Ie27643ff172cc2b1a9b389fd503fe6bf7c9e21e3

This patch fixes a regression introduced in 1d190950 where the encoder
 was using the 4x4 VP9/AV1 transforms for RDO, but then used the Daala
 transforms for encoding.
The ~2% improvement below comes from forcing the C implementation of the
 4x4 and 8x8 transforms to be used when CONFIG_DAALA_DCT4 and
 CONFIG_DAALA_DCT8 are enabled respectively.

subset-1 (--enable-experimental --enable-daala_dct4):

master@2017-08-21T21:41:18.302Z ->
 master_daala_dct4_use_c@2017-08-22T02:39:14.457Z

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-2.1953 | -1.2044 | -1.1865 |  -1.6173 | -1.7029 | -1.6784 |    -1.7235

Change-Id: I44d2b24094e89b2857ae03d743180e706cef45eb

Make it 0 to run at higher precision

Change-Id: I51decbf9179efa18a1a06dcc3f0e939d9895a5cd

This is undefined behaviour in C and might confuse the optimizer, leading to incorrect code.

Change-Id: Ia4bb60478068da678f013bdd6ab6a49814d89ebe

Change get_lgt in order to integrate a later experiment
lgt_from_pred with lgt. There are two main changes.

The main purpose for this change is to unify get_fwd_lgt and
get_inv_lgt functions into a get_lgt function so the lgt basis
functions can always be selected through the same function in
both forward and inverse transform paths. The structure of those
functions will also be consistent with the get_lgt_from_pred
functions that will be added in the lgt-from-pred experiment.

These changes have no impact on the bitstream.

Change-Id: Ifd3dfc1a9e1a250495830ddbf42c201e80aa913e

Coding gain becomes tiny on top of other experiments.

Change-Id: Ia89b1c2a2653f3833dff8ac8bb612eaa3ba18446

The AVX2 code only supports DCT_DCT. For other transform types, use
the C fallback.

Change-Id: I6b472ebd7d963c02aae80ff5846b7f2dcaf092ea

This experiment replaces the 64-point Type-II DCT and related
scaling vp9 transforms with the 64-point orthonormal
Daala transforms.

subset-1:

    monty-square-baseline-s1-F2@2017-07-28T03:35:45.962Z ->
      monty-square-dct64-s1-F2@2017-07-29T04:50:58.412Z

       PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
    -0.1930 | -0.2037 | -0.0643 |  -0.1917 | -0.2331 | -0.3510 |    -0.1810

objective-1-fast:

    monty-square-baseline-o1f-F2@2017-07-28T03:35:35.533Z ->
      monty-square-dct64-o1f-F2@2017-07-29T04:50:28.542Z

       PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
    -0.2557 | -0.1743 | -0.4900 |  -0.3028 | -0.4147 | -0.5764 |    -0.2864

Change-Id: I1f944df29e44d2e350c42555af274f2d75a62a92

This experiment replaces the 32-point Type-II DCT and 32-point
Type-IV DST scaling vp9 transforms with the 32-point orthonormal
Daala transforms.

subset-1:

    monty-square-baseline-s1-F3@2017-08-02T11:50:51.375Z ->
      monty-square-dct32-s1-F3@2017-08-02T11:50:18.859Z

      PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
    0.0000 |  0.0115 | -0.1044 |  -0.0185 | -0.0069 | -0.0603 |     0.0555

objective-1-fast (4 frames):

    monty-square-baseline-o1f-F3-l4-fine@2017-08-12T02:18:05.560Z ->
      monty-square-dct32-o1f-F3-l4-fine@2017-08-12T02:19:44.461Z

      PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
   -0.0269 | -0.0715 |     N/A |  -0.0547 | -0.0268 | -0.0590 |        N/A

Change-Id: Ib1bad991d82eb67956e94a6216298a84e908b169

This allows inter and intra modes to use different mask functions.
The mask functions checked in are still place holders to allow for
easy experimentation.

Change-Id: Ic20d88200676df81dffee8c43555d0ff0c7bfc28

Change-Id: I51e4a61bfca6d662330476e2d90680f1a9a80304

Change-Id: I5558e18c8c706474df28e51e6ac9f598e0e2ab48