GitLab

Change-Id: I76259d6ec925a0c7024e7c70a517debe2d3bf1ab

* Remove some unused variables
* Reduce need for casts by typing intermediate buffers appropriately
* Avoid copying data which is never modified; use the original data
  instead.
* Reduce number of intermediate buffers required, saving allocations
  of 576KiB in the decoder and ~1MiB in the encoder

No effect on performance

Change-Id: I55243904dd8e818fb6d43fa431903736475d23ff

This CL aims at simplify transform code.

Change-Id: Ibaf1dd8607e37d44a0f77788a72e344583f81fa0

Change-Id: I5ad51375287b40170882c4816d34858be50afacd

This commit enables the cb4x4 mode to support ext-tx experiment. The
coding performance gains are:

       ext-tx   cb4x4    ext-tx + cb4x4
lowres  2.7%     2.6%      4.9%
midres  2.1%     1.2%      3.0%

Change-Id: I6c566b6073527262abcdbb1a0c6bcb8729988f3b

Remove unnecessary #if statements from the implementation.

Change-Id: I09c2f046aec2c43894f8dcfd99216fdf0a50451d

Change-Id: I6ce654b582f2a9d45a40bf22ba597b47d418a0be

Similarly to the refactoring of PVQ codes for 4x4 intra,
instead of calling tx and pvq_encode_helper() in 4x4 inter,
av1_xform_quant() is called.

This commit gives no change in metrics.

Change-Id: Ib69efb00ed5a5b2254478bf5db5a19d9dac12b3b

This commit adds a new experiment to allow disabling of loop filtering
on tile boundaries. It is implemented by adding a syntax field
"loopfilter_across_tiles_enabled" into the uncompressed frame header. 
If it is set to 0, decoder and encoder will disables loop filtering for
block edges that are also tile boundaries.

Change-Id: Ib80bfd82d49c74f1ba46ae18ceedb30704ac8aa5

In 4x4 intra search for RDO, AV1 codes has been changed to
call av1_xform_quant() while ago, while PVQ did not but call
txfm and pvq_encode_helper() instead, which caused duplicated codes
and thus worse maintenance and testing.

This refactor also has fixed the long-sitting bug,
which we couldn't find before refactoring.

PSNR    PSNR-HVS  SSIM  FAST-SSIM  CIEDE 2000 MS-SSIM
-2.77   -2.62     -2.90 -4.07       -2.94     -2.63

Change-Id: I6e526123a64af810897962d11d53028719e82e16

If --enable-entropy-stats is on, the aggregate counts for each
frame are written out to a file named counts.stt.

Change-Id: I0c73ab872183a9dbd6d767a8c6f0642c5c117253

The convolve filters generated by loop_wiener_filter_tile
are not compatible with some existing convolve implementations
(they can have coefficients >128, sums of (certain subsets of)
coefficients >128, etc.)

So we implement a new variant, which takes a filter with 128
subtracted from its central element and which adds an extra copy
of the source just before clipping to a pixel (reinstating the
128 we subtracted). This should be easy to adapt from the existing
convolve functions, and this patch includes SSE2 highbd and
SSSE3 lowbd implementations.

Change-Id: I0abf4c2915f0665c49d88fe450dbc77b783f69e1

Change-Id: Id24b4ac814b8b9db8ca3dd8d8d0c19174f345c75

The bmi structure for sub8x8 block is deprecated in the cb4x4 mode.
Always fetch the transform type from coding block's mode_info
structure directly.

Change-Id: I8df8536e1a1723b292600018c4843e5fcc025284

Change-Id: I6ccb0c884545049a7d428f8654df54c20f563392

This commit allows the sub8x8 blocks to compose and filter their
chroma components for supertx in cb4x4 mode. The coding gains of
supertx and cb4x4 are largely additive:

          supertx      cb4x4       cb4x4 + supertx
lowres     -1.0%       -2.7%        -3.64%
midres     -0.8%       -1.3%        -2.10%

Change-Id: Ie7d09f6fceb36ce375e56773728f05dd628786fe

This makes the cb4x4 mode support supertx experiment. It resolves
the enc/dec mismatch issue when both experiments are turned on.

Change-Id: If3f70fb26862b4ea95d73f7030f86a399051e21e

This allows the cb4x4 mode to work with ref-mv and supertx modes.

Change-Id: Ib9747d2c8a2b036fb246ca04bf7cc8c8f40931bf

Use table access to replace integer to enum conversion.

Change-Id: Idb3e7e2e3267bccf322cffbe4bfaa969e9018296

This commit makes the cb4x4 mode support supertx operation.

Change-Id: I1a713b2268c1029aebeb43aa6aeb0fa37b16810f

Change-Id: Id2ca1c1b03fc6dca33e86cdbc17ca0782f44a446

Change-Id: Ic278cc3296813b52bfd228544971fc62779a2d1c

Avoid comparing values from different enums.

Change-Id: I405f87942a64e86bda899b84a142c4d64414dd81

Change-Id: I53d1383bfe70e0508b0c91d77931a21be2b91682

With PVQ, the dst buffer should be initialized as zero
before av1_inv_txfm_add_*() is called.
This bug seems introduced during resolving conflicts
when nextgenv2 was merged.

BD-Rate change:
                PSNR  PSNR-HVS  SSIM  CIEDE 2000  MS SSIM
subset1-mono    -0.25 -0.25     -0.23 -0.26       -0.23
objective1-fast -0.17 -0.26     -0.14 -0.04       -0.18

Change-Id: I7c6b793ba0aa5f1e3d419312cbbe5c207a68f1f8

BUG=aomedia:115

Change-Id: If67821ed084b01f26287ac5e032d4f5fd5a83024

Change-Id: I3c52a4759780d987d045bb7b34a27ee9f7f55117

Replace hard coded numbers with table access. Avoid comparing
values from different enums.

Change-Id: I43216db4a9b13ee317e8e517683946f526e5ca0e

This commit fixes the 2x2 transform system setups for high bit-
depth setting. It enables the cb4x4 mode to support high bit-depth
process. The coding performance is improved over high bit-depth +
ref-mv:

lowres  2.5%
midres  1.2%

Change-Id: I351f9d72bdc7e15b2bd00e94286b98966a295e6d

Remove unused chunk of codes for sub8x8 inside this function.

Change-Id: Ie49d707b3ceeeee3b439e46c9d0e63abd4ae104c

* Fix a bug in warp_erroradv introduced by previous patch
* Add highbd version of the new warp filter

Change-Id: I791d3a97baf86f0cbfc72880776848f93df6daa6

Also fixes a bug with rectangular transforms

Change-Id: Id459c18d8fdc767678452e0b20c4168a412f4de7

Change-Id: I38259c4074f77a8941baefbe7585fff2eded6b12

Add 2x2 forward and inverse 2D-DCT for high bit-depth.

Change-Id: I3092a2587a0cdc6675a69cc9203499a530b65325

The mv cdfs are updated below in calls to av1_set_mv_cdfs().

av1-master@2016-12-19T17:27:14Z -> av1-set-mv-cdfs@2016-12-19T17:27:54Z

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000

Change-Id: I6061602a4f2cc91dadf79e39d513c9678b9d2075

When enable_optimize_b is false in av1_encode_intra_block_plane the
entropy contexts were never initialized.

No changes on metrics for objective-1-fast when no experiment is
enabled.

Change-Id: Ic68913f6400d2becbaec3cc14214a0257530ed0b

This commit allows the dynamic motion vector referencing system to
scale its search range according to the coding block size. This
provides higher search resolution for smaller size coding unit.

The cb4x4 mode improves the compression performance across all the
test sets:

         avg     low    mid    high
lowres   2.8%    2.4%   3.1%   3.0%
midres   1.3%    0.3%   1.8%   2.7%
hdres    0.9%    0.5%   1.4%   1.5%

Change-Id: I1bc501506a9f2f06071c5274391f6bd053b235a7

Use the proper scaling factor to decide if a block is sitting on
the frame border. This refactor does not change the coding
statistics of the code base. It fixes an enc/dec mismatch issue
due to out of boundary memory access in the cb4x4 mode.

Change-Id: Ia1e999c0f4e4ef10aac6120e69c1fb10a738dd4d

Refactor the fill_token_cost() function to automatically compute
the token cost arry for all transform block sizes.

Change-Id: I2f44c9c08fb169bc14282ba48bce23577b1ab184

This commit allows the forward model update for 2x2 transform
block size.

Change-Id: Ie08c401e488b3872be0d92640468857f0aa0d0b3