GitLab

In 4x4 intra search for RDO, AV1 codes has been changed to
call av1_xform_quant() while ago, while PVQ did not but call
txfm and pvq_encode_helper() instead, which caused duplicated codes
and thus worse maintenance and testing.

This refactor also has fixed the long-sitting bug,
which we couldn't find before refactoring.

PSNR    PSNR-HVS  SSIM  FAST-SSIM  CIEDE 2000 MS-SSIM
-2.77   -2.62     -2.90 -4.07       -2.94     -2.63

Change-Id: I6e526123a64af810897962d11d53028719e82e16

If --enable-entropy-stats is on, the aggregate counts for each
frame are written out to a file named counts.stt.

Change-Id: I0c73ab872183a9dbd6d767a8c6f0642c5c117253

The convolve filters generated by loop_wiener_filter_tile
are not compatible with some existing convolve implementations
(they can have coefficients >128, sums of (certain subsets of)
coefficients >128, etc.)

So we implement a new variant, which takes a filter with 128
subtracted from its central element and which adds an extra copy
of the source just before clipping to a pixel (reinstating the
128 we subtracted). This should be easy to adapt from the existing
convolve functions, and this patch includes SSE2 highbd and
SSSE3 lowbd implementations.

Change-Id: I0abf4c2915f0665c49d88fe450dbc77b783f69e1

Change-Id: Id24b4ac814b8b9db8ca3dd8d8d0c19174f345c75

The bmi structure for sub8x8 block is deprecated in the cb4x4 mode.
Always fetch the transform type from coding block's mode_info
structure directly.

Change-Id: I8df8536e1a1723b292600018c4843e5fcc025284

Change-Id: I6ccb0c884545049a7d428f8654df54c20f563392

This commit allows the sub8x8 blocks to compose and filter their
chroma components for supertx in cb4x4 mode. The coding gains of
supertx and cb4x4 are largely additive:

          supertx      cb4x4       cb4x4 + supertx
lowres     -1.0%       -2.7%        -3.64%
midres     -0.8%       -1.3%        -2.10%

Change-Id: Ie7d09f6fceb36ce375e56773728f05dd628786fe

This makes the cb4x4 mode support supertx experiment. It resolves
the enc/dec mismatch issue when both experiments are turned on.

Change-Id: If3f70fb26862b4ea95d73f7030f86a399051e21e

This allows the cb4x4 mode to work with ref-mv and supertx modes.

Change-Id: Ib9747d2c8a2b036fb246ca04bf7cc8c8f40931bf

Use table access to replace integer to enum conversion.

Change-Id: Idb3e7e2e3267bccf322cffbe4bfaa969e9018296

This commit makes the cb4x4 mode support supertx operation.

Change-Id: I1a713b2268c1029aebeb43aa6aeb0fa37b16810f

Change-Id: Id2ca1c1b03fc6dca33e86cdbc17ca0782f44a446

Change-Id: Ic278cc3296813b52bfd228544971fc62779a2d1c

Avoid comparing values from different enums.

Change-Id: I405f87942a64e86bda899b84a142c4d64414dd81

Change-Id: I53d1383bfe70e0508b0c91d77931a21be2b91682

DatarateTestLarge tests take a long time in some configurations, this
commit reduces the time required for tests to finish by cutting # of
ovideo frames used and # of rate targes.

Change-Id: I1d5324b7338325be14213bd9495f567714339607

With PVQ, the dst buffer should be initialized as zero
before av1_inv_txfm_add_*() is called.
This bug seems introduced during resolving conflicts
when nextgenv2 was merged.

BD-Rate change:
                PSNR  PSNR-HVS  SSIM  CIEDE 2000  MS SSIM
subset1-mono    -0.25 -0.25     -0.23 -0.26       -0.23
objective1-fast -0.17 -0.26     -0.14 -0.04       -0.18

Change-Id: I7c6b793ba0aa5f1e3d419312cbbe5c207a68f1f8

BUG=aomedia:115

Change-Id: If67821ed084b01f26287ac5e032d4f5fd5a83024

Change-Id: I3c52a4759780d987d045bb7b34a27ee9f7f55117

Replace hard coded numbers with table access. Avoid comparing
values from different enums.

Change-Id: I43216db4a9b13ee317e8e517683946f526e5ca0e

This commit fixes the 2x2 transform system setups for high bit-
depth setting. It enables the cb4x4 mode to support high bit-depth
process. The coding performance is improved over high bit-depth +
ref-mv:

lowres  2.5%
midres  1.2%

Change-Id: I351f9d72bdc7e15b2bd00e94286b98966a295e6d

Remove unused chunk of codes for sub8x8 inside this function.

Change-Id: Ie49d707b3ceeeee3b439e46c9d0e63abd4ae104c

* Fix a bug in warp_erroradv introduced by previous patch
* Add highbd version of the new warp filter

Change-Id: I791d3a97baf86f0cbfc72880776848f93df6daa6

Also fixes a bug with rectangular transforms

Change-Id: Id459c18d8fdc767678452e0b20c4168a412f4de7

This commit fixes the tile decoding parameter control for ext-tile.

Bug=aom:122

Change-Id: I2cb702cee8d1e8083915c3a2d15c68927414b91c

Change-Id: I5bc018b22690f47a6b4507da872bffde4b6983c8

Change-Id: I38259c4074f77a8941baefbe7585fff2eded6b12

Add 2x2 forward and inverse 2D-DCT for high bit-depth.

Change-Id: I3092a2587a0cdc6675a69cc9203499a530b65325

Provide primitive modules for cb4x4 mode use. This resolves compiler
warnings when both high bit-depth and cb4x4 mode are turned on.

Change-Id: If6ecac50578b3e665b602419a0701c3e047ce623

this is a precursor to requiring toolchains to support c99

BUG=aomedia:111

Change-Id: Ic501ea074e738fe7870ce3f56fb6e87a509632fd

This commit adds a compiler flag to gcc to warn stack size greater
than 300Kbytes.

Change-Id: I4bd0680de435373fc46bfd8d5b80a610dbaddad8

This commit reduces number of video frames used in tests to avoid
timeouts in nightly run of "libaom__example_test-multi-target".

Change-Id: I842339d0e2c36f39f2d84ccc7b131d8ebaf2347c

The mv cdfs are updated below in calls to av1_set_mv_cdfs().

av1-master@2016-12-19T17:27:14Z -> av1-set-mv-cdfs@2016-12-19T17:27:54Z

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000

Change-Id: I6061602a4f2cc91dadf79e39d513c9678b9d2075

When enable_optimize_b is false in av1_encode_intra_block_plane the
entropy contexts were never initialized.

No changes on metrics for objective-1-fast when no experiment is
enabled.

Change-Id: Ic68913f6400d2becbaec3cc14214a0257530ed0b

This commit allows the dynamic motion vector referencing system to
scale its search range according to the coding block size. This
provides higher search resolution for smaller size coding unit.

The cb4x4 mode improves the compression performance across all the
test sets:

         avg     low    mid    high
lowres   2.8%    2.4%   3.1%   3.0%
midres   1.3%    0.3%   1.8%   2.7%
hdres    0.9%    0.5%   1.4%   1.5%

Change-Id: I1bc501506a9f2f06071c5274391f6bd053b235a7

Use the proper scaling factor to decide if a block is sitting on
the frame border. This refactor does not change the coding
statistics of the code base. It fixes an enc/dec mismatch issue
due to out of boundary memory access in the cb4x4 mode.

Change-Id: Ia1e999c0f4e4ef10aac6120e69c1fb10a738dd4d

Refactor the fill_token_cost() function to automatically compute
the token cost arry for all transform block sizes.

Change-Id: I2f44c9c08fb169bc14282ba48bce23577b1ab184

This commit allows the forward model update for 2x2 transform
block size.

Change-Id: Ie08c401e488b3872be0d92640468857f0aa0d0b3

Also make sure that qindex is clipped to the quantizer range.

Change-Id: I3163da4b45e190f9ab34982d1bbbefa5cba7514e

Test "decode_to_md5_av1" is to detect unintentional bitstream changes. 
As AV1 bitstream has changed, the md5 used in the test needs to be 
updated to reflect the changes. This commit update the md5 as of current
git#be128601.


Change-Id: I9b8b37e48496be4b811a27a484eb9348ef2bc45b