GitLab

Change-Id: I0c58fb5ee2a77ae15f6243b1c645dbe601171e67

BUG=aomedia:396

Change-Id: I1b7f6dddb06eac9e341518a95a0d71465e613e9e

This draft version only pass compiling check, it's not working yet.

The following goal is to use new coding system when doing bitstream
packing but keep old coding system in RD loop.

Change-Id: I224a1581d1cc5c67d73e71558fb77d9faf9c2470

With this patch, --enable-var-tx only enables recursive transform
partitioning without using rectangular transforms.
To enable use of rectangular transforms in addition, use:
--enable-var-tx --enable-rect-tx

The RD selection process is not fully tested under the var-tx flag
only. We might expect certain performance loss there.

Change-Id: Ie6aa17f1bbc3e8563b9990bc9ff79cc860d9a361

Fix an encoding failure issue when var-tx is enabled, while ext-tx
and rect-tx are disabled. This doesn't change coding statistics
when all are enabled.

Change-Id: I4b32387a0a1497380980f8087832aaf6467cdcbe

This commit makes ext-tx and rect-tx experiments supported in the
cb4x4 mode. It resolves an enc/dec mismatch issue when all the
transform experiments are enabled.

The coding gains are
        ext-tx + rect-tx   cb4x4    vartx     total
lowres      4.0%           2.3%      0.5%     6.9%

The encoding speed is about the same when cb4x4 and vartx are
further enabled.

BUG=aomedia:139

Change-Id: I3fdabc6d5de23ceb78ac0751a9bf7332ebc0a3ac

Account for the additional block sizes in these tables.

Change-Id: Iae940f28671714caaf32432940752958ef66f6d5

These are under EXT_TX + RECT_TX experiment combo.

Results
=======

Derf Set:
--------
All Intra frames: 1.8% avg improvement (and 1.78% BD-rate improvement)
Video: 0.230% avg improvement (and 0.262% BD-rate improvement)

Objective-1-fast set
--------------------
Video: 0.52 PSNR improvement

Change-Id: I1893465929858e38419f327752dc61c19b96b997

Also fixes a bug with rectangular transforms

Change-Id: Id459c18d8fdc767678452e0b20c4168a412f4de7

Change-Id: I93493abe3c412fc10f5bb5a2eb157c8db277f4e0

Change the table content to support 4x4 mode_info unit. Refactor
partition_plane_context() to reflect the fact that the minimum
partition block size is 8x8.

Change-Id: Id26fcfba8d74efdb9ae316c9d066cd65358dd7e6

Separate the use cases of number of 8x8 blocks from those of
mode_info array. This allows the mode_info array processing to be
scaled to 4x4 resolution.

Change-Id: Iab78f2540355ce7658d9ea21e902a86f71148d8f

Scale the counting scheme to operate in the unit of 2x2 transform
block size and 4x4 coding block size.

Change-Id: I7c4155c3b29df109278187d5ce0aa78d85a6245e

If the coding block size is 4x4, map the uv transform block size
to 2x2 in non-444 format.

Change-Id: I5767df7c6c1f73938f97745d604207caad6f7d68

clang format gets confused with this table due to #if statements.
Turn off format check on this table.

Change-Id: I21e9069581749d6e01501d01ba779f56207ca84a

Add 2x2 block size syntax to the codec system. It prepares for the
4x4 coding block unit for 420 format. This change retains the same
coding statistics.

Change-Id: If8e9a31bd6b4b75bc994539dc4dd8021d455ba57

Replace the computation of block size in pixels with lookup table
directly.

Change-Id: I39589b2bc1d20372969ff5ad0f60639e64a19b41

Change-Id: Idc44fa29c70c9bb63c9b04cfba679fd05d34fdff

Includes:
Various table updates and fixes to support 64x64 transforms.
Entropymode updates to support tx_size expansion to 64x64.
tx_mode changes to support an ALLOW_64sXx64 transform mode.

Change-Id: Ib9098cfe27d0c015fe3be6ae13e7d09576771b9e

For these files:
av1/common/common_data.h
av1/encoder/encodemb.c
av1/encoder/quantize.c
av1/encoder/rdopt.c

Change-Id: I379e861d55c2875d0366df24f986b29796a70087

Also includes some refactoring and cleanups.

Change-Id: I2c2528c434a1e9e9b898251fa69489d884463929

Make the UV transform block table support recursive transform block
partitioning. This doesn't change the coding statistics.

Change-Id: I90bcf7c52c597a77afe130f1f1ed5024b6888737

This commit makes the encoding process of the recursive transform
block partition support both rectangular and square transform block
sizes as the starting point. If the coding block size is rectangular,
it would allow the transform block size to start from the largest
rectangular transform size, and recursive parse to the selected
coding sizes.

Change-Id: I576628b9166565bada6a918f0a1e67849dfef4cd

No coding statistics change.

Change-Id: I88cbb828308b5796a2e87079c2f1bf0dabd99a11

Change-Id: I04367fb68e8fd027f4b9d945f4001e5ab346d098

Make the codec support 2x2 tranform block unit for chroma components.

Change-Id: Ic454535bd5620abe88a2e99789160cc4664ee518

Use table to replace the arithmetic computation for mapping between
transform block and pixel number. Support automatic scale of block
size and transform block size.

Change-Id: I84766850172265d4295f418383dbc5e6e5838ec8

This prepares for the next refactoring to support 2x2 transform
block sizes.

Change-Id: Ia06bc487da34e853ef9323cd13e3d482e819db43

"varios" -> "various"

Change-Id: If91a462dc009f701c48c2cfd7965cd71f61f2970

This prepares the support to both rectangular and 2x2 transform
block sizes.

Change-Id: I3c2d4e317f6b627bb45d2273c278331bd976ee92

Use the table access to retrieve pixel numbers from tx_size.

Change-Id: I9459f2c3292c2f9ddf963f16b79e142de7432031

The duplicate breaks build.

Change-Id: I0f16761c4bcb8563402a664013429403b883c2e1

av1_init_scan_order
initialize data structures related to adaptive scan order

av1_update_scan_prob
update nonzero probabilities from nonzero counts

av1_augment_prob
embed r + c and coeff_idx info with nonzero probabilities.
When sorting the nonzero probabilities, if there is a tie,
the coefficient with smaller r + c will be scanned first

av1_update_sort_order
apply quick sort on nonzero probabilities to obtain a sort order

av1_update_scan_order
apply topological sort on the nonzero probabilities sorting order to
guarantee each to-be-scanned coefficient's upper and left coefficient
will be scanned before the to-be-scanned coefficient.

av1_update_neighbors
For each coeff_idx in scan[], update its above and left neighbors in
neighbors[] accordingly.

Change-Id: I64c4938057daf8e30e48609a00ecc08d2e3062f4

Change-Id: I789fa11638f155f1092a1e9260d26c7855d18e37

Add tx_size_2d table to cb4x4 configs.

Change-Id: I2f68a21ff3fb008fe5a55712a753edd98899a98f

Change-Id: I086b79462b0933cf9dc1101ff71cbc71c7da2738

1) Turn off SIMD quantizer in adapt_scan experiment because the iscan is
not 16-byte aligned now.

2) Turn off eob-specific dqcoeff initialization in
inverse_transform_block_inter and inverse_transform_block_intra

3) Turn off transform optimization for special eob because it is not
compatible with adapt_scan experiment

Performance:
        PSNR    BDRate
lowres  1.2%    1.068%
midres  0.897%  0.769%
hdres   0.945%  0.724%

Change-Id: I197c19ba536761c334790a040ef44534c7cf21b5

Make the codec support 2x2 tranform block unit for chroma components.

Change-Id: If428abeb55fd772bdd74da0d0449b436f60eb0e3

Uses an array to map block sizes, y tx sizes, and subsampling
factors to various transform sizes for UV.

Results improve by 0.1-0.2%

Change-Id: Icb58fd96bc7c01a72cbf1332fe2be4d55a0feedc

Change-Id: I2b2b70e756b7eb9611b7b33b7d5f19b3b30e0a50