This is still a rather inefficient black+white encoder, since it carefully
computes some chroma data, but just doesn't write it. However, at least the
bitstream is now monochrome.

Change-Id: Ie8a89bf329e7b41441032fb0d9e9011385bc12ff

To faciliate using intrabc on interframes.

Change-Id: Ibfe376190adf24d15198c5fb548e1050e191a3d6

I think the result is a little easier to reason about (you now talk
about a property of the block, rather than the behaviour that should
be enforced). It also matches the code in read_partition in
decodeframe.c

Change-Id: I13ba06b1504fa153b8b6b60fa14b373483639718

No change to the code, but these #if !CONFIG_NEW_MULTISYMBOL lines are
all in the #else part of an #if CONFIG_NEW_MULTISYMBOL...

Change-Id: Ibf11b1f0711113d9ee52927dcaf243d74e3f9d28

The "src_height" computed in save_deblock_boundary_lines didn't match
the one in save_tile_row_boundary_lines, which meant that the wrapper
function assumed the deblock code was saving some lines and that code
thought that save_cdef_boundary_lines would do it.

This patch fixes up the logic to match, and also completely gets rid
of the lines_to_save variable (after all, bad things would happen if
lines_to_save was 1 because we'll still read both boundary lines
later)

The tile height gets rounded up to a multiple of 8 luma pixels in
save_tile_row_boundary_lines to avoid nasty corner cases. This will
only have any effect for rows at the bottom of the frame (where
av1_get_tile_rect clips to the frame boundary).

BUG=aomedia:1020

Change-Id: I55adb53fa8ba9c7f97fb2fd5b328a3f2f5065464

The br_cdf and lps_cdf with a new 4-state symbol br_cdf.
The br symbol indicates whether the level is k, k+1, k+2 or >k+2
In the latter case, a new br symbol is read. Up to 4 br symbols are
read which will reach level 14 at most. Levels greater than 14 are
golomb coded.

The adapted symbol count is reduced further by this commit.
E.g. for the I-frame of ducks_take_off at cq=12, the number of adapted symbols
is reduced from 4.27M to 3.85M. About 10% reduction.

Gains seems about neutral on a limitied subset.

Change-Id: I294234dbd63fb0fa26aef297a371cba80bd67383

This experiment modifies lv_map to make use of multi symbol.

Replace the nz_map and coeff_base binary CDF with a new multi-symbol
CDF of size 4. The new base_cdf indicates for each coeff if the level
is 0, 1, 2 or >2. Two new special contexts are added to be used for the
last coefficient (the EOB coeff). For the EOB coefficient we already know
that it is non-zero. We use one context for DC EOB and one for AC EOB
(this can potentially be refined more).

The new symbol is read/written by special bitreader/bitwriter functions.
Those functions reduce the probability precision from 15bit to 9bit before
the invocation of the arithmetic coding engine.

The adapted symbol count is significantly reduced by this experiment.
E.g. for the I-frame of ducks_take_off at cq=12, the number of adapted symbols
is reduced from 6.7M to 4.3M.

Change-Id: Ifc3927d81ad044fb9b0733f1e54d713cb71a1572

And make variable consts when possible.

Change-Id: I823e56327e338ba669a0edd68c6c6d67077ebb7e

The decoder side correctly disabled delta_q but the encoder didn't.

Change-Id: I9f720c678d9e99d723c632095c058eaecd1a639d

Otherwise the previous value ended up being used, creating a desync.

Change-Id: I42d466474ce1a2567045720b8dfd413625f21cfa

Rather than backing out all the LGT-related shifting matrices
throughout the existing TX code, separate out and simplify Daala
inverse TX into a single dedicated entry point.  When DAALA_TX is
enabled, CONFIG_HIGHBITDEPTH is also forced, and all of Daala TX
(lowbd and highbd) uses this single TX dispatch.

This patch is purely non-functional changes.

subset 1:
monty-TXtesting-fwd-s1@2017-11-12T05:25:09.557Z ->
 monty-TXtesting-inv-s1@2017-11-12T05:25:43.878Z

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000

objective-1-fast:
monty-TXtesting-fwd-o1f@2017-11-12T05:25:29.386Z ->
 monty-TXtesting-inv-o1f@2017-11-12T05:25:58.897Z

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000

Change-Id: I790e8d7ac08eb214eb712f5441d6e5f76ebddf17

Change-Id: Idc201abd06cb1ac351a71bc723d9fed99c215b8e

Reduce context model number from 9 to 6.
Let context be two kinds: two reference frames are equal distance
or not.
Also, give equal distance compound weight {9, 7} instead of {8, 8}/16

Reducing context model gives neutral performance.
New compound weight provides -0.14% gain.

Change-Id: I8a3f3021eac9e446ac826e5992f42931af4c8962

Change-Id: I2c913198b7ad136cdf15d4af86b9b0b9e6850b72

Change-Id: I976b4a684d6d309da6b1076627f7e1e058e72932

Change-Id: I484121349af182f4f9525b1c992a6e77f6da7ea9

Change-Id: I96e5ff72caee8935efb7535afa3a534175bc425c

This reverts commit 060e192b.

Change-Id: I5700d351a3cbb682ec49a0efb9cca4d0e83f9a3a

This experiment has been abandonned for AV1.

Change-Id: I07be0876b21ee20a1eb2490bb98e4f84978ff001

This computes a binary mask from the residual by smoothing in a 5x5
window and then thresholding.

Change-Id: I8e933160ece44c3c4b162e847a2b022ee2136583

Change-Id: Ib3e72cf6d838046465df4c3ea5282416cd892e36

Change-Id: Ia37d6ddfaf83296f5f88c3a32928120f73a202a0

Include a few RDO fixes that properly account for the extra flag
cost at the right place. Also entropy coding of the flag is made
contexted on tx_size and based on cdf framework.

Change-Id: I52f98ace7e253ccc08917a4a7b517515d1d58a98

Make it work with NO_FRAME_CONTEXT_SIGNALING.

Change-Id: I27813305c68de7042678706c1c9b938b172c3666

warp motion is disabled from a scaled reference.
Thus, the parameters are constant (SCALE_SUBPEL_SHIFTS).

Change-Id: I6757ea855ef0fd91cf2378f756f92774f9b9e39a

Change-Id: Ifaea6aa82da870868474d5d34b19892ff752c72f

Add low bit-depth SIMD function for av1_warp_affine based on
existing SIMD implementation.
Unit tests are added.

Change-Id: I1b4033fa75b53a81cb20a4bb5cc60413708b568c

Conveys depth from the largest transform size instead of the
actual transform size. Besides, the max depth is now limited
by the macro MAX_TX_DPETH set at 2.

Results: BDRATE lowres (30 frames): -0.005%

Change-Id: I1ccbac8ee18c77b816a6a8f500abfaa7892b21de

This is to diagnose many nightly test failures.

BUG=aomedia:1023

Change-Id: Ibf2da2cfe0fbb0e52920a007200335d672435c82

Re-introduces a check that was removed in the refactor in 1a96c3f5.

BUG=aomedia:1021
BUG=aomedia:1022

Change-Id: I548a30dba7586cf220b2f5a3f1fddf2b6b57e68d

Rather than backing out all the LGT-related shifting matrices
throughout the existing TX code, separate out and simplify Daala
forward TX into a single dedicated entry point.  When DAALA_TX is
enabled, CONFIG_HIGHBITDEPTH is also forced, and all of Daala TX
(lowbd and highbd) uses this single TX dispatch.

At present, this should result in no effective functional change,
however rectangular transforms are now always column-first-- that
has minor rounding effects.

subset 1:
monty-daalaTX-fulltest-DaalaRDO-s1@2017-11-07T00:02:56.282Z ->
 monty-daalaTX-fulltest-fwd-s1@2017-11-07T03:08:55.478Z

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-0.0576 |     N/A | -0.2646 |  -0.0125 | -0.0439 | -0.0479 |    -0.1798

objective 1 fast:
monty-daalaTX-fulltest-DaalaRDO-o1f4@2017-11-07T05:59:50.180Z ->
 monty-daalaTX-fulltest-fwd-o1f4@2017-11-07T06:00:08.500Z

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
0.0036 |  0.0477 |  0.1132 |   0.0863 | -0.0017 |  0.0209 |     0.0240

Change-Id: I182a5c4388c410cbea8810e2f9e36fd37a4a46e5

This experiment has been adopted, we can simplify the code
by dropping the associated preprocessor conditionals.

Change-Id: I17bd46ebad7796d04fb4065fb36da0e1c4eeaf9b

In preparation for Daala unified LBD/HBD TX, add (and use) is_hbd
field in TxfmPama structure.  This field indicates whether or not
pixel data is using 8 or 16 bit reference buffers (currently ambiguous
in the case of 8 bit input).

Change-Id: I28bca792a48ffa00e208617adb072b08ff816e3c

The target of this experiment is to fix and develop bitstream syntax
changes related to reference frames, especially considering:
(1) Fix various issues in aomedia bug 973;
(2) Make according changes accomondating the adoption of frame_marker.

BUG=aomedia:973

Change-Id: Ia8731eaa3b3d2cdacbbe3c12b0793ac15928c054

Cleanup/optimizations of the low-bitdepth inverse TX path for AV1 TX
broke Daala TX in several places; this patch cleans up the cleanup.

Tested against the New Daala TX code that unified LBD/HBD, restores
bit-identical TX behavior.

monty-daalaTX-invzerotest-LBD-s1-2@2017-11-10T08:46:01.822Z ->
  monty-daalaTX-invzerotest-test-s1@2017-11-09T05:09:05.483Z

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000

Change-Id: I58e4de4c71ec5251138ff7816f77777db6f869a3

Now that tran_low_t is assumed to be 32 bit when Daala TX is active,
there's no reason for multi-stage shifting to fit coefficients into 16
bits for the inter-tranform transpose matrix. Go to a consistent up by
four, down by one shifting scheme for all TX block sizes.

(Note this is for the current AV1 coefficient scaling scheme with
av1_get_tx_scale and deeper coefficients for higher bitdepth input.
Daala TX is moving to the long-intended constant-coefficient-depth in
upcoming patches).

subset 1:
monty-4-1-baseline-s1@2017-11-11T05:57:15.857Z ->
 monty-4-1-test-s1@2017-11-11T05:57:52.983Z

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
-0.0117 | -0.0246 |  0.0530 |   0.0238 | 0.0254 |  0.0447 |    -0.0442

Change-Id: I2214e94ac822542c504d472276723277ed350abf

This causes no change in the encoder output.
Comparing simple SSE-based RDO with the switch to
txfm_rd_in_plane, the overhead is reduced by 23% ~ 50%.
The total encode time increase is now 2.3% ~ 3.1%.

Change-Id: I48c76216871f8ed68631815fd781697139305e94

Change-Id: Ia47101de22091a60d7931890f00a4a3a527f5bd4

Unit tests for jnt_comp low bit-depth added.

Change-Id: Ib070a67c125c5fa9a034e2b368aa109f9a256a45

Change-Id: I40bac595b1ecf56fada6980774b46bbf16426ce3