Add tests of expected failure conditions, and handle invalid pad
sizes in the fixed length encode function.

BUG=aomedia:1125

Change-Id: I8b9d0fbc44bb776bca3b4c3f0467a2125f13be2e

Commit https://aomedia-review.googlesource.com/c/aom/+/39985
changed the deblock filter for subsampled planes, so that
we always look at the bottom-right mi unit in each 8x8 luma
pixel unit. This fixed some issues around determining which
blocks are inter/skip/etc.

However, this introduced a different bug - the boundary info
("are we allowed to filter across the top/left edge of this block?")
is stored in the *top-left* mi unit in each 8x8 luma pixel unit.
But now we we're looking at the bottom-right unit, which always says
it's fine to filter across the top and left boundaries! Thus the
deblock filter effectively ignored the
loop_filter_across_tiles_enabled flag(s).

Fix this issue by looking up the boundary info from the top-left
block in each unit; the other information is still taken from
the bottom-right.

Change-Id: I626ea3358563641a2532ee9c5968fb54bdc78e34

Since 1193 is now fixed.

BUG=aomedia:1193

Change-Id: I79952e42679b68d8a1abc873b2c6f66711a7c4d8

Change-Id: I22d0fac0d8e94fc02a7adf13b144ed17097ff84b

For 2:1 txfm, move the sqrt2 scaling to the end of the fwd txfm
function

This only affects the txfm accuracy slightly but simplifies the
range management a lot.

Change-Id: I2eef8c15b7e8958a1fb0f2ae632604fdbab86046

Change-Id: Ic5b09169d7fbb28d09008756ec71703ff7322d78

The coding block processing is streamlined in cb4x4. There is no
longer a need to do special handle for sub8x8 blocks. This commit
removes the unnecessary memory allocation to the leaf nodes,
corresponding to 4x4 block size. It saves around 20% of the encoder
memory requirement.

Change-Id: I61301d6dea6c0a10ee232d166eea28578e2b3a58

Change-Id: I87b11ec892fe5048f858869a3b6e68d0fe78ea43

dq_type now takes 4 possible values, one of which is
the original multiply-only dequantizer.

Change-Id: I2180f632f0d7f91dc391a6e802a93a77de789228

When a transform block is skipped, reset the txb_entropy_ctx value
to be 0. This clears the assertion failure cases in txk-sel.

Change-Id: I23816761d4383aa9877bc54b117f54d69e4949a9

Update intrabc_cdf per superblock during encoding.
Also added support for entropy_stats.

Change-Id: Ie106309a8932b86bb069990db0b0ea13a4c5e8ae

Change-Id: I0f0cdf479091c308594a0288a0546dbdb76e4450

When --enable-coefficient-range-checking isn't specified,
clamp the coefficient at each stage.

The decoder behaviour is unchanged for valid existing AV1 streams.
However, some AV1 bitstreams that would have been rejected by the
decoder as illegal (range check failure) are now legal bitstreams.

There is no impact on video quality for valid bitstreams,
only bitstreams that would have been considered invalid are affected,
and are now considered as valid ones.

BUG=aomedia:30

Change-Id: Ie72ceeb3cb0561e8d3259767b209a4ef3be90438

The OBU experiment has removed the parsing of super frame indices, so
the test is obsolete when OBU is enabled.

BUG=aomedia:1213

Change-Id: If7d1873f3f41fa9146f9451687eda92b39b035a5

This is the first phase of a new-quant cleanup. We are now only
using a variable width zero bin, so we can simplify the
implementation.

Change-Id: I4da6c663a9d40b4fd08c14818cf7d7fe9b75844c

Add speed feature that uses hash tables to
reuse previously found optimized coefficients
in av1_optimize_txb. This skips some expensive
optimize_txb calls.

Currently shows no significant quality
degredation or speed improvement, and set to off
by default. Requires hash_me, lv_map and
lv_map_multi. Adding to speed features required
changing AV1_COMMON *cm to AV1_COMP *cpi in a
chain of functions.

Variations that have been tried:
-varying the maximum eob on which the feature
activates: 16, 32, 64. 16 currently used. 64
has best hit rate but longer execution time.
-varying the data hashed and the length of hashes
(first hash is 16 bit and based on context data,
while second hash is 16 bit and based only on
pre-optimized qcoeff values.)
-softening the data used for the hashes: ideally
this would raise the number of hits, without
compromising quality too much.

Change-Id: I94f22be82f3a46637c0489d512f2e334a307575f

When current coeff is found to be set as eob, nz_rd is not needed
in the computation of rdcost. Skip it.

Similarly, when has_nz_tail >= 2, computation for nz_rd should be
skipped.

Local runs show ~3% speed up.

Change-Id: I176abf1d1043cab40788934b70558b816af72732

Change-Id: Ied3252c3075e84252d8268a13d3f50066b3418e1

BUG=aomedia:1203

Change-Id: I03ca925734535c31a1ed6bdeb7f29b5b5d5f476c

BUG=aomedia:1195

Change-Id: Ib643ed9d3a23b83e91d908940f5777f6d13b8b19

BUG=aomedia:1209

Change-Id: If4ba99d6784c55768af57cac2b197db62ea2317e

Change-Id: I31a6a66753e1e06a26ad798415c5994920bf22b7

BUG=aomedia:1154

Change-Id: I0c856564dc1eadd9e22be4de6fca5c2b0344dcb5

Use assert to test the assumption noted in the comment.

Ran some encodes with varying per-frame resolutions (using
SUPERRES_RANDOM and RESIZE_RANDOM modes) to ensure that these
asserts are indeed valid.

Change-Id: I30021fff05f9793f80e42c5319bed02b0ae04cbd

BUG=aomedia:1125

Change-Id: I383c752cdd010001e8226ca510097ef693e486bb

Add the last scan position in the 8x32 iscan table. This point
would cause the encoder to ignore the last non-zero coefficient
at scan index 255, hence causing enc/dec mismatch. This commit
fixes and solves this issue.

BUG=aomedia:1193

Change-Id: Ia41ba31ef8549f8809cea3d76ecd91da77e130cf

Put loops of searching jnt_comp only inside handle_inter_mode
function.

Change-Id: I9508dea64da7e6dfe31fad09aac8679cc855f55f

Avoid potential out of boundary buffer access issue.

Change-Id: Ic3766cd5bc2c1c8b4e1cbf38310fe6689aa38b59

When the reference frame size differs from the current coding
frame, skip the use of its motion information for motion field
estimation.

BUG=aomedia:1194

Change-Id: I1a32395367228f4ac86a21099b6b7b2c25e60270

Fix a bug that prevents the mfmv buffer re-allocation when the
frame size changes.

BUG=aomedia:1194

Change-Id: Ied349ead9703069c87fbf9e46668ae1dd0b6141a

this patch enables the loopfiltering_across_tiles_ext experiment by
default since it has been adopted.

Change-Id: I24ee97ff04788af9b0045e9e4b70b9dd103b8af5

Change-Id: I19e59dba2644127f8e26cf4815c55dac693b5641

Change-Id: Iaf47b593bd768db37b499474e21226336db60f37

Change-Id: Ice048df7c909ea09bcafcddc695fc30410345726

Change-Id: I0a89e7eacf6941c735c9615af0bb74bc6d7d2ec4

Change-Id: Iac7c99eee00a426d115af5343c776cd1f2c5be70

This currently only ports a small portion - the random encode/decode mixing
CDFs and bools, plus the patch initial bits tests.

The tests will break with a different CDF_PROB_TOP, as well as a different
CDF_PROB_TOP between bools and CDFs.

Change-Id: Ia289c6afd70cbc7dde5ed7a9c7c42f219c29935d

Add clamping to 16/18/20 bits after first pass of the inverse
transform for 8/10/12 bit source espectively, and clampaing to 16
bits after second stage of the inverse transform.

BUG=aomedia:30

Change-Id: I7a68334c77baecb359a4fb3b801fdfd9d5a62f29

Change-Id: I05e77bf0c263ab7b94038f0c812bcec67df4ad24

Change-Id: I66a542da0c7b8fdb9ac2d4efee73aa62414c10f9