Change-Id: I348dfd1f8b555306a3fb625bf2303f9cd2649e07

Patch b1bedf5f converted the three writes in bitstream.c that
specify an extended transform from using av1_write_token (encoded with
probability trees) to aom_write_symbol (encoded with CDFs).

That patch fixed up the two reads in decodemv.c but didn't fix up the
corresponding read in decodeframe.c. This patch does so.

The patch also fixes up a write of a (non-extended) transform when not
CONFIG_EXT_TX and the corresponding read.

Change-Id: Ibf5dcfcf3e7122f08dd0ef8616fb0ecddb95d99a

Support transform block level kernel selection in the recursive
transform block partitioning search.

Change-Id: I511c39705ee636b0c9fabbe4720fe5a9764b964a

Make the block index use cases consistent in the recursive
transform block partition.

Change-Id: I57778acfab73c786a1db8c8b9110d56ce6df4854

mi[0] is not set properly when encoding all mvs in a
super-block first. After this patch NCOBMC can function
properly.

Change-Id: I149a50184c4823c0d3b82b6b21c7608e639668e6

This change makes the conversions similar to those in av1_quantize.c,
and fix ubsan warnings shown in nightly tests.

Change-Id: I90851a80dcb9f052a32bf22199fd9ef8ff927725

added in:
193422e7 Add avx2 highbd_quantize_b

Change-Id: Ie4ba48042ffd36d69d2bf200bba12a1d924c8f9c

Change-Id: Idafef140d3425a9a9f66cb8864a804c4d2a89a70

Change-Id: Iaf9e8192905ea24946d6e2831be5739eaa564fae

The var-tx has its own suite of tx size/type RD search functions,
which recursively split the partition into square tx blocks.

The Daala-dist requires access to 8x8 pixels (both decoded and predicted)
since it measures the distortion for multiple of a 8x8 pixels.
Thus, if tx block is smaller than 8x8, it waits until all of sub8x8 blocks
are RD searched (with MSE) then replaces the MSE of 8x8 pixels with
daala-dist's calculated distortion for 8x8 pixels.

It is also applied to luma pixels only.

Change-Id: Ic4891e89b4ef05cf880aa26781d2d06ccf3142de

In previous ADSTs, DST-7 and DST-4 are used for length 4 and length
8/16/32, respectively. In this LGT experiment we explore transforms
between DST-4 and DST-7. When CONFIG_LGT flag is on, adst4 and adst8
are replaced by lgt4 and lgt8, the intermediate transforms with
pre-chosen parameters.

The LGTs applied here are lgt4_160 and lgt8_170, where the numbers
mean the self-loop weights times 100. The associated values for DST-7
and DST-4 are 100 and 200.

ovr_psnr:
lowres: -0.140
midres: -0.131
hdres: -0.078

These changes are not applied to the highbd scenario in the
current version.

Change-Id: I20600456da8766528b2b6b11aa28801e70af498e

- If invisible pixels, av1_daala_dist() simply use source pixles for dst.
- Added av1_daala_dist_diff() which inputs diff signal instead of dst.

- Refactored daala_dist code so that av1_daala_dist() and _diff()
is called inside av1's distortion calculation functions, pixel_sse() and
sum_squares_visible().

Change-Id: Id857db52fe19856d92c46a9e84ac2962c01ae045

BUG=aomedia:623

Change-Id: I158072895adb8a9f5f177b8146f3beec265d7406

This patch changes the motion vector scaling and clamping to be
slightly more accurate (removing an occasional 1px offset due to
multiple roundings) and fixes the border clamping when scaling
frames.

Change-Id: I032dc0b87854eebafa58f1f803981e23c8cc2d9b

Avoids mixing accesses to ctx->pending_cx_data
with serialization logic.
"index_sz" is deduced from the write position,
instead of being redundantly computed.

Change-Id: Ic14f93886da61acc1735fbbe4f787e45a4ca79eb

Sebastien Alaiwan authored Jun 24, 2017 and James Zern committed Jun 24, 2017

This reverts commit a3d70911.

Reason for revert: this was fixed in cb637674 which moved the
definition to a different line causing this change to merge
cleanly, resulting in a duplicate.

Change-Id: I2d8763f0e2af320f043a1417ba33e82f82163592

_mm_set_epi64x is incompatible with visual studio x86 configurations

Change-Id: I7986e43d0471699553affeefabae66a512d9d46a

BUG=aomedia:621

Change-Id: I60b4fa9e5ebbef37bf1859a98d82c34821d2d02b

lead with '0 &&' to avoid string to bool conversion warnings

BUG=aomedia:621

Change-Id: I2cd6618377f9ed94f4d9dbc252f6f5cfc81efea4

This is to facilitate future experiment related to adapt_scan

Change-Id: I51628f3df81bd82db7f8f553d13da0ee5792d7d9

Fixed the compile warning when both global-motion
and warped-motion are disabled.

Change-Id: Ie3ac036fc6c0a15e54a56427452682d7ea7864db

0835e7b80 left out the required changes to aomenc.c for the KF numerator
arguments for resize and superres to work. This patch adds them.

Change-Id: I350b01c8b187188de5313fffaa15c1ec9f052469

NCOBMC_ADAPT_WEIGHT allow using different interpolation kernels
to combine overlapped predictions generated using mvs in the
neighboring blocks.
This experiment will build on top of MOTION_VAR and it might conflict
with WARPED_MOTION in the developing stage, so will only be effective
when MOTION_VAR is on and WARPED_MOTION is off.

Change-Id: I4f1b6e55b6146ed443955751c09bfa22ef2f33e8

The special path in build_inter_predictors for chroma blocks
corresponding to sub8x8 luma blocks would always fetch the
scale factors from 'xd', which correspond (at least in the
decoder) to the references of the block for which is_chroma_reference
returns true.

The correct behaviour is to fetch the scale factors from 'ref_buf',
which corresponds to the references of the block currently being
predicted.

This patch fixes some encode/decode mismatches which were caused
by the above behaviour when the various reference frames had
different sizes.

Change-Id: I48a0a167ea25d47d08018016cf8b77885b3b5d6b

Adds check to make sure that find transformation functions are
never called for 0 points.

Change-Id: I2d7cf40aace535b1d708d6189aea9c1e0f7c281b

this normalizes these tests with the regular variance ones both in
implementation and test list output

Change-Id: Iaa549f2e2a054d716c24f5a64baf700747c55295

BUG=aomedia:620

This reverts commit 4da880bd.

Change-Id: I40a2295083b3328ef743d3eab9c2aa514dc698eb

BUG=aomedia:615

Change-Id: I827e857d310020705a5292ef8fe817bc042d8dd0

Change-Id: Id22615d461bf16272d1b2e2c72ae7e00db8bcb5c

avoids overflow of unsigned integer.

Change-Id: Ic92974b508bb0cd6fc680203ffa6cff14d644ff7

Avoid compiler warning when global-motion is off.

Change-Id: Ie6a0d3e4efc0e06b263e8c8c0c0dc153738c3804

The test libs omitted the dependency on aom.

Change-Id: I47fe769252151cf0bf81f245452e22512963c9fa

Change-Id: Id0cd184e8b3cea085ecc3adbc7fea7bb765c7986

- First pass encoding time reduces ~10.9% on i7-6700
  at 100 frames, 1080p.
- avx2 works for coeff number >= 8 cases; coeff number < 8
  case will be implemented by sse2.
- Unit test is added type B/FP/DC.

Change-Id: Ibe5b7807c64e6dfc2d59c470ed50a6e8ca94ef7c

Previously, for block >=8x8, and tx < 8x8,
we skipped setting the early-exit flag in block_rd_txfm() because
distortion for sub8x8 tx block is from MSE but reference (best)
is from daala-dist.
However, not setting early-exit flag turned out to be the reason
for a regression in MSE probe mode of daala-dist because
it loses the chance to set rd_stats properly.

On the other hand, there is still a small regression, say 0.05% psnr bd-rate,
which seems to occur in the case that a tx block in a partition has chosen
the skipped rd_cost since it is smaller than non-skip rd_cost and
set the early-exit flag to 0 (so, not exit), but the daala-dist applied
to the whole partition cannot access the same info but can choose from
two kinds of rd_costs:
1) all tx blocks are skipped (even if a tx block has non-zero coeff) and 0 bits
2) sum of final distortion of all tx blocks (i.e. non-zero coeff decoded)
and bits to encode coeffs.

Change-Id: I2ec69972aa1f22d465293cb9e8d5e18ef2c6f7f3

Yaowu Xu authored Jun 21, 2017 and James Zern committed Jun 22, 2017

BUG=aomedia:618

Change-Id: Ie96ccc363462a28527c99a72e97b7acaf2ab0ff8

Change-Id: I013780b81b0de04a2a359bf65c44c3c3c5e0729f

Change-Id: Idded8f8774c10c53fba59e7b834583399e57225c

Change-Id: I46d77055765c0edcb615f1bb851fea10f6fc84ba

Adds an option bit in the bitstream syntax to allow chroma to
have restoration tilesize that is coupled to luma based on
subsmapling of the color components.

This is meant to ease encoder hardware implementation.

Change-Id: Ic3cc2b68c0f33701ed3ff2fe19cf57cd864da67f