GitLab

this change makes parallel deblocking experiment works with
cb4x4. the inner loop process every 4x4 block.

Change-Id: I86adb3d7b6d67a91ccc12aab29da9bfb8c522cf1

Remove the special rate-distortion optimization loop for sub8x8
block size from vp9.

Change-Id: I62c6cf537a54769f26f2d4938ebed5fed2c84741

Move the large stack allocation from stack initialization to
dedicated mem space. This resolves the extremely large stack issue
when ext-partition, motion-var, and high bit-depth are all turned
on.

BUG=aomedia:415

Change-Id: I85b77bbc6429093fcb0152176d9e237087d6bbd8

This function will be applied to the last non-zero coeff to
calculate the cost difference including eob change

Change-Id: I471aa74600c41fd371447ec121d113c79bd767b8

For intra edge filtering experiment, replace the 2x iteration
(5-6-5) filter with a 5-tap filter (2-4-4-4-2).

BDrate (1 key-frame) for this change:
cif:    +0.02%
midres: +0.04
720p:   -0.01
1080p:  -0.03
4k:     -0.01

BDrate (1 key-frame) for intra-edge experiment:
(05/31, disable rect-tx, ext-tx, delta-q, ext-delta-q)

          1 key-frame     60 frames
         PSNR   SSIM     PSNR  SSIM
cif:    -0.02   -0.01   -0.03  -0.01
midres: -0.02   -0.02   -0.05  -0.10
720p:   -0.36   -0.39   -0.05  -0.06
1080p:  -0.75   -0.88   -0.22  -0.27
4k:     -0.91   -1.12   -0.45  -0.54

Change-Id: I834037e662b4483d4d6bdceb1c1624d56ba293a4

The place where av1_daala_dist() is applied for sub8x8 partition is
moved from sub8x8 mode decision functions to rd_pick_partition().

BD-Rate change by daala-dist with '--disable-var-tx' is:
(AWCY, objective-1-fast, high delay mode)

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
15.1558 | 12.9585 | 14.4662 |  -3.8651 | -1.7102 | -9.2956 |    10.8686

In MSE probe mode:

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
0.0429 |  0.0435 |  0.1651 |  -0.0415 | 0.0850 |  0.0122 |     0.0546

Change-Id: I3b2ea916d41c48e433eb641adf44552e4725c198

This function computes the overall (i.e. self and neighbors') cost
difference caused by downgrading a coefficient by one level at
a specific location

Change-Id: I1b7b6acfe06ed06b9a2ff48b5bb11527646d1aa8

try_self_level_down() computes the cost difference of the coeff
that is downgraded by one level

get_level_prob() computes the probability of level_map coding
at a specific position and level.

Change-Id: Iaa9d40477aaf798993c2d5d26341551db665902b

This function pre-generate counts/magnitudes of each level map
such that we don't have to re-calculate the counts/magnitudes
while doing the optimization.

Change-Id: Ifdfc89522cf2f2b9f3734d451324081f42b47cb0

Change-Id: I085f2bc706fde41afbee5ff48b56acc095f804c2

cb4x4 itself should not require these sizes.

This simplifies compatibility with other experiments, since we can
first make them work with cb4x4 (which is now on by default), and
then worry about chroma_2x2 (which is not) in separate steps.

Encoder and decoder output should remain unchanged.

Change-Id: I4e9fcdae49f238b5099a3c74a398fe993c2545f8

Update and capture the effective transform block size per color
plane.

Change-Id: Ib6e0e7abb3973db6b8d511ee7c9948aaab048788

Make sure initialization is done regardless of whether RD search
is skipped (skip_chroma_rd).

BUG=aomedia:568

Change-Id: Idb620b34be6930bb35ab6c912dfd4777f7614159

Change-Id: I995b1ba6b1dafeceb1e75a3d71d6630215a8df68

Change-Id: I8deea1d2a76ce8c36085d19362ac2508fd3c438f

(1) Make unit tests for masked sad/variance encoder-only
(2) Fix compile error with intrabc
(3) Fix warnings reported by static analysis

Change-Id: I0cd2176fcda0b81e1fc30283767678376ced4c42

Patch https://aomedia-review.googlesource.com/c/12602/ made the
variable 'sum' in the warp filter unsigned, to indicate that its
value should always be >= 0. But 'sum' is used to accumulate
signed values, and it is expected that some of those values
will be negative.

The issue is that, when running 'x += y', if x is a uint32_t
and y is an int (and is 32 bits), the C standard says to
convert y to a uint32_t before doing the addition. This causes
overflow, and so undefined behaviour, if y < 0.

This is fixed by making 'sum' signed, and by explicitly bounds
checking against zero at the end of the filter.

BUG=aomedia:572

Change-Id: I1d484b5f5698db0ec9761807610b3b2b35647983

Change-Id: Id2be191fb48ed8d65b452499e1a1a1f470359321

Make the txfm_above and txfm_left be processed in the unit of
miniumum transform block size. Scale the transform block step
size with respect to the mode_info step size.

Change-Id: Iee4421e005db742cd4ff7899215560063e5f68e5

Change-Id: I56c790821c1035e06d53392fbfee4fb4b7ed8b4d

BUG=aomedia:571

Change-Id: I9779e341def6329a1d30a59d030b4b72819bf592

Resolve the enc/dec mismatch issue when filter intra is turned on,
in addition to chroma-sub8x8, ext-tx, and ext-inter experiments.

BUG=aomedia:570

Change-Id: Idf0875763ce24bd8d4022f7338fc86debf4dfd0c

Change-Id: I68f8cc50d81a0cac116c6f342202b85ad2e6e3b2

Change-Id: Ib94d57b24d3276dd74abe151f740258d78ff430b

The masked variance functions can read slightly off the
(nominal) end of their input array. This is not a problem,
since the extra data is never used, and when the functions
are used in the encoder proper, they will just read data
from the frame border.

However, the arrays in the test case had not been properly
padded, causing ASan to complain about reading off the end
of an array.

Also remove an accidental comment in the code.

BUG=aomedia:569

Change-Id: Icb5cf4d39ee50fc6e1b807f483940d7a7b12ce63

* Simplify the C version of the warp filter to make the intent
  of the code clearer
* Replace saturate_uint() in the C warp filter with an assertion
  that the intermediate values are in-range. This is because they
  should (provably) *never* go out-of-range.
* Add a comment describing the intended hardware architecture
* Miscellaneous comment updates

Change-Id: I798736f923ece599f22d573d31c5dfccd18b2d0e

BUG=aomedia:526

Change-Id: I5d9b86a36f412ded2d6f20e198d2f4de4f97aaeb

BUG=aomedia:542

Change-Id: Ifceffa29d87d12c37ae1563350101415631eaa00

Parts of it are causing doxygen to emit warnings, and
AOM's doxygen configuration doesn't produce XML output.

Change-Id: I34271721b64f369dfc51b9be3f508db2bfcb5633

Change-Id: I7bceace31c118993228168ec04f12319a9011f6b

Change-Id: If8f8e1a0032e914beb3ec3bcde221fe4a5605139

Change-Id: I05b2c8c116b5e3287be2703e840a28f6dda9c42a

Change-Id: Idc7bb686f5751b0457c9f21daac0fa6f4865fd22

This avoids the use of uninitialized value in palette encoding.

BUG=aomedia:568

Change-Id: I1000b28d9acf25a70ef641d4494f0b116a4ca071

Change-Id: Iac66b12dc6b1e6c3bc3c3ae54af45a97c81e34de

Resolve an enc/dec mismatch issue in new-tokenset and var-tx.

BUG=aomedia:567

Change-Id: I9bd8ec4c7716bca3a5e551b6e9838fc8ef37f198

Change-Id: I013c15acdfb968702360bd7deb231900f7880f49

Fixes AV1/AltRefForcedKeyTestLarge.Frame1IsKey test.

Change-Id: I457b5c1dacb9fd2294c650d11821d6a1930d04dc

Implements the high precision Wiener filter with an offset
to reduce the error due to saturation without increasing
the number of bits needed for intermediate precision.

Also turns the high precision filter on.

Change-Id: I34037a5746a6a89c5fce67753c1b027749085edf

BUG=aomedia:561

Change-Id: I6dc0fd97f29bfa0302abb6e90802674c1aa65674