This commit resolves the compression performance regression when
both compound rounding and compound segment are enabled.

Change-Id: I831b4e44d2b054aa74922eb0c541eaa2ac355e0e

Use multi-symbol CDF coding instead.

Change-Id: I8a69364c8672474021d2ea5933e344d493186967

The frame marked as last_bipred at the encoder side is the frame right
before the source frame of BWDREF_FRAME, which was not used as a
reference. This CL is to add this type of frames to the reference frame
buffer and use them as reference for the coding of future frames. This
is a non-normative change.

A tiny gain is observed (lowres BDRate -0.016% in avg psnr). The main
target of this CL is to make it possible to have more flexible gf group
structure. For instance, LAST_BIPRED_UPDATE can be replaced by
LAST_UPDATE followed by an extra alt ref frame.

Change-Id: If3dbce0959bb468e95d01a1feca1dac6bfb91d36

Add a new default motion_mode_cdf supporting this
experiment.
Also define the costs for the ncobmc mode tokens.

Change-Id: Iebab044e4a34e3d2a94c18893107d82055cc9c77

Change-Id: I89035a64414f9511789022704ad9343bc2937666

To make it compatible with frame_superres

Change-Id: Id1560e1477a09cfd27a4b4f17468be9c76d09013

Turn "allow_screen_content_tools" on when the source video has many blocks
with only few different colors. The automatic detection is enabled by
defualt (or with command line flag "--tune-content=default"). With
"--tune-content=screen", the screen content tools are always turned on.

On the screen_content test set, the "default" setting is less than 0.3%
worse than the "screen" setting on keyframe encoding.

Change-Id: Iac7ab8952c96531d1fae84da1823291f5987519c

This patch adds support for 4:1 rectangular blocks to various common
data arrays, and adds new partition types to the EXT_PARTITION_TYPES
experiment which will use them.

This patch has the following restrictions, which can be lifted in
future patches:

  * ext-partition-types is incompatible with fp_mb_stats and supertx
    for the moment

  * Currently only 32x32 superblocks can use the new partition types

There's a slightly odd restriction about when we allow
PARTITION_HORZ_4 or PARTITION_VERT_4. Since these both live in the
EXT_PARTITION_TYPES CDF, read_partition() can only return them if both
has_rows and has_cols is true. This means that at least half of the
width and height of the block must be visible. It might be nice to
relax that restriction but that would imply a change to how we encode
partition types, which seems already to be in a state of flux, so
maybe it's better to wait until that has settled down.

Change-Id: Id7fc3fd0f762f35f63b3d3e3bf4e07c245c7b4fa

Fix the chroma component boundary context update in the inter
residual rd search.

Change-Id: Ice8028386a8b3bf921e2bf523ad0d2dcea707c7a

This experiment replaces the 4-point Type-II scaled-output vp9 DCT
 transform with the 4-point Type-II orthonormal Daala DCT transform.
Right now the CONFIG_DAALA_DCT4 experiment depends on CONFIG_DCT_ONLY
 as it does not add an orthonormal 4-point DST.

subset-1:

monty-baseline-dctonly-squaretx-subset1 ->
  monty-dct4-dctonly-squaretx-subset1-rerun

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
0.0055 | -0.0132 | -0.0405 |   0.0261 | 0.0005 |  0.0246 |     0.0226

objective-1-fast:

monty-baseline-dctonly-squaretx-o1f ->
  monty-dct4-dctonly-squaretx-o1f

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-0.0215 | -0.1573 |     N/A |  -0.0131 | -0.0347 | -0.0390 |    -0.1121

Change-Id: Idef8f6e5525037d5bbb2d0927675c21d1922d69a

BUG=aomedia:652

Change-Id: I5d178fd101ac5c163249a82dfeacbf64091e8333

Also:
- Tidy up the BUILD_SHARED_LIBS section.
- Tidy up testing basics section.
- Make code block style consistent: always use fence style.

Change-Id: Iaa3bfd1895c38210e228d02cef41212d1e157427

Support override of the LIBAOM_TEST_DATA_PATH variable via
the CMake command line:

$ cmake path/to/aom -DAOM_TEST_DATA_PATH=path/to/test/data

Change-Id: Idb0f3394584c0d0dfab221b42c539f0ffb15dc65

Recently, sub8x8 inter mode decition functions have been
removed from the av1 codebase, so codebase does not allow
disabling cb4x4 anymore.

This makes pvq not working simply crashing
because we had disabled cb4x4 if pvq is enabled.
Hence, pvq has been fixed for cb4x4.

Also, if pvq is enabled, disable lgt and highbitdepth in the configure.

Change-Id: I2cb675c0dbc12bce60ed6a66c34ea3e907cc35b3

Change-Id: Ib5337dfa78b73059ad169ca98a07119aa991864b

WebM is the intended container here. The recent rollup
of libwebm regressed the output doctype.

Change-Id: I6e9e41bb59abf20f451e5576a4822fe06eb80478

Default probabilities were updated in
d1b8c2a3. Update
recently-added CDFs not covered in this commit
to use these probabilities for initialisation.

AWCY: -0.03%

Change-Id: I5c34d1e890ddb0757df41848a0acc8509fcd4772

Change-Id: Ib05eefeca1fd7819919d26f7ca52138c62306319

Fixes "aomenc: init_mode_probs: Assertion `sizeof(fc->motion_mode_prob)
== sizeof(default_motion_mode_prob)' failed"

Change-Id: I7b71304f50756ffd6e14b03fe338c0d624ce35c5

The cost of signaling the alpha symbol and the signs are added to the
DC_PRED rate in RDO.

Results on Subset1(compared to f9e04152b with CfL enabled)

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-0.3699 |  1.5330 |  0.8664 |  -0.2881 | -0.3107 | -0.2587 |     0.1954

Change-Id: Icd9827d11ee4ef29dfb527e636f0f380bcafa062

(1) Work with var-refs to remove redundant bits in ref frame
    coding;
(2) Add a new uni-directional compound reference pair:
    (LAST_FRAME, LAST3_FRAME);
(3) Redesign the contexts for encoding uni-directional reference frame
    pairs;
(4) Use aom_entropy_optimizer to collect stats for all the default
    probability setups related to the coding of reference frames.

Compared against the baseline (default enabled tools excluding ext-tx
and global-motion for encoder speed concern) with one-sided-compound,
the coding gain of ext-comp-refs + var-refs - one-sided-compound is:

lowres: avg_psnr -0.385%; ovr_psnr -0.378% ssim -0.344%
midres: avg_psnr -0.466%; ovr_psnr -0.447% ssim -0.513%

AWCY - High Latency:
   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-0.2758 | -0.1526 | -0.0965 |  -0.2581 | -0.2492 | -0.2534 |    -0.2118

AWCY - Low Latency:
   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-1.0467 | -1.4500 | -0.9732 |  -0.9928 | -1.0407 | -1.0180 |    -1.0049

Compared against the baseline (default enabled tools excluding ext-tx
and global-motion for encoder speed concern) without
one-sided-compound, the coding gain of
ext-comp-refs + var-refs - one-sided-compound is:

lowres: avg_psnr -0.875%; ovr_psnr -0.877% ssim -0.895%
midres: avg_psnr -0.824%; ovr_psnr -0.802% ssim -0.843%

Change-Id: I8de774c9a74c20632ea93ccb0c17779fa94431cb

Fixed a bug in my previous patch that causes a compile error (variable 
block undefined) when pvq is on. 

However, with or without LGT, --enable-pvq still has a run time error 
during encoding. This run time error is independent of the LGT 
experiment.

Change-Id: I98ca5f69a916ea8556e45b820c2eb741c9656277

Building with --enable-dct_only will force the encoder to use only
 tx_type == DCT_DCT.
This experiment gives a loss and is only added for testing.

subset-1:

master@2017-02-21T01:23:58.825Z ->
 master-dct_only@2017-02-21T02:57:28.585Z

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
2.5467 |  1.0524 |  0.9171 |   1.8849 | 2.6626 |  2.4995 |     1.8402

objective-1-fast:

master@2017-02-21T01:47:43.790Z ->
 master-dct_only@2017-02-20T16:54:03.578Z

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
1.6625 |  0.3948 |  0.3368 |   1.5268 | 1.7142 |  1.7097 |     1.0743

Change-Id: I19b738f3d1a450bc50422149ac42bc184bfae08a

Global_motion, obmc and warped_motion are now permanently
mutually exclusive.

Change-Id: Ib1a1207cc7caa6459a2027c6c4a50fcf4c451e76

Change-Id: I472775a6877721f5ebee6b14f760227546110b7a

Uses a better non-normative scaler to scale reference frames.

Change-Id: I44b689c8328d6e6fd467c70c9b6b789874818153

Use the uniform way to compue the cost of symbols in AV1.

Results on Subset1 (compared to 8a516a8f with CfL enabled)

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-0.0357 | -0.0854 |  0.0305 |  -0.0422 | -0.0097 | -0.0171 |    -0.1042

Change-Id: Ie908fc7d20c480634002c78027b070223b3ea96d

Alpha's biggest fraction is 1/8, so Q3 does not change the bitstream.

Results on Subset1 (compared to 503aca74 with CfL enabled)

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000

Change-Id: I1fe5b2ace97179d5f950d7406a4f3d391924f89d

Change-Id: Id8789a2c352a7c7940e5cabff39acd0d7a584cac

Set LOG_SWITCHABLE_FILTERS accordingly to USE_EXTRA_FILTER

Change-Id: I453fe201a66ec725061899337b17d517c57b9e7a

Change-Id: Idfcc4e19143a45e0729829301acb1e3b711faff0

The allow_lowbitdepth shouldn't be exported to the API at all.
This is a temporary hack to allow API users such as the analyzer,
inspector, and simple_decoder.c to function correctly.

Change-Id: Id171cc0c24d78216647e949a1dc30a81f4cc826d

Change-Id: Ief1fc77294397c32121dc666e09a9a802ff5b7d4

Should always use AOM_ICDF() macro for compatibility with multiple
symbol coding related experiments.
This commit has no effect on metrics.

Change-Id: Iab2c8f2a1234a36ebd1ec4307079d5344214608b

A python script is provided to accumulate stats from counts.stt
files generated from multiple encoding examples. Command line:
python ../../tools/aggregate_entropy_stats.py [dir of stats files]
 [keyword of filenames] [filename of final stats]

Plus cosmetics on output format of optimized prob tables. The comma
after the last element of each dimension is removed, i.e.,
before: {
          { 128, 128, 128, },
          { 128, 128, 128, },
        }
after:  {
          { 128, 128, 128 },
          { 128, 128, 128 }
        }.
The reason is to avoid moving '}' to a second line after applying
clang-format.

Change-Id: I3b764f4c89b7aefbaf48ac00b8c83713caf75a5d

Change-Id: I9bc925ab9b93f5318eb3f1aa3401ff3de2851fef

Change-Id: If7e9ef6509a1be821484f081152bec47ea55cb00

Change-Id: Ibb3a2c8c855fffe6fd75a94da09425d784709431

Change-Id: I9fe592d6fc4bd2cffea8cbc5ac80138f28182ef8

Removing these flags make the EC_ADAPT experiment an integral part of
 the draft AV1 bitstream definition
This commit has no effect on metrics.

Change-Id: Ice78520935e8bfa9d25cf4b8384a1b872069d09c