This commit fixes the 2x2 transform system setups for high bit-
depth setting. It enables the cb4x4 mode to support high bit-depth
process. The coding performance is improved over high bit-depth +
ref-mv:

lowres  2.5%
midres  1.2%

Change-Id: I351f9d72bdc7e15b2bd00e94286b98966a295e6d

Remove unused chunk of codes for sub8x8 inside this function.

Change-Id: Ie49d707b3ceeeee3b439e46c9d0e63abd4ae104c

* Fix a bug in warp_erroradv introduced by previous patch
* Add highbd version of the new warp filter

Change-Id: I791d3a97baf86f0cbfc72880776848f93df6daa6

Also fixes a bug with rectangular transforms

Change-Id: Id459c18d8fdc767678452e0b20c4168a412f4de7

This commit fixes the tile decoding parameter control for ext-tile.

Bug=aom:122

Change-Id: I2cb702cee8d1e8083915c3a2d15c68927414b91c

Change-Id: I5bc018b22690f47a6b4507da872bffde4b6983c8

Change-Id: I38259c4074f77a8941baefbe7585fff2eded6b12

Add 2x2 forward and inverse 2D-DCT for high bit-depth.

Change-Id: I3092a2587a0cdc6675a69cc9203499a530b65325

Provide primitive modules for cb4x4 mode use. This resolves compiler
warnings when both high bit-depth and cb4x4 mode are turned on.

Change-Id: If6ecac50578b3e665b602419a0701c3e047ce623

this is a precursor to requiring toolchains to support c99

BUG=aomedia:111

Change-Id: Ic501ea074e738fe7870ce3f56fb6e87a509632fd

This commit adds a compiler flag to gcc to warn stack size greater
than 300Kbytes.

Change-Id: I4bd0680de435373fc46bfd8d5b80a610dbaddad8

This commit reduces number of video frames used in tests to avoid
timeouts in nightly run of "libaom__example_test-multi-target".

Change-Id: I842339d0e2c36f39f2d84ccc7b131d8ebaf2347c

The mv cdfs are updated below in calls to av1_set_mv_cdfs().

av1-master@2016-12-19T17:27:14Z -> av1-set-mv-cdfs@2016-12-19T17:27:54Z

  PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000

Change-Id: I6061602a4f2cc91dadf79e39d513c9678b9d2075

When enable_optimize_b is false in av1_encode_intra_block_plane the
entropy contexts were never initialized.

No changes on metrics for objective-1-fast when no experiment is
enabled.

Change-Id: Ic68913f6400d2becbaec3cc14214a0257530ed0b

This commit allows the dynamic motion vector referencing system to
scale its search range according to the coding block size. This
provides higher search resolution for smaller size coding unit.

The cb4x4 mode improves the compression performance across all the
test sets:

         avg     low    mid    high
lowres   2.8%    2.4%   3.1%   3.0%
midres   1.3%    0.3%   1.8%   2.7%
hdres    0.9%    0.5%   1.4%   1.5%

Change-Id: I1bc501506a9f2f06071c5274391f6bd053b235a7

Use the proper scaling factor to decide if a block is sitting on
the frame border. This refactor does not change the coding
statistics of the code base. It fixes an enc/dec mismatch issue
due to out of boundary memory access in the cb4x4 mode.

Change-Id: Ia1e999c0f4e4ef10aac6120e69c1fb10a738dd4d

Refactor the fill_token_cost() function to automatically compute
the token cost arry for all transform block sizes.

Change-Id: I2f44c9c08fb169bc14282ba48bce23577b1ab184

This commit allows the forward model update for 2x2 transform
block size.

Change-Id: Ie08c401e488b3872be0d92640468857f0aa0d0b3

Also make sure that qindex is clipped to the quantizer range.

Change-Id: I3163da4b45e190f9ab34982d1bbbefa5cba7514e

Test "decode_to_md5_av1" is to detect unintentional bitstream changes. 
As AV1 bitstream has changed, the md5 used in the test needs to be 
updated to reflect the changes. This commit update the md5 as of current
git#be128601.


Change-Id: I9b8b37e48496be4b811a27a484eb9348ef2bc45b

Do not merge; the highbd filter is not implemented yet.

Change-Id: I8f3322f5ab932b0f2e45f3590c135b70d711d915

Change-Id: Ia1757d580dd230d9e743b1f8c3e87df164008684

AV1FrameSizeTestsLarge.ValidSize test failed on x86-win32-gcc due to
running out of memory. This commit reduce the image size for the test
to avoid the failure.

Change-Id: Ie081878c7a57b9c453a25e990f446cc3f57704a4

This commit makes the encoder to properly account for all transform
block sizes when combining statistics from encoding threads.

Change-Id: I010acd3b247dc890f63756d3d1436b1fb52ea2d9

This uses a segmentation mask (which is temporarily computed arbitrarily)
to blend predictors in compound prediction. The mask will be computed
using a color segmentation in a followup patch.
Change-Id: I2d24cf27a8589211f8a70779a5be2d61746406b9

Change-Id: I18cc994f31d33f59f38f798f6629fe180026e066

Change-Id: Ie7a5de671eee19b1bc1609200968c6ecb083f569

Change-Id: I53f5a9858b4b488f670cdf89ab75638dee979df9

Change-Id: I62b662052a4b9b1de07575824410aa9b2ce2c924

Change-Id: I0005c896a243275c052a0163a5da0f9230071743

This function corrected for the fact that the old bilateral and
Wiener filters would not write to the outermost 3 pixels of the
destination. Now that the bilateral filter has been removed and
the Wiener filter has been rewritten, this is no longer necessary.

No effect on performance

Change-Id: I3f3b0a759bdb9ff1e2407affe963388e76a9c9e6

Change-Id: I4c4300f3f565d8aecf65669b77aaa874bb73a3a0

- Apply changes on tx_size: 4x8, 8x4, 8x16, 16x8.
- Turn on corresponding unit tests on SSE2.
- Partially fix aomedia:113.

Change-Id: I29d15540ab8e9e3681e9caa54e5162bcbbd7af11

This commit fixes the 2x2 d45 intra prediction. It avoids the use
of out-of-boundary position as reference. This resolves an enc/dec
mismatch issue in cb4x4 mode.

Change-Id: I93d01536a0c004190cc9fe3c724bf41364f6fdde

This resolves an enc/dec mismatch issue in the intra prediction
modes.

Change-Id: I8655621332d955e718b9341e208e837c91e2acf0

Also includes some minor renaming of macros.

Change-Id: I9493cc97c6ec9c8dae8020a05a02d6f322db9a02

Failure brought by 45dc597a

Also harmonize the high-bit-depth and regular versions
of directional intra prediction.

Change-Id: I7ed6602ccbfb53470cb7e9d8f428b17a860ca596

When PVQ is on, we reencode at the end of choose_tx_size_type_from_rd to
get the entropy contexts right, previously this was done using
txfm_rd_in_plane but this is different from the encodes done in the loop
which use txfm_yrd, the result is that rd_stats is set incorrectly at
the end of choose_tx_size_type_from_rd when PVQ is on.

Results on objective-1-fast with --limit=5:

   PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
-0.5803 | -1.0598 | -1.4565 |  -0.3377 | -0.8153 | -0.5934 |    -0.9943

See https://goo.gl/Hvv0E2

Change-Id: Iccc7b0afaff849f959a0084eb48dbb838bc3cb1a

Stop reading partition information at 4x4 block.

Change-Id: I2b33f5ad307aa3051a1b1e230b7f6953ec6cecc6

Change-Id: Ic2fbc66e9212da32930c6a8ba1a749e3a37c5b9a