1. 28 Nov, 2016 3 commits
    • Yaowu Xu's avatar
      Fix compiling of tests with emulate-hardware · 46f0f299
      Yaowu Xu authored
      CONFIG_EMULATE_HARDWARE disable SIMD versions of transform functions.
      This commits added !CONFIG_EMULATE_HARDWARE to get tests that use
      SIMD versions of transforms to compile.
      
      Change-Id: I4b9ef5a46ae8f12c439f4fe18766b95f8a520d34
      46f0f299
    • Yi Luo's avatar
      SAD avg and 4D avx2 optimization for ext-partition · 9e218747
      Yi Luo authored
      - User level time reduction <1% on i7-6700 cpu
      
      Change-Id: I8f15bde07dddd938df0b065e20ae94109e7b3b5b
      9e218747
    • Urvang Joshi's avatar
      Add a new intra prediction mode "smooth". · 6be4a54b
      Urvang Joshi authored
      This is added as part of ALT_INTRA experiment.
      
      This uses interpolation between top row and estimated bottom row; as
      well as left column and estimated right column to generate the
      predicted block.The interpolation is done using a predefined weight
      array.
      
      Based on experiments, the currently chosen weight array was created
      to represent a quadratic curve, but can be tuned further if needed.
      
      Improvement from baseline on Derf set:
      ALL Keyframes: 1.279%
      
      Improvement from existing ALT_INTRA:
      ALL Keyframes: 1.146%
      
      Change-Id: I12637fa1b91bd836f1c59b27d6caee2004acbdd4
      6be4a54b
  2. 23 Nov, 2016 1 commit
    • David Barker's avatar
      Improve rectangular transform accuracy · 838a53d6
      David Barker authored
      By adjusting the internal scaling and rounding in the transforms,
      we can adjust the maximum round-trip errors to:
      * 8x16 and 16x8: 0 pixel values (ie, transforms are exact)
      * 16x32: 1 pixel value
      * 32x16: 2 pixel values
      
      Change-Id: I0ba691a8d27042dcf1dd5ae81568d07a92d68781
      838a53d6
  3. 22 Nov, 2016 2 commits
  4. 21 Nov, 2016 2 commits
    • Yaowu Xu's avatar
      Replace int with uint32_t for non-negative values · 4ce287aa
      Yaowu Xu authored
      This also fix a few compiler warnings of comparison between signed
      and unsigned values.
      
      Change-Id: I1d633f4dfdffff73743dc3f373564056c6d58813
      4ce287aa
    • Yi Luo's avatar
      Fix rectangle transform computation overflow · 63bd6dc9
      Yi Luo authored
      - Add 16-bit saturation in fdct_round_shift().
      - Add extreme value tests and round trip error tests.
      - Fix inv 4x8 txfm calculation accuracy.
      - Fix 4x8, 8x4, 8x16, 16x8, 16x32, 32x16 extreme value tests.
      - BDRate: lowres: -0.034
                midres: -0.036
                hdres:  -0.013
      BUG=webm:1340
      
      Change-Id: I48365c1e50a03a7b1aa69b8856b732b483299fb5
      63bd6dc9
  5. 17 Nov, 2016 2 commits
  6. 16 Nov, 2016 1 commit
  7. 12 Nov, 2016 1 commit
  8. 10 Nov, 2016 1 commit
  9. 07 Nov, 2016 1 commit
    • Yushin Cho's avatar
      New experiment: Perceptual Vector Quantization from Daala · 77bba8d3
      Yushin Cho authored
      PVQ replaces the scalar quantizer and coefficient coding with a new
      design originally developed in Daala. It currently depends on the
      Daala entropy coder although it could be adapted to work with another
      entropy coder if needed:
      ./configure --enable-experimental --enable-daala_ec --enable-pvq
      
      The version of PVQ in this commit is adapted from the following
      revision of Daala:
      https://github.com/xiph/daala/commit/fb51c1ade6a31b668a0157d89de8f0a4493162a8
      
      More information about PVQ:
      - https://people.xiph.org/~jm/daala/pvq_demo/
      - https://jmvalin.ca/papers/spie_pvq.pdf
      
      The following files are copied as-is from Daala with minimal
      adaptations, therefore we disable clang-format on those files
      to make it easier to synchronize the AV1 and Daala codebases in the future:
       av1/common/generic_code.c
       av1/common/generic_code.h
       av1/common/laplace_tables.c
       av1/common/partition.c
       av1/common/partition.h
       av1/common/pvq.c
       av1/common/pvq.h
       av1/common/state.c
       av1/common/state.h
       av1/common/zigzag.h
       av1/common/zigzag16.c
       av1/common/zigzag32.c
       av1/common/zigzag4.c
       av1/common/zigzag64.c
       av1/common/zigzag8.c
       av1/decoder/decint.h
       av1/decoder/generic_decoder.c
       av1/decoder/laplace_decoder.c
       av1/decoder/pvq_decoder.c
       av1/decoder/pvq_decoder.h
       av1/encoder/daala_compat_enc.c
       av1/encoder/encint.h
       av1/encoder/generic_encoder.c
       av1/encoder/laplace_encoder.c
       av1/encoder/pvq_encoder.c
       av1/encoder/pvq_encoder.h
      
      Known issues:
      - Lossless mode is not supported, '--lossless=1' will give the same result as
      '--end-usage=q --cq-level=1'.
      - High bit depth is not supported by PVQ.
      
      Change-Id: I1ae0d6517b87f4c1ccea944b2e12dc906979f25e
      77bba8d3
  10. 05 Nov, 2016 4 commits
  11. 04 Nov, 2016 3 commits
    • Yushin Cho's avatar
      New experiment: Perceptual Vector Quantization from Daala · 09705fe7
      Yushin Cho authored
      PVQ replaces the scalar quantizer and coefficient coding with a new
      design originally developed in Daala. It currently depends on the
      Daala entropy coder although it could be adapted to work with another
      entropy coder if needed:
      ./configure --enable-experimental --enable-daala_ec --enable-pvq
      
      The version of PVQ in this commit is adapted from the following
      revision of Daala:
      https://github.com/xiph/daala/commit/fb51c1ade6a31b668a0157d89de8f0a4493162a8
      
      More information about PVQ:
      - https://people.xiph.org/~jm/daala/pvq_demo/
      - https://jmvalin.ca/papers/spie_pvq.pdf
      
      The following files are copied as-is from Daala with minimal
      adaptations, therefore we disable clang-format on those files
      to make it easier to synchronize the AV1 and Daala codebases in the future:
       av1/common/generic_code.c
       av1/common/generic_code.h
       av1/common/laplace_tables.c
       av1/common/partition.c
       av1/common/partition.h
       av1/common/pvq.c
       av1/common/pvq.h
       av1/common/state.c
       av1/common/state.h
       av1/common/zigzag.h
       av1/common/zigzag16.c
       av1/common/zigzag32.c
       av1/common/zigzag4.c
       av1/common/zigzag64.c
       av1/common/zigzag8.c
       av1/decoder/decint.h
       av1/decoder/generic_decoder.c
       av1/decoder/laplace_decoder.c
       av1/decoder/pvq_decoder.c
       av1/decoder/pvq_decoder.h
       av1/encoder/daala_compat_enc.c
       av1/encoder/encint.h
       av1/encoder/generic_encoder.c
       av1/encoder/laplace_encoder.c
       av1/encoder/pvq_encoder.c
       av1/encoder/pvq_encoder.h
      
      Known issues:
      - Lossless mode is not supported, '--lossless=1' will give the same result as
      '--end-usage=q --cq-level=1'.
      - High bit depth is not supported by PVQ.
      
      Change-Id: I1ae0d6517b87f4c1ccea944b2e12dc906979f25e
      09705fe7
    • Yushin Cho's avatar
      Fix the bool coder test · 3e4fcb4f
      Yushin Cho authored
      Fix the bool coder test not to use a probability of 100%.
      
      Change-Id: I799871cb0c48580edf0ee15a6c9931d27591ec99
      (cherry picked from commit 9b79f6a3)
      3e4fcb4f
    • Yushin Cho's avatar
      Fix the bool coder test · 9b79f6a3
      Yushin Cho authored
      Fix the bool coder test not to use a probability of 100%.
      
      Change-Id: I799871cb0c48580edf0ee15a6c9931d27591ec99
      9b79f6a3
  12. 01 Nov, 2016 3 commits
  13. 31 Oct, 2016 1 commit
  14. 30 Oct, 2016 2 commits
  15. 28 Oct, 2016 1 commit
  16. 27 Oct, 2016 1 commit
  17. 25 Oct, 2016 3 commits
  18. 24 Oct, 2016 1 commit
    • Yaowu Xu's avatar
      fdct4x4_test: fix unsigned overflow · 59b969da
      Yaowu Xu authored
      The difference between src and dst will be signed, the error will be
      unsigned. The change quiets -fsanitize=integer:
          unsigned integer overflow: 4294967295 * 4294967295
      
      Change-Id: I131cefcc9583ee8a5b98eb5182fd30e9c7237ea0
      59b969da
  19. 21 Oct, 2016 3 commits
  20. 20 Oct, 2016 4 commits
    • Urvang Joshi's avatar
      Remove some useless casts · 77853e56
      Urvang Joshi authored
      Cherry-picked from aomedia/master: 6796e7f1
      
      Change-Id: I8af087d97cadb0c2a9e37a4e4723246cdd397995
      77853e56
    • Urvang Joshi's avatar
      Add compiler warning flag -Wextra and fix related warnings. · d71a231c
      Urvang Joshi authored
      Note: some of these warnings are enabled by a combination of -Wunused
      (added earlier) and -Wextra.
      
      Cherry-picked from aomedia/master: 4790a69f
      
      Change-Id: I322a1366bd4fd6c0dec9e758c2d5e88e003b1cbf
      d71a231c
    • Yi Luo's avatar
      Fix the overflow of av1_fht32x32() in 2D DCT_DCT · 157e45a4
      Yi Luo authored
      - Use range check function to avoid DCT_DCT overflow.
        We need to re-develop the column txfm side scaling/rounding. Now,
        we prefer to maintain the current BDRate level.
      - Encoder user level time reduction <1% owing to av1_fht32x32_avx2.
      - Add MemCheck unit test and fdct32() unit test.
      
      Change-Id: I1e67030f67bc637859798ebe2f6698afffb8531c
      157e45a4
    • Peter de Rivaz's avatar
      Fix for AV1.TestTell · f994855e
      Peter de Rivaz authored
      The tell functions return an unsigned integer.
      This causes the AV1.TestTell test case to fail because
      -1 is greater than 20 when treated as an unsigned integer.
      
      Change-Id: I9dd1d7eb61260d30d1713a4917159fc6fe8eee42
      f994855e