1. 15 Sep, 2017 13 commits
    • Nathan E. Egge's avatar
      Add the DAALA_TX experiment. · 4e884047
      Nathan E. Egge authored
      Change-Id: I408dbcf69b3f680e5de570e080ce39aeacbf618d
    • Yi Luo's avatar
      Enhance intra pred speed test to include highbd pred · f5d71a69
      Yi Luo authored
      This is a manual merge from libvpx's commit:
      "05ee24149 Add high bitdepth intra prediction
      optimization speed test". Credit goes to Linfeng Zhang.
      Change-Id: Ie254593aa9b601889ecb95eca900365055d46a03
    • Yi Luo's avatar
      Fix a baseline build error · 2e6a9ab9
      Yi Luo authored
      Change-Id: I9b92caa9d65a3b062762c270c89018c8e08eba0f
    • Angie Chiang's avatar
      Turn off TestResizeCspWorks under conditions · 1ff7d9ab
      Angie Chiang authored
      DISABLE_TRELLISQ_SEARCH will incur failure of TestResizeCspWorks
      Change-Id: I70d51b9a490b251ebd7743faf831da54b94e48c7
    • Luc Trudeau's avatar
      Fix Dead Store in rdopt.c · 1f7c4114
      Luc Trudeau authored
      Change-Id: Iad6a16d3ab819405de037d5100060710e0636176
    • Nathan E. Egge's avatar
      Disable daala_dct64 if tx64x64 is not enabled. · 72e0f783
      Nathan E. Egge authored
      Change-Id: Ib19d9431124b2416abe4a217138ec8bdb029f73c
    • Nathan E. Egge's avatar
      Fix highbd_iht_test with 4, 8, and 16 daala_tx. · 71b0513b
      Nathan E. Egge authored
      This change fixes a compile error when all three of --enable-daala_dct4,
       --enable-daala_dct8 and --enable-daala_dct16 are enabled at once.
      Change-Id: I4942e09fb887afbda2eda6aaacec727b5cbf6f50
    • Yushin Cho's avatar
      Enable 'dist_8x8' experiment by default · 255ff990
      Yushin Cho authored
      This experiment has been agreed to remove its flag in
      Sep 12 AOMedia Codec WG meeting.
      We first soft-enable it until it gets stable.
      The provided encoder option "--tune=[cdef-dist | daala-dist]" is turned
      off by default, hence there is no change in bd-rate.
      Change-Id: Ib4553125bbaeff5a98542b39cba942496337f901
    • Yushin Cho's avatar
      Fix a static analyzer warning · ee810273
      Yushin Cho authored
      Also fix asan warnings.
      Change-Id: I21fe3150635540abacb5b1b8928c6470db605035
    • Angie Chiang's avatar
      register_state_check: simplify Check() methods · 74acf004
      Angie Chiang authored and James Zern's avatar James Zern committed
      - make Check() void as the EXPECT's are sufficient to document failure
      cumulatively this has the effect of avoiding reporting incorrect Check()
      failures due to earlier test failures.
      This CL is ported over from
      f8c27d164 register_state_check: simplify Check() methods
      Change-Id: I1b65aa769c69c2a52b2e0b363f1c4432965ee89f
    • Yi Luo's avatar
      Enhance intra pred unit test to verify rectangular pred · da9e4afe
      Yi Luo authored
      Add a macro to improve the readibility of test case. The
      coming test cases varying on mode/size would expand the
      list too large.
      Change-Id: I74171344098820b21090dd9b857229bdf2e77248
    • Zoe Liu's avatar
      Add encoder support for multi-layer GF 16 · 8dd1c980
      Zoe Liu authored
      Currently the use of the new multi-layer GF group of 16 is guarded by
      the macro USE_GF16_MULTI_LAYER, which is turned off. Hence this CL
      does not change any of the encoder behavior.
      Change-Id: I588cd34e19388337a2ecb0a0cb3f796a37647e24
    • Yunqing Wang's avatar
      Further refactor setup_ref_mv_list · d1121fa3
      Yunqing Wang authored
      This patch follows the previous refactoring patch, and further reduces
      the number of calls made to scan_row_mbmi and scan_col_mbmi by going
      through partition blocks instead of mi blocks. This patch doesn't change
      bitstream, which was proven by Borg test result.
      The baseline decoder speed test on 1080p clip showed that the average
      decoder speedup was 1.1%.(fps: 32.626 --> 32.994)
      Change-Id: Ic375ae5d682c7454e2f2a2fcf8baa6b4b438d9a6
  2. 14 Sep, 2017 1 commit
  3. 13 Sep, 2017 9 commits
    • Sarah Parker's avatar
      Use default reference gm params in error resilient mode · f289f9f5
      Sarah Parker authored
      This allows gm parameters to be written when error resilient mode
      is enabled but avoids depending on stored parameters from the
      previous frame.
      Change-Id: Iae455a346e0eebb18e2bcfadc8826c75aedfee99
    • David Michael Barr's avatar
      [CFL] Fix typedef-redefinition compiler warnings · 5b2021ea
      David Michael Barr authored
      Instead of forward-declaring AV1_COMMON and MACROBLOCKD,
      move the dependent struct and function prototype closer
      to where they are used and after these types are defined.
      Change-Id: I75f005b46ef322a6fcbc01377b8dded1637c5f73
    • Rupert Swarbrick's avatar
      Teach inspector about 4:1 block sizes · a5263757
      Rupert Swarbrick authored
      Change-Id: I5d60cc74233bf7ddf56bcd0c3e8b8d012a6e5a63
    • Rupert Swarbrick's avatar
      Hide repeated arguments in calls to count_segs in count_segs_sb · 114e81a3
      Rupert Swarbrick authored
      The calls to count_segs appear very different from each other, but
      this is really just because of line wrapping (enforced by the
      clang-format linter). This patch produces equivalent code but the
      results are far easier to read.
      Change-Id: I9d548a4988d4ef23f71fbd8afc855eb8a43f7bd5
    • Rupert Swarbrick's avatar
      Simplify get_partition() implementation · 136d5c17
      Rupert Swarbrick authored
      This function is given a bsize and an mi array and has to figure out
      what partition to use to divide the given bsize in the direction of
      the sizes it finds in the mi array. (Since each block size can be
      reached by only one sequence of partitions, this can be done
      The previous version was correct, working by looking up entries in the
      partition_lookup array. Unfortunately, that lookup isn't quite enough
      when CONFIG_EXT_PARTITION_TYPES is true, so it then had to do some
      slightly confusing computations to fix things up after the fact.
      The new version should be more self-explanatory and doesn't work by
      looking things up in a magic array. It looks up the width and height
      corresponding to bsize and compares them with the width and height
      corresponding to the sb_type at mi_row,mi_col in the mi array. When
      CONFIG_EXT_PARTITION_TYPES is false, this is all you need, and the
      four corresponding cases can be found by a lookup in an array of 4
      With extended partition types and a sufficiently large block, you have
      to do a bit more searching. For example, if bsize is BLOCK_16X16 and
      the subsize is BLOCK_8X8, the partition might be PARTITION_SPLIT, but
      it might be one of PARTITION_HORZ_A or PARTITION_VERT_A instead. The
      new code adds some comments to explain what's going on.
      A nice side-effect of rewriting get_partition in this way is that it
      lets us completely dispense with the partition_lookup array.
      The patch also fixes comments for the A/B extended partitions in
      enums.h, which were slightly backwards (a "horizontal split means two
      blocks vertically above one another)
      Change-Id: I4b48189103aa63e1859f25a15d7690d53ca7baf5
    • David Barker's avatar
      aom-qm: Fix overflow in quantizer calculation · 568b7c7e
      David Barker authored
      By using a combination of a small qmlevel and large qindex,
      it is possible for the quantizer 'dqv' to end up > 2^15.
      This currently causes dqv to overflow, so widen its type
      to avoid that.
      Note that this is certainly an extreme case, but not entirely
      useless - if using a 32x32 transform, the dequantized value
      can be as small as dqv/2, which may still fit in 16 bits.
      Change-Id: I0451e70ba6b17620d94386a98d873f0a8c615635
    • Rupert Swarbrick's avatar
      Report a proper error when bitstream wrongly requests prev_frame_mvs · bdfb4a6f
      Rupert Swarbrick authored
      Using an assert (which was compiled out) meant we got to a
      use-after-free in bug 729.
      Change-Id: I4d0fa5e80322c395f94565c76e2285782c328505
    • Debargha Mukherjee's avatar
      Change/refactor compound mode handling for sub8x8 · 0f248c46
      Debargha Mukherjee authored
      Turn off compound modes as long as one of the dimensions
      is less than 8.
      Imapct on AWCY (0.05% increase in BDRATE)
      Change-Id: I4a70890c04149246a50e60990dede21cb8052fad
    • Yushin Cho's avatar
      Fix compile error when both of dist_8x8 and pvq are enabled · 39086c0b
      Yushin Cho authored
      Remove mistakenly leftover code from commit
      Note that this change force-disables activity masking in PVQ until we can add some
      bitstream signaling for it.
      Change-Id: I5279f82e7977733ebc40f5aed844ecec1279992a
  4. 12 Sep, 2017 7 commits
    • Zoe Liu's avatar
      Remove duplicate line of code · 10a051fc
      Zoe Liu authored
      Change-Id: Ie92a17d6c530bdd65464fbc599ce92561b8c0428
    • Jingning Han's avatar
      Remove unnecessary rate cost setup in lv-map encoding · ba42e749
      Jingning Han authored
      This won't change the coding statistics.
      Change-Id: Ibe3790836c59462f830029528d88a6e615efa493
    • Debargha Mukherjee's avatar
      Ensure consistent border extension before LR · fc9f3ccd
      Debargha Mukherjee authored
      Before LR the border extension needs to be consistent.
      Otherwise there will be inconsistency at the frame boundaries
      causing mismatches.
      Change-Id: I5b0c51aa1493c58f7acc706bf686ce711eadd75d
    • Nathan Egge's avatar
      Revert "Add an orthonormal 4-point Type-VII DST." · 5a5e1adb
      Nathan Egge authored
      This reverts commit 72c99e1a.
      No metrics on this commit.
      Change-Id: I9fc350b25e710c3d5d6d8299ab5348e8b31b39ea
    • Nathan E. Egge's avatar
      Add an orthonormal 4-point Type-VII DST. · 72c99e1a
      Nathan E. Egge authored
      Replaces the orthonormal Type-IV DST with an orthonormal Type-VII DST
       in od_bin_fdst4() and od_bin_idst4()
      Change-Id: I4ff0888e740d8cc063a2e5deaeceef7cb0d80485
    • David Barker's avatar
      Clarify comment in av1_set_mb_mi() · ee0fd929
      David Barker authored
      The code currently pads the decoded frame width and height to a
      multiple of 8 luma pixels, but there is a TODO suggesting that
      this may be changed to only require a multiple of 4 in future.
      But, as per the comments on the linked bug, there are good reasons
      to keep the decoded width and height as multiples of 8. So delete
      the outdated TODO and instead outline the reasons why the current
      behaviour is helpful.
      Change-Id: I2340bbcd740afe74c2e6fb3cf2e7a420db2b4f40
    • Luc Trudeau's avatar
      Chroma Fix for Superblock CDF update · d7150530
      Luc Trudeau authored
      UV_INTRA_MODES must be used for chroma modes
      Change-Id: I3e72d16204d11062a850fd00fb6272358dd61aac
  5. 11 Sep, 2017 9 commits
    • Sarah Parker's avatar
      Tokenize and write mrc mask · 99e7daa2
      Sarah Parker authored
      This allows a mask for mrc-tx to be sent in the bitstream for
      inter or intra 32x32 transform blocks. The option to send the mask
      vs build it from the prediction signal is currently controlled with
      a macro. In the future, it is likely the macro will be removed and it
      will be possible for a block to select either method. The mask building
      functions are still placeholders and will be filled in in a followup.
      Change-Id: Ie27643ff172cc2b1a9b389fd503fe6bf7c9e21e3
    • Jingning Han's avatar
      Use per tile model update for coeff_br coding · e29c9260
      Jingning Han authored
      Change-Id: Ie52d52bc25e3fdfdea877349215431d8edc064a3
    • Jingning Han's avatar
      Fix base range counter index in lv-map decoding · 2e40574e
      Jingning Han authored
      Fix the index order of br_idx.
      Change-Id: I55acda816d1ec33c25ca4c31b09976f5e6f9c562
    • Soo-Chul Han's avatar
      add SEG_LVL_ZEROMV · a752d1d5
      Soo-Chul Han authored
      Change-Id: Icd04302886a4d12890d04f9f15563169a91e3a0d
    • Zoe Liu's avatar
      Add support of multi-layer GF group 16 to bit allocation · c3903ff2
      Zoe Liu authored
      Change-Id: I52a7ae7404f15f29a0a0b892884cf0edea619507
    • Zoe Liu's avatar
      Define coding parameters for GF group of 16 · 8679f417
      Zoe Liu authored
      Propose the coding structure for GF Group of 16 to use the following
      multi-layer design:
        1st Layer: Frame 0 and Frame 16 (ALTREF)
        2nd Layer: Frame 8 (ALTREF2)
        3rd Layer: Frame 4 and 12 (ALTREF2)
        4th Layer: Frame 2, 6, 10, and 14 (BWDREF)
        5th Layer: Frame 1, 3, 5, 7, 9, 11, 13, and 15
      This CL implements the reference frame update for a GF group of 16
      using a look-up table, which is different from the current
      implementation. The motivation behind is to try out various GF group
      coding structures simply through manipulating the look-up table,
      instead of making changes on swapping the reference indexes and
      associated flags throughout the codebase.
      Change-Id: I823edae1c26263e0e0642a580685a25e81caa0a9
    • Debargha Mukherjee's avatar
      Change vertical border to 1 (2-line buffer) · da46da8e
      Debargha Mukherjee authored
      Changes the macros SGRPROJ_BORDER_VERT and
      SGRPROJ_BORDER_VERT to 1 to use a single line border
      vertically - which will be equivalent to a 2-line buffer.
      Change-Id: I788d9dca53d3d492058914215acf61e9d3d3880d
    • Steinar Midtskogen's avatar
      CDEF: Do not filter chroma if subsampling_x != subsampling_y · 1c1161f1
      Steinar Midtskogen authored
      Since CDEF looks uses the luma direction for chroma, CDEF would have
      to change significantly to support formats like 4:2:2.  The limited
      use of such formats does not justify the complexity to support this,
      so the simple solution is to mandate that the chroma planes aren't
      filtered if subsampling_x != subsampling_y.  Most of the visual gain
      is in luma, anyway.
      This also means that the chroma strengths and chroma skip condition
      shall not be sent if subsampling_x != subsampling_y.
      Change-Id: I35c184a6fe0908ae0fee1e74494b6904fa9a3c82
    • David Barker's avatar
      cdef-singlepass: Fix integer overflow · 0123bc7d
      David Barker authored
      When cdef-singlepass is enabled, it is possible to signal the
      CDEF parameters in such a way that we end up with unsigned
      integer overflow in constrain().
      Fix this by i) using signed instead of unsigned values,
      and ii) clamping the result to avoid going on to shift
      by a negative amount.
      Change-Id: Ib677b2d644e44000c54959f7280e646bf02054da
  6. 10 Sep, 2017 1 commit
    • Jingning Han's avatar
      Rework base range entropy coding in level map system · 87b01b5a
      Jingning Han authored
      Replace the truncated geometric distribution model with the grouped
      leaves structure for more efficient probability modeling.
      Each group has its own Geometric distribution
      This give us 0.2% gain on lowres
      Change-Id: If5c73dd429bd5183a8aa81042f8f56937b1d8a6a