1. 15 Sep, 2017 15 commits
    • Nathan E. Egge's avatar
      Force C implementation of 16-point Daala TX's. · 34e1201a
      Nathan E. Egge authored
      This patch fixes a regression introduced in 1d190950 where the encoder
       was using the 16x16 VP9/AV1 transforms for RDO, but then used the Daala
       transforms for encoding.
      
      subset1:
      
      master-daala_dct16@2017-09-13T12:05:18.013Z ->
        master_daala_dct16_use_c@2017-09-13T13:05:02.252Z
      
         PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
      -0.3654 | -0.7634 | -0.7407 |  -0.4884 | -0.4699 | -0.4945 |    -0.5104
      
      master-no_rect_tx-no_var_tx@2017-09-12T00:23:18.153Z ->
        master_daala_dct16_use_c@2017-09-13T13:05:02.252Z
      
         PSNR | PSNR Cb | PSNR Cr | PSNR HVS |    SSIM | MS SSIM | CIEDE 2000
      -0.0133 |  0.1040 | -0.0440 |  -0.0492 | -0.0151 | -0.0120 |     0.0699
      
      Change-Id: Id1830d0975db4bd0320a47fdf45b4bca20881cfb
      34e1201a
    • Nathan E. Egge's avatar
      Remove tabs in configure. · 22fe4a13
      Nathan E. Egge authored
      Change-Id: I0b6a1781ab3bf8e32874fe71e24a4cb8c9943357
      22fe4a13
    • Nathan E. Egge's avatar
      Add the DAALA_TX experiment. · 4e884047
      Nathan E. Egge authored
      Change-Id: I408dbcf69b3f680e5de570e080ce39aeacbf618d
      4e884047
    • Yi Luo's avatar
      Enhance intra pred speed test to include highbd pred · f5d71a69
      Yi Luo authored
      This is a manual merge from libvpx's commit:
      "05ee24149 Add high bitdepth intra prediction
      optimization speed test". Credit goes to Linfeng Zhang.
      
      Change-Id: Ie254593aa9b601889ecb95eca900365055d46a03
      f5d71a69
    • Yi Luo's avatar
      Fix a baseline build error · 2e6a9ab9
      Yi Luo authored
      Change-Id: I9b92caa9d65a3b062762c270c89018c8e08eba0f
      2e6a9ab9
    • Angie Chiang's avatar
      Turn off TestResizeCspWorks under conditions · 1ff7d9ab
      Angie Chiang authored
      DISABLE_TRELLISQ_SEARCH will incur failure of TestResizeCspWorks
      BUG=aomedia:734
      
      Change-Id: I70d51b9a490b251ebd7743faf831da54b94e48c7
      1ff7d9ab
    • Luc Trudeau's avatar
      Fix Dead Store in rdopt.c · 1f7c4114
      Luc Trudeau authored
      Change-Id: Iad6a16d3ab819405de037d5100060710e0636176
      1f7c4114
    • Nathan E. Egge's avatar
      Disable daala_dct64 if tx64x64 is not enabled. · 72e0f783
      Nathan E. Egge authored
      Change-Id: Ib19d9431124b2416abe4a217138ec8bdb029f73c
      72e0f783
    • Nathan E. Egge's avatar
      Fix highbd_iht_test with 4, 8, and 16 daala_tx. · 71b0513b
      Nathan E. Egge authored
      This change fixes a compile error when all three of --enable-daala_dct4,
       --enable-daala_dct8 and --enable-daala_dct16 are enabled at once.
      
      Change-Id: I4942e09fb887afbda2eda6aaacec727b5cbf6f50
      71b0513b
    • Yushin Cho's avatar
      Enable 'dist_8x8' experiment by default · 255ff990
      Yushin Cho authored
      This experiment has been agreed to remove its flag in
      Sep 12 AOMedia Codec WG meeting.
      We first soft-enable it until it gets stable.
      
      The provided encoder option "--tune=[cdef-dist | daala-dist]" is turned
      off by default, hence there is no change in bd-rate.
      
      Change-Id: Ib4553125bbaeff5a98542b39cba942496337f901
      255ff990
    • Yushin Cho's avatar
      Fix a static analyzer warning · ee810273
      Yushin Cho authored
      Also fix asan warnings.
      
      Change-Id: I21fe3150635540abacb5b1b8928c6470db605035
      ee810273
    • Angie Chiang's avatar
      register_state_check: simplify Check() methods · 74acf004
      Angie Chiang authored
      - make Check() void as the EXPECT's are sufficient to document failure
      
      cumulatively this has the effect of avoiding reporting incorrect Check()
      failures due to earlier test failures.
      
      This CL is ported over from
      f8c27d164 register_state_check: simplify Check() methods
      
      Change-Id: I1b65aa769c69c2a52b2e0b363f1c4432965ee89f
      74acf004
    • Yi Luo's avatar
      Enhance intra pred unit test to verify rectangular pred · da9e4afe
      Yi Luo authored
      Add a macro to improve the readibility of test case. The
      coming test cases varying on mode/size would expand the
      list too large.
      
      Change-Id: I74171344098820b21090dd9b857229bdf2e77248
      da9e4afe
    • Zoe Liu's avatar
      Add encoder support for multi-layer GF 16 · 8dd1c980
      Zoe Liu authored
      Currently the use of the new multi-layer GF group of 16 is guarded by
      the macro USE_GF16_MULTI_LAYER, which is turned off. Hence this CL
      does not change any of the encoder behavior.
      
      Change-Id: I588cd34e19388337a2ecb0a0cb3f796a37647e24
      8dd1c980
    • Yunqing Wang's avatar
      Further refactor setup_ref_mv_list · d1121fa3
      Yunqing Wang authored
      This patch follows the previous refactoring patch, and further reduces
      the number of calls made to scan_row_mbmi and scan_col_mbmi by going
      through partition blocks instead of mi blocks. This patch doesn't change
      bitstream, which was proven by Borg test result.
      
      The baseline decoder speed test on 1080p clip showed that the average
      decoder speedup was 1.1%.(fps: 32.626 --> 32.994)
      
      Change-Id: Ic375ae5d682c7454e2f2a2fcf8baa6b4b438d9a6
      d1121fa3
  2. 14 Sep, 2017 1 commit
  3. 13 Sep, 2017 9 commits
    • Sarah Parker's avatar
      Use default reference gm params in error resilient mode · f289f9f5
      Sarah Parker authored
      This allows gm parameters to be written when error resilient mode
      is enabled but avoids depending on stored parameters from the
      previous frame.
      
      BUG=aomedia:741
      
      Change-Id: Iae455a346e0eebb18e2bcfadc8826c75aedfee99
      f289f9f5
    • David Michael Barr's avatar
      [CFL] Fix typedef-redefinition compiler warnings · 5b2021ea
      David Michael Barr authored
      Instead of forward-declaring AV1_COMMON and MACROBLOCKD,
      move the dependent struct and function prototype closer
      to where they are used and after these types are defined.
      
      Change-Id: I75f005b46ef322a6fcbc01377b8dded1637c5f73
      5b2021ea
    • Rupert Swarbrick's avatar
      Teach inspector about 4:1 block sizes · a5263757
      Rupert Swarbrick authored
      Change-Id: I5d60cc74233bf7ddf56bcd0c3e8b8d012a6e5a63
      a5263757
    • Rupert Swarbrick's avatar
      Hide repeated arguments in calls to count_segs in count_segs_sb · 114e81a3
      Rupert Swarbrick authored
      The calls to count_segs appear very different from each other, but
      this is really just because of line wrapping (enforced by the
      clang-format linter). This patch produces equivalent code but the
      results are far easier to read.
      
      Change-Id: I9d548a4988d4ef23f71fbd8afc855eb8a43f7bd5
      114e81a3
    • Rupert Swarbrick's avatar
      Simplify get_partition() implementation · 136d5c17
      Rupert Swarbrick authored
      This function is given a bsize and an mi array and has to figure out
      what partition to use to divide the given bsize in the direction of
      the sizes it finds in the mi array. (Since each block size can be
      reached by only one sequence of partitions, this can be done
      unambiguously)
      
      The previous version was correct, working by looking up entries in the
      partition_lookup array. Unfortunately, that lookup isn't quite enough
      when CONFIG_EXT_PARTITION_TYPES is true, so it then had to do some
      slightly confusing computations to fix things up after the fact.
      
      The new version should be more self-explanatory and doesn't work by
      looking things up in a magic array. It looks up the width and height
      corresponding to bsize and compares them with the width and height
      corresponding to the sb_type at mi_row,mi_col in the mi array. When
      CONFIG_EXT_PARTITION_TYPES is false, this is all you need, and the
      four corresponding cases can be found by a lookup in an array of 4
      elements.
      
      With extended partition types and a sufficiently large block, you have
      to do a bit more searching. For example, if bsize is BLOCK_16X16 and
      the subsize is BLOCK_8X8, the partition might be PARTITION_SPLIT, but
      it might be one of PARTITION_HORZ_A or PARTITION_VERT_A instead. The
      new code adds some comments to explain what's going on.
      
      A nice side-effect of rewriting get_partition in this way is that it
      lets us completely dispense with the partition_lookup array.
      
      The patch also fixes comments for the A/B extended partitions in
      enums.h, which were slightly backwards (a "horizontal split means two
      blocks vertically above one another)
      
      Change-Id: I4b48189103aa63e1859f25a15d7690d53ca7baf5
      136d5c17
    • David Barker's avatar
      aom-qm: Fix overflow in quantizer calculation · 568b7c7e
      David Barker authored
      By using a combination of a small qmlevel and large qindex,
      it is possible for the quantizer 'dqv' to end up > 2^15.
      This currently causes dqv to overflow, so widen its type
      to avoid that.
      
      Note that this is certainly an extreme case, but not entirely
      useless - if using a 32x32 transform, the dequantized value
      can be as small as dqv/2, which may still fit in 16 bits.
      
      Change-Id: I0451e70ba6b17620d94386a98d873f0a8c615635
      568b7c7e
    • Rupert Swarbrick's avatar
      Report a proper error when bitstream wrongly requests prev_frame_mvs · bdfb4a6f
      Rupert Swarbrick authored
      Using an assert (which was compiled out) meant we got to a
      use-after-free in bug 729.
      
      BUG=aomedia:729
      
      Change-Id: I4d0fa5e80322c395f94565c76e2285782c328505
      bdfb4a6f
    • Debargha Mukherjee's avatar
      Change/refactor compound mode handling for sub8x8 · 0f248c46
      Debargha Mukherjee authored
      Turn off compound modes as long as one of the dimensions
      is less than 8.
      
      Imapct on AWCY (0.05% increase in BDRATE)
      https://arewecompressedyet.com/?job=debargha-nocdef-sub8c8nc-0907%402017-09-07T20%3A28%3A38.251Z&job=debargha-nocdef-0907%402017-09-07T14%3A42%3A17.170Z
      
      Change-Id: I4a70890c04149246a50e60990dede21cb8052fad
      0f248c46
    • Yushin Cho's avatar
      Fix compile error when both of dist_8x8 and pvq are enabled · 39086c0b
      Yushin Cho authored
      Remove mistakenly leftover code from commit
      e30a47ca.
      
      Note that this change force-disables activity masking in PVQ until we can add some
      bitstream signaling for it.
      
      Change-Id: I5279f82e7977733ebc40f5aed844ecec1279992a
      39086c0b
  4. 12 Sep, 2017 7 commits
    • Zoe Liu's avatar
      Remove duplicate line of code · 10a051fc
      Zoe Liu authored
      Change-Id: Ie92a17d6c530bdd65464fbc599ce92561b8c0428
      10a051fc
    • Jingning Han's avatar
      Remove unnecessary rate cost setup in lv-map encoding · ba42e749
      Jingning Han authored
      This won't change the coding statistics.
      
      Change-Id: Ibe3790836c59462f830029528d88a6e615efa493
      ba42e749
    • Debargha Mukherjee's avatar
      Ensure consistent border extension before LR · fc9f3ccd
      Debargha Mukherjee authored
      Before LR the border extension needs to be consistent.
      Otherwise there will be inconsistency at the frame boundaries
      causing mismatches.
      
      BUG=aomedia:742
      BUG=aomedia:744
      BUG=aomedia:745
      
      Change-Id: I5b0c51aa1493c58f7acc706bf686ce711eadd75d
      fc9f3ccd
    • Nathan Egge's avatar
      Revert "Add an orthonormal 4-point Type-VII DST." · 5a5e1adb
      Nathan Egge authored
      This reverts commit 72c99e1a.
      
      No metrics on this commit.
      
      Change-Id: I9fc350b25e710c3d5d6d8299ab5348e8b31b39ea
      5a5e1adb
    • Nathan E. Egge's avatar
      Add an orthonormal 4-point Type-VII DST. · 72c99e1a
      Nathan E. Egge authored
      Replaces the orthonormal Type-IV DST with an orthonormal Type-VII DST
       in od_bin_fdst4() and od_bin_idst4()
      
      Change-Id: I4ff0888e740d8cc063a2e5deaeceef7cb0d80485
      72c99e1a
    • David Barker's avatar
      Clarify comment in av1_set_mb_mi() · ee0fd929
      David Barker authored
      The code currently pads the decoded frame width and height to a
      multiple of 8 luma pixels, but there is a TODO suggesting that
      this may be changed to only require a multiple of 4 in future.
      
      But, as per the comments on the linked bug, there are good reasons
      to keep the decoded width and height as multiples of 8. So delete
      the outdated TODO and instead outline the reasons why the current
      behaviour is helpful.
      
      BUG=aomedia:727
      
      Change-Id: I2340bbcd740afe74c2e6fb3cf2e7a420db2b4f40
      ee0fd929
    • Luc Trudeau's avatar
      Chroma Fix for Superblock CDF update · d7150530
      Luc Trudeau authored
      UV_INTRA_MODES must be used for chroma modes
      
      Change-Id: I3e72d16204d11062a850fd00fb6272358dd61aac
      d7150530
  5. 11 Sep, 2017 8 commits
    • Sarah Parker's avatar
      Tokenize and write mrc mask · 99e7daa2
      Sarah Parker authored
      This allows a mask for mrc-tx to be sent in the bitstream for
      inter or intra 32x32 transform blocks. The option to send the mask
      vs build it from the prediction signal is currently controlled with
      a macro. In the future, it is likely the macro will be removed and it
      will be possible for a block to select either method. The mask building
      functions are still placeholders and will be filled in in a followup.
      
      Change-Id: Ie27643ff172cc2b1a9b389fd503fe6bf7c9e21e3
      99e7daa2
    • Jingning Han's avatar
      Use per tile model update for coeff_br coding · e29c9260
      Jingning Han authored
      Change-Id: Ie52d52bc25e3fdfdea877349215431d8edc064a3
      e29c9260
    • Jingning Han's avatar
      Fix base range counter index in lv-map decoding · 2e40574e
      Jingning Han authored
      Fix the index order of br_idx.
      
      Change-Id: I55acda816d1ec33c25ca4c31b09976f5e6f9c562
      2e40574e
    • Soo-Chul Han's avatar
      add SEG_LVL_ZEROMV · a752d1d5
      Soo-Chul Han authored
      Change-Id: Icd04302886a4d12890d04f9f15563169a91e3a0d
      a752d1d5
    • Zoe Liu's avatar
      Add support of multi-layer GF group 16 to bit allocation · c3903ff2
      Zoe Liu authored
      Change-Id: I52a7ae7404f15f29a0a0b892884cf0edea619507
      c3903ff2
    • Zoe Liu's avatar
      Define coding parameters for GF group of 16 · 8679f417
      Zoe Liu authored
      Propose the coding structure for GF Group of 16 to use the following
      multi-layer design:
        1st Layer: Frame 0 and Frame 16 (ALTREF)
        2nd Layer: Frame 8 (ALTREF2)
        3rd Layer: Frame 4 and 12 (ALTREF2)
        4th Layer: Frame 2, 6, 10, and 14 (BWDREF)
        5th Layer: Frame 1, 3, 5, 7, 9, 11, 13, and 15
      
      This CL implements the reference frame update for a GF group of 16
      using a look-up table, which is different from the current
      implementation. The motivation behind is to try out various GF group
      coding structures simply through manipulating the look-up table,
      instead of making changes on swapping the reference indexes and
      associated flags throughout the codebase.
      
      Change-Id: I823edae1c26263e0e0642a580685a25e81caa0a9
      8679f417
    • Debargha Mukherjee's avatar
      Change vertical border to 1 (2-line buffer) · da46da8e
      Debargha Mukherjee authored
      Changes the macros SGRPROJ_BORDER_VERT and
      SGRPROJ_BORDER_VERT to 1 to use a single line border
      vertically - which will be equivalent to a 2-line buffer.
      
      Change-Id: I788d9dca53d3d492058914215acf61e9d3d3880d
      da46da8e
    • Steinar Midtskogen's avatar
      CDEF: Do not filter chroma if subsampling_x != subsampling_y · 1c1161f1
      Steinar Midtskogen authored
      Since CDEF looks uses the luma direction for chroma, CDEF would have
      to change significantly to support formats like 4:2:2.  The limited
      use of such formats does not justify the complexity to support this,
      so the simple solution is to mandate that the chroma planes aren't
      filtered if subsampling_x != subsampling_y.  Most of the visual gain
      is in luma, anyway.
      
      This also means that the chroma strengths and chroma skip condition
      shall not be sent if subsampling_x != subsampling_y.
      
      BUG=aomedia:720
      
      Change-Id: I35c184a6fe0908ae0fee1e74494b6904fa9a3c82
      1c1161f1