1. 29 Nov, 2017 1 commit
    • Sarah Parker's avatar
      Make new_quant bin sizes uniform · ca52fb5f
      Sarah Parker authored
      This gives a -0.05% change in performance over the regular
      quantizer. The new_quant bins will remain uniform as we
      experiment with different parameters.
      
      Change-Id: Ic92c74fb1183cf1c2460bbcf1e223452f46d8210
      ca52fb5f
  2. 20 Nov, 2017 1 commit
    • Monty Montgomery's avatar
      Add Daala TX fixed-coeff-depth capability to quantization · 60f2a229
      Monty Montgomery authored
      This patch completes the work to add fixed-depth TX domain support to
      the quantization and dequantization code.  At present, it is active but
      configured to behave identically to current AV1 master as RDO and TX
      have not yet been updated to also support this functionality.
      
      subset-1:
      monty-rest-of-stack-noshift-s1@2017-11-13T14:37:42.541Z ->
       monty-rest-of-stack-quant-s1@2017-11-13T14:38:43.774Z
      
        PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
      0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000
      
      objective-1-fast --limit=4:
      monty-rest-of-stack-noshift-o1f4@2017-11-13T14:37:16.992Z ->
       monty-rest-of-stack-quant-o1f4@2017-11-13T14:38:28.828Z
      
        PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
      0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000
      
      Change-Id: I3773a1fc128136c9fea227f4b547576a8aa6efa3
      60f2a229
  3. 15 Nov, 2017 1 commit
    • Yaowu Xu's avatar
      Support Separate qmatrix for U and V planes · d467bba2
      Yaowu Xu authored
      This commit adds support of a separate qmatrix and iqmatrix for each
      of the U and V planes. Currently the separate matrices are intialized
      to the same ones, then the commit does not have any coding impact
      yet.
      
      Change-Id: I5c4045fe1879db262c6ec1567d8d7dfd9a98fbed
      d467bba2
  4. 10 Nov, 2017 1 commit
    • Yaowu Xu's avatar
      Separate quantizaton for U and V plane · be42dc72
      Yaowu Xu authored
      This commit adds code to support separate regular quantization for U
      and V. They currently always use same quantization parameter, hence
      this commit does not change bitstream at all.
      
      Change-Id: Ifaf43e4fd0bcd01b1483f2dacf3ac498003d5db1
      be42dc72
  5. 09 Nov, 2017 2 commits
    • Rostislav Pehlivanov's avatar
      Add the q_segmentation experiment · f624dd5a
      Rostislav Pehlivanov authored
      This experiment implements low-cost delta q signalling on a per-block basis
      for all non-inter frame types, which would allow for more efficient AQ
      which bases its decisions on temporal information.
      
      Based on an Intel proposal from March.
      
      Change-Id: I18e73d8b12f4caa0b165df12c58ab506271bec03
      f624dd5a
    • Monty Montgomery's avatar
      Separate quantizers used for quantization from RDO · 125c0fca
      Monty Montgomery authored
      Generalize quantizer setup so that quantization and TX can use
      different coefficient shifts/scalings without inpacting RDO lambda
      generation.
      
      This patch is documentaiton + a minor refactor setting up later
      work; it causes no functional change.
      
      monty-daalaTX-fulltest-Daalabaseline-o1f@2017-11-07T00:01:20.779Z ->
       monty-daalaTX-fulltest-DaalaRDO-o1f@2017-11-07T00:02:31.347Z
      
      PSNR | PSNR Cb | PSNR Cr | PSNR HVS | SSIM | MS SSIM | CIEDE 2000
       N/A |  0.0000 |  0.0000 |      N/A |  N/A |     N/A |        N/A
      (note-- the numbers above were collected using --cpu-used=3, which
       appears to be newly broken.)
      
      monty-daalaTX-fulltest-Daalabaseline-o1f4@2017-11-07T05:59:16.553Z ->
       monty-daalaTX-fulltest-DaalaRDO-o1f4@2017-11-07T05:59:50.180Z
      
        PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
      0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000
      
      monty-daalaTX-fulltest-Daalabaseline-s1@2017-11-07T00:01:46.582Z ->
       monty-daalaTX-fulltest-DaalaRDO-s1@2017-11-07T00:02:56.282Z
      
        PSNR | PSNR Cb | PSNR Cr | PSNR HVS |   SSIM | MS SSIM | CIEDE 2000
      0.0000 |  0.0000 |  0.0000 |   0.0000 | 0.0000 |  0.0000 |     0.0000
      
      Change-Id: Ia5a3c052eacd17184ca1b0fe6d032cfb9afdb77f
      125c0fca
  6. 29 Sep, 2017 1 commit
  7. 09 Sep, 2017 1 commit
  8. 04 Sep, 2017 1 commit
  9. 08 Aug, 2017 2 commits
    • Thomas Davies's avatar
      AOM_QM: use SIMD for flat matrices and re-enable tests. · 1870382c
      Thomas Davies authored
      When AOM_QM is enabled, by default quantization matrices are
      flat unless enabled with --enable-qm=1. Re-use existing SIMD
      functions when a flat matrix is used, so that there is no
      speed deficit when AOM_QM is enabled.
      
      SIMD for the non-flat case is TBC.
      
      Change-Id: I1bb8da70d3dd5858dac15099610ddf61662e3d0d
      1870382c
    • Thomas Davies's avatar
      Refactor quantization C code. · f3b5ee14
      Thomas Davies authored
      This commit de-duplicates C reference quantization code
      and unifies quantization matrix (QM) and non-QM code
      paths when there is no SIMD.
      
      The reorganisation also will facilitate re-using SIMD quant
      functions for QM when the matrix is flat, as is the
      default when AOM_QM is enabled.
      
      Change-Id: Idbfdac9eb9a31adcffe734aac1877d58b86fab77
      f3b5ee14
  10. 28 Jun, 2017 1 commit
  11. 22 Jun, 2017 2 commits
    • Yaowu Xu's avatar
      convert to int before apply sign · bdda9d4e
      Yaowu Xu authored
      avoids overflow of unsigned integer.
      
      Change-Id: Ic92974b508bb0cd6fc680203ffa6cff14d644ff7
      bdda9d4e
    • Yi Luo's avatar
      Add avx2 highbd_quantize_b · 193422e7
      Yi Luo authored
      - First pass encoding time reduces ~10.9% on i7-6700
        at 100 frames, 1080p.
      - avx2 works for coeff number >= 8 cases; coeff number < 8
        case will be implemented by sse2.
      - Unit test is added type B/FP/DC.
      
      Change-Id: Ibe5b7807c64e6dfc2d59c470ed50a6e8ca94ef7c
      193422e7
  12. 12 Jun, 2017 1 commit
    • Jingning Han's avatar
      Fix high bit-depth quantization process · 6ae7b3d9
      Jingning Han authored
      Scale the rounding factor according to the scaling factor applied
      to the quantization step size. This resolves a compression
      performance regression in 32x32 and above transform size.
      
      BUG=aomedia:599
      
      Change-Id: Id3fc9a46c4a8843ff5d77ccaa59ee3112b12d7f4
      6ae7b3d9
  13. 26 May, 2017 1 commit
    • Yi Luo's avatar
      Improve the quantization table interface · c621023e
      Yi Luo authored
      - Add av1_build_quantize() function so that quantization
        related unit test would be able to access quant/dequant
        table without starting an encoder instance and directly
        accessing cpi.
      
      Change-Id: I8ba429e5deb7a4e7f967996aaec1d20bff0feb3c
      c621023e
  14. 28 Apr, 2017 1 commit
  15. 26 Apr, 2017 1 commit
    • Cheng Chen's avatar
      Refactor aom_quantize_b · 9b180373
      Cheng Chen authored
      Use one helper function to remove copy paste of
      aom_quantize_b_c, aom_quantize_b_32x32_c, aom_quantize_b_64x64_c.
      And remove redundant av1_quantize_b_c, av1_highbd_quantize_b_c.
      
      BUG=aomedia:442
      
      Change-Id: I3e7923a64a16af223c3e2a42dc27c0f28a9b134b
      9b180373
  16. 25 Apr, 2017 2 commits
  17. 24 Apr, 2017 1 commit
    • Fangwen Fu's avatar
      Extend delta q with segments · 6160df29
      Fangwen Fu authored
      This is the first patch for ext_delta_q experiment.
      * Allow delta q to work with segment features
      
      Change-Id: I9455ebb3b5b23b41daa4afa1149672a20d3a3f2c
      6160df29
  18. 20 Apr, 2017 1 commit
  19. 12 Apr, 2017 1 commit
  20. 04 Apr, 2017 1 commit
  21. 22 Mar, 2017 1 commit
  22. 08 Mar, 2017 2 commits
  23. 13 Feb, 2017 1 commit
  24. 19 Dec, 2016 1 commit
    • Thomas Davies's avatar
      Turn on delta_q by default. · 0090c8fb
      Thomas Davies authored
      Also make sure that qindex is clipped to the quantizer range.
      
      Change-Id: I3163da4b45e190f9ab34982d1bbbefa5cba7514e
      0090c8fb
  25. 07 Dec, 2016 2 commits
  26. 29 Nov, 2016 1 commit
  27. 16 Nov, 2016 1 commit
    • Yaowu Xu's avatar
      Fix IOC warnings · 4d34154b
      Yaowu Xu authored
      av1_txfm.h: left shift of a negative number
      av1/encoder/quantize.c: unsigned int overflow
      aom_dsp/entenc.c: unsigned int overflow
      
      Change-Id: I6143e68f7d6e2621f97900808c8ef7ee0ad0c814
      4d34154b
  28. 14 Nov, 2016 1 commit
  29. 10 Nov, 2016 1 commit
    • Yaowu Xu's avatar
      apply clang-format · 49eea11c
      Yaowu Xu authored
      For these files:
      av1/common/common_data.h
      av1/encoder/encodemb.c
      av1/encoder/quantize.c
      av1/encoder/rdopt.c
      
      Change-Id: I379e861d55c2875d0366df24f986b29796a70087
      49eea11c
  30. 09 Nov, 2016 1 commit
  31. 24 Oct, 2016 1 commit
    • David Barker's avatar
      Fix a bug when combining new-quant + supertx · d7d78c83
      David Barker authored
      Previously, we assumed that av1_init_plane_quantizers is always called with
      segment_id == xd->mi[0]->mbmi.segment_id (and use the latter to derive the value
      of 'qindex' to use in the quantizer). But this is no longer true when supertx
      is enabled. This patch instead remembers the value of 'qindex' derived from
      the latest call to av1_init_plane_quantizers and uses that directly.
      
      Change-Id: Ifa1c5bf74cad29942ff79b88ca92c231bc07f336
      d7d78c83
  32. 19 Oct, 2016 3 commits