1. 16 Feb, 2018 1 commit
    • David Barker's avatar
      [non-normative] Clarify clamping code for inverse transforms · 92b49a6d
      David Barker authored
      Although the clamping for the inverse transforms is still being
      discussed, it is useful to have clear code.
      
      The current code is not ideal - both av1_inv_txfm1d.c and av1_inv_txfm2d.c
      have functions called clamp_buf(), but they do different things - one
      clamps to the exact number of bits passed in, the other optionally
      clamps to 16 bits.
      
      This commit refactors things so that:
      
      * clamp_* always clamps to the exact number of bits passed in
        To compensate, we push the "if bit <= 16: clamp to 16 bits"
        logic into the callers of the clamp_* functions
      
      * We deduplicate some of the code
      
      BUG=aomedia:1352
      
      Change-Id: I1b9d85d6db5d291814c055a8113b7b054690b04c
      92b49a6d
  2. 15 Feb, 2018 1 commit
    • Yaowu Xu's avatar
      Remove CONFIG_TX64X64 · d3d4159f
      Yaowu Xu authored
      The experiment is fully adopted.
      
      Change-Id: I6cc80a2acf0c93c13b0e36e6f4a2378fe5ce33c3
      d3d4159f
  3. 14 Feb, 2018 1 commit
    • Peng Bin's avatar
      Refactor inv_cos_bit for speedup · 28744b5c
      Peng Bin authored
      Replace the last parameter cos_bit for all 1D inv_txfm funcions with
      a macro define, as it is actually always equal to 12. By changing it
      to const value, compiler can do further optimization.
      
      Change-Id: If8a9fd99c7ac7eb6f485dafbce22b4803efda62e
      28744b5c
  4. 09 Feb, 2018 1 commit
  5. 08 Feb, 2018 1 commit
  6. 05 Feb, 2018 1 commit
  7. 03 Feb, 2018 1 commit
  8. 31 Jan, 2018 1 commit
    • Angie Chiang's avatar
      Update adst4 range · 5d7c1fcc
      Angie Chiang authored
      Serialize the adst4 operations
      Update stage range accordingly
      Change the cos_bit precision accordingly.
      Correct 4x8/8x4 inv_start_range
      
      BUG=aomedia:1271
      
      Change-Id: I10bc91585a61d790decdc24cb91659102e043620
      5d7c1fcc
  9. 26 Jan, 2018 1 commit
  10. 25 Jan, 2018 2 commits
    • Angie Chiang's avatar
      Simplify txfm table · 0c7b8d84
      Angie Chiang authored
      Instead of listing all possible stage_range,
      we use set_fwd_txfm_non_scale_range() to generate 2d stage_range
      from 1d stage_range.
      
      This will reduce the complexity of txfm table significantly.
      
      This is a lossless change.
      The coding performance isn't changed.
      The txfm config is exactly the same as it was before.
      
      Change-Id: Ibd1d9e53772bb928faaeecc98d81cbc8f38b27ed
      0c7b8d84
    • Angie Chiang's avatar
      Refactor buf_offset in av1_inv_txfm2d.c · 0822557b
      Angie Chiang authored
      Change-Id: I73d1d15ab678242737432064d203c476057286ed
      0822557b
  11. 24 Jan, 2018 1 commit
    • Angie Chiang's avatar
      Simplify cos_bit setting in txfm · d4327bce
      Angie Chiang authored
      Move cos_bit from txfm 1d cfg to 2d cfg
      Each txfm stage only uses one cos_bit
      
      This is a lossless change and it speeds up encoder by 2%
      
      Change-Id: I45d398761e4729b8c4c37729571fe3765cb0c83f
      d4327bce
  12. 23 Jan, 2018 2 commits
  13. 17 Jan, 2018 1 commit
  14. 11 Jan, 2018 1 commit
  15. 09 Jan, 2018 1 commit
    • Sebastien Alaiwan's avatar
      Clamp inverse transform coeffs after 1st/2nd pass · a3457cc2
      Sebastien Alaiwan authored
      Add clamping to 16/18/20 bits after first pass of the inverse
      transform for 8/10/12 bit source espectively, and clampaing to 16
      bits after second stage of the inverse transform.
      
      BUG=aomedia:30
      
      Change-Id: I7a68334c77baecb359a4fb3b801fdfd9d5a62f29
      a3457cc2
  16. 04 Jan, 2018 1 commit
  17. 03 Jan, 2018 2 commits
  18. 29 Dec, 2017 1 commit
  19. 25 Dec, 2017 1 commit
    • Debargha Mukherjee's avatar
      Use and adjust rectangular txfm stage ranges · 901d5148
      Debargha Mukherjee authored
      Adjusst txfm stage ranges so that Cfg tests pass, however
      tests with --enable-coefficient-range-checking are still
      failing. Those are to be addressed subsequently.
      
      Change-Id: I1b15406a525a78322211e69a0d3a796823bb645e
      901d5148
  20. 22 Dec, 2017 1 commit
  21. 16 Dec, 2017 1 commit
  22. 14 Dec, 2017 1 commit
    • Urvang Joshi's avatar
      round_shift_array: Use SSE4 version everywhere. · 1ac47a7c
      Urvang Joshi authored
      Usage of CPU by round_shift_array goes from 2.01% to 1.04%.
      Overall encoding is slightly faster (~0.05%).
      
      This means some of the intermediate array have to be aligned.
      Also, these functions were moved to common header/source files.
      
      BUG=aomedia:1106
      
      Change-Id: I492c9b1f2e7339c6cb83cfe68a61218642654d1b
      1ac47a7c
  23. 13 Dec, 2017 1 commit
  24. 06 Dec, 2017 1 commit
  25. 02 Dec, 2017 1 commit
  26. 01 Dec, 2017 1 commit
  27. 30 Nov, 2017 1 commit
    • Urvang Joshi's avatar
      Pass TXFM_2D_FLIP_CFG by pointer; don't return. · c502216a
      Urvang Joshi authored
      This avoids copying a whole struct on return. This is important, because
      this function is called frequently: once for every block that is transformed.
      
      Overall, aomenc speed seems to be improved slightly: by 0.15% - 0.30%.
      
      Change-Id: If44c351e1141c0fe0458daa2262aeb4afe44de46
      c502216a
  28. 28 Nov, 2017 1 commit
  29. 22 Nov, 2017 1 commit
  30. 17 Nov, 2017 1 commit
  31. 15 Nov, 2017 2 commits
    • Urvang Joshi's avatar
      Fix unit tests for TX64X64. · ab2b36e9
      Urvang Joshi authored
      All tests are now passing.
      
      Change-Id: Ifc1a0f3ff69f5730722a27eed092395595127e8e
      ab2b36e9
    • Debargha Mukherjee's avatar
      Replace RECT_TX_EXT experiment · 35a4db38
      Debargha Mukherjee authored
      Remove the previous experiment and now use the same name for a
      simpler experiment that only enables 4:1 transforms for 4:1
      partitions when ext_partition_types is on, and that which was
      previously enabled with the USE_RECT_TX_EXT macro.
      
      Change-Id: Iccc35744bd292abf3c187da6f23b787692d50296
      35a4db38
  32. 14 Nov, 2017 1 commit
  33. 02 Nov, 2017 1 commit
    • Sebastien Alaiwan's avatar
      Remove experimental flag of EXT_TX · 3bac9928
      Sebastien Alaiwan authored
      This experiment has been adopted, we can simplify the code
      by dropping the associated preprocessor conditionals.
      
      Change-Id: I02ed47186bbc32400ee9bfadda17659d859c0ef7
      3bac9928
  34. 17 Oct, 2017 1 commit
  35. 05 Oct, 2017 2 commits