Skip to content
  • Miroslav Lichvar's avatar
    stream_encoder : Improve selection of residual accumulator width · f081524c
    Miroslav Lichvar authored and Erik de Castro Lopo's avatar Erik de Castro Lopo committed
    In the precompute_partition_info_sums_ function, instead of selecting
    64-bit accumulator when the signal bps is larger than 16, revert to the
    original approach based on partition size, but make room for few extra
    bits to not overflow with unusual signals where the average residual
    magnitude may be larger than bps.
    
    It slightly improves the performance with standard encoding levels and
    16-bit files as the 17-bit side channel can still be processed with the
    32-bit accumulator and correctly selects the 64-bit accumulator with
    very large 16-bit partitions.
    
    This is related to commits 6f7ec60c and 187e596e
    
    .
    
    Signed-off-by: default avatarErik de Castro Lopo <erikd@mega-nerd.com>
    f081524c