• Jingning Han's avatar
    Fast computation path for forward transform and quantization · ccba289f
    Jingning Han authored
    This commit enables a fast path computational flow for forward
    transformation. It checks the sse and variance of prediction
    residuals and decides if the quantized coefficients are all
    zero, dc only, or more. It then selects the corresponding coding
    path in the forward transformation and quantization stage.
    It is currently enabled in rtc coding mode. Will do it for rd
    coding mode next.
    In speed -6, the runtime for pedestrian_area 1080p at 1000 kbps
    goes down from 14234 ms to 13704 ms, i.e., about 4% speed-up.
    Overall coding performance for rtc set is changed by -0.18%.
    Change-Id: I0452da1786d59bc8bcbe0a35fdae9f623d1d44e1