think of) to produce NaNs in the new PLC.

arithmetic.

introduced in Thorvald's previous patch.

Timothy Terriberry authored 15 years ago and Jean-Marc Valin committed 15 years ago

Expose the normalized range for reciprocal square roots in fixed-point mode. This allows subsequnt calculations to use the full precision of the result.

budget at low bitrate.

Timothy B. Terriberry authored 15 years ago and Jean-Marc Valin committed 15 years ago

Accuracy for rsqrt, rcp, cos, and log2 is now at the level of truncation error
 for the current output resolution of these functions.
sqrt and exp2 still have non-trivial algebraic error, but this cannot be
 reduced much further using the current method without additional computation.
Also updates the fast float approximations for log2 and exp2 with coefficients
 that give slightly lower maximum relative error.

Patch modified by Jean-Marc Valin to leave the cos approximation as is and
leave the check for x<-15 in exp2 as is.