Commit 05e21d8d authored by Timothy B. Terriberry's avatar Timothy B. Terriberry Committed by Tim Terriberry
Browse files

ec_smallmul: Relax tell test.

The small multiplier intentionally introduces a larger error, so
relax the accuracy threshold in the aom_reader_tell_frac() test.

Change-Id: Ib046a95dd3a8498a1a2ea58680796e75fd195868
parent 4ef7f7a5
......@@ -92,7 +92,11 @@ TEST(AV1, TestBitIO) {
}
#if CONFIG_DAALA_EC
#if CONFIG_EC_SMALLMUL
#define FRAC_DIFF_TOTAL_ERROR 0.16
#else
#define FRAC_DIFF_TOTAL_ERROR 0.07
#endif
#else
#define FRAC_DIFF_TOTAL_ERROR 0.2
#endif
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment