Commit 5b573d65 authored by Jingning Han's avatar Jingning Han

Fix vp10_inv_txfm2d.round_trip test failure

Avoid accessing transform type that is not 2D-DCT if the transform
size is 64x64. This fixes an assert failure in this unit test.

Change-Id: I0dee865ea0925f5743b8a25c2f90eb6522b4d272
parent cacd6347
......@@ -69,6 +69,10 @@ TEST(vp10_inv_txfm2d, round_trip) {
const Inv_Txfm2d_Func inv_txfm_func = inv_txfm_func_ls[txfm_size_idx];
const int count = 1000;
double avg_abs_error = 0;
if (txfm_size == 64 && tx_type != DCT_DCT)
continue;
ACMRandom rnd(ACMRandom::DeterministicSeed());
for (int ci = 0; ci < count; ci++) {
for (int ni = 0; ni < sqr_txfm_size; ++ni) {
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment