Fix an assertion fail in rd_pick_intra_sub_8x8_y_subblock_mode().

BUG=aomedia:410

Change-Id: I22d4aaea0566336605230e09d9590bc235719685