Adds a missing logic in get_vartx_max_txsize() function for
64x16 and 16x64 transforms.

Change-Id: I60bf4f5b49be674f103e30a2e35fa0a43ba1f7e6