Don't use too much temporal resolution on hybrid frames at low rate

Otherwise, we risk having "temporal holes" in the HF that anti-collapse
can't always fill in.