The restoration buffers are freed and allocated at every frame, which
is not necessary. This patch makes the allocation to happen only when
it is necessary.

Change-Id: I773f7ec9202d17c57bba44a698350e05101fa871