Refactor palette functions to write a general color map

This will allow the mrc-tx experiment to pass in its own color map
and set of probabilities to the tokenize and bit packing functions.
The corresponding change on the decoder side will come in a followup
shortly.

No change in performance.

Change-Id: I1872b7f1b1cf5b102e6289388ce1ae449e67cb4d