Raw seeking in small ogg files isnt working

When using seeking_example on the test ogg-file, something goes wrong:

loading....
testing raw seeking to random places in 4148 bytes....
    172 [raw position 17]...data position after seek doesn't match pcm position


In my game im using a mixer that decodes data from diff. ogg streams. I need to
be able to take a "stamp" of where i am currently in a stream, and then be able
to jump back to it later. The streams are relatively small, (about 5000 bytes in
the OggVorbis format) , Im trying to use ov_raw_seek and ov_raw_tell, but they
somehow give me wrong values. ov_pcm_tell and ov_pcm_seek work fine (but they
are too slow)