>>1
If you can't do it fast enough, maybe you can precompute the rotated images? Should work pretty well if it's only the generic "Rotate right/left" stuff.
Afaik GQView also preloads and prescales the next image while viewing, but I don't know about rotation.