Do matrix multiply ourselves instead of (ab)using the GL matrix stack.