Factor out freeing of IPMAPs (as a list, for upcoming commits).