math: Make sure that we do not drop and positions in poses when the other pose
has a non-valid position.