If he made the same mistake as he had done originally, then Voyager wouldn't have been able to survive meeting Anorax.

So I think that he somehow was affected by all of the time distortions that he did, (maybe his ship wasn't as protective against time changes because the ship was probably a few centuries old) and he subconsciously chose his wife because of this.