Punishment was never supposed to be indefinite. It is not a means of its own, but rather it services a purpose to a bigger goal. As soon as Yaakov's punishment of not seeing his son Yosef was over, Yosef made a quick move.