If you're still on the day before, you could try time-traveling to earlier in the day when he's not asleep. Then you can hopefully ping/talk to him and convince him to change his mind. If he hasn't pinged you yet about moving, perhaps this will be his opportunity to do so.