Are you just playing random games with him or the ones where he says he'll move to town if you win? Just keep talking to him until he brings up moving to town and pester him until he agrees to play a game to determine his fate lol. Usually if it's an easy game like charades you've got him for sure