Just keep talking to them. I don't know if every villager does this (I know Kody didn't, he accepted my invitation to move the first time I offered) but with Patty I had to play charades with her twice before she would move in. (lost my watering can to her the first time... that *****)