My son said that if people talk to your villagers while they are visiting, that they might move out of your town and go to the visitors town. Is that true? I've been avoiding all of his villagers and I keep worrying one might talk to me. He likes his villagers, so that would be awful. And I also like most of mine, so I wouldn't want visitors to be able to take any of them.