When does the game allow to swap out villagers

[emilythestrange]

So I now have 5 villagers that have randomly been selected.

How can I change them now or do I have to wait. Also I’d like to change where 2 of their houses are. Are we able to control it in the future similar to new leaf? How does it work?

 

[Kurashiki]

once you get to 9 or 10 villagers they will start to ask to move out, in the mean time after building your campground you will be able to lay down plots and continue to either recruit villagers from islands or have them as random move ins. after you build town hall you will have the option to move houses.