I just experienced one of the best moments when I stepped out of the train station and saw both Skye and Beau in my welcome committee! I've always loved being loyal to my starting villagers and have tried keeping at least one of them <3
With Fairbell I've just been insanely lucky - my other three were Cheri, Olivia and Hopper (all three of whom I may also keep)
In past towns I've also sometimes grown unexpectedly attached to some I wouldn't have even considered, like Gaston and Gala. But still, if I dislike the villager or their house I have no qualms letting them go.