I might have some insights. When I cycled, I did notice that the same villagers or same set of villagers tend to pop up over and over, for example, Genji. I swear I had that dude like 3 different times in my town.
Also, my sister got it in her head to meet all 333 villagers in her town. So whenever someone wanted to move out, she never said no. What we both observed was, she also had the same villagers moving back in. So what we both concluded was, it would be hard to meet all 333 as some towns seem to favor certain villagers.
So, the short answer to your question, yes, you sometimes get the same villagers over and over again, in both your town and campsite.