You can time travel if you want but then you have to bear the risk, such as losing the villagers that you do want if you're not careful TT-ing.
But I'd say you can try to befriend them, maybe personality-wise they'll attract you ;D I like some villagers that people considered ugly, like Gruff, Canberra, Curly, and so on but I like their personality so their look does not matter anymore to me