I'd say don't give up on them but simply cut back on actively looking. They will come to you in time. 
Personally I also have 2 dream villagers that I really want in my town, as they were my best friends in Wild World. I like having my villagers move in naturally through the campsite, so I only put my own villagers up for adoption/last-minute auction, but not villager-for-villager trades. The other "dreamies" are villagers that interested me the most when I checked out all the different personalities. I still pick up random campers that make a good impression on me. I find the game to be more interesting this way.
Personally I also have 2 dream villagers that I really want in my town, as they were my best friends in Wild World. I like having my villagers move in naturally through the campsite, so I only put my own villagers up for adoption/last-minute auction, but not villager-for-villager trades. The other "dreamies" are villagers that interested me the most when I checked out all the different personalities. I still pick up random campers that make a good impression on me. I find the game to be more interesting this way.