The villager amiibo cards(series 1~4, don't know about the new 50) completely override the 16-villager cycle, so if you have his card, he'll move right back in.
Good luck! I've been looking for a Julian card for a while now. eBay is too expensive
Also, the welcome amiibo cards bypass the 16 villager cycle too. I've moved Claude on and out several times already