Having a similar problem... all 3 of my villagers have moved in, so I thought it was safe to go to the islands again. Nope, still nothing. I have now placed my campsite and construction is done.. anyone know if it's safe NOW or do I have to wait another day?