Should be able to move in there -- you're able to dig at least one area around where the house should be. I think he's just being stubborn. Assuming you missed a spot with your patterns or you didn't block off other plots?
After about an hour he finally moved in where I wanted him. I was getting concerned because he kept alternating between the 2 spots I missed but seemed to want nothing to do with my preferred spot.