Yes, I do now. Sometimes it is the middle of the night and even on a good day only a few show up. Doesn't bother me. Gives Isabelle extra poppers to amuse herself.
I have been lately, because I've had to destroy and move some PWPs around, so I just got annoyed and didn't go to the ones that had technically already been built before. I'm lazy. I got **** to do, and as Karla said, ain't nobody got time for that when it's something you've already had before and were just moving.
I said no once to see what happens, I thought she would still force me to go. But she didn't, so from now on I won't go to any since it too long and repetitive.
I've never skipped it and I always thought that if you did, you'd just have to do it at later time. Apparently not! hehe...
But as Ras said, it's a good way to get most of the villagers outside in one spot in case they ping for anything.