My problem is I have a ton of flowers in my town so its difficult to find a spot to shoot down the balloon, and I don't generally have the patience to wait for the balloon to get to an appropriate spot, so I don't bother. I do agree with what others have said though about villager crafting and bottles, I do actually have the patience required to do those two as I find them a lot less frustrating!