I would keep them, especially if they have interesting patterns! I've cut down tons and not gotten any in my town. I don't think they count against perfect town, but I could be wrong.
I really wish they would have included easier tanning or the ability to choose skin tone. I am pale as heck and have always had a more accurate interpretation of myself in AC games and I wish everyone could have that. :(