It's fine. My town is pretty underdeveloped at this point because my villagers seem to really like suggesting hideous PWPs so there's not much to ruin.
There aren't too many flowers left but you're free to take all of the orange pansies and non-hybrids you want. The orange pansies are up in the top left and the rest of the red flowers are in the left area of town.