Ok thanks. I've cleared it to under 10 items on the floor and now it says that further development is desired but before it said with little work the town could become the best town ever. I didn't cut down any trees or anything.
I can verify mushrooms & single pieces of fruit on the ground don't count as litter. Items/furniture, gems, balloon presents, fruit baskets, and handheld items/tools do count as litter.