I use coconuts, but foreign fruits work quite well for this too.
If you really want to give them furniture, the villagers don't do anything with furniture that hangs on a wall. You can give them those. Just make sure not to give them anything that can hang on their front door if you don't want it there, because they absolutely WILL put it on their door.