You should keep as many as you can in your inventory. When villagers ask for any kind of perfect fruit, they respond better (apparently) to perfect fruit that is not native. Also, if they ask for the specific kind of fruit, they'll like it being perfect. It helps you get their pictures faster!