It also depends if they're doing an activity while you're talking to them. For example, if they're fishing or reading, you have the option to speak to them, but you cannot gift them anything until they've stopped what they're doing. At least from my experience, this was one of the factors.