Use to happen to me with this one guy a couple years ago. I was honestly just like "screw it" and didn't make any effort for it anymore. But if he asked me to go and wouldn't ditch last second, I just went. Don't worry about it too much. If it happens, it happens. If not, their loss.