I have heard of incidences (granted, not as often) of TTers belittling and looking down on those of us that do not TT. As I said, it is not often, but it is not unheard of either.
My daughter works weird hours, but she does not TT. What she did to fix this effect is to set her clock at a 12 hour differential (hers is 12 hours ahead of mine) so that her daytime is at night (when she is working...third shifter). This way, she plays day by day, just at an offset time.
For myself, I do not TT either. I do not really think it is a bad thing if that is what you do, but I'm just not into it. I am anxious that I would mess something up. I also enjoy the relaxed feel that [to me] only comes from not TTing.