Depends on your definition of hot and cold.
60-75 degrees is my ideal weather. Over 80 degrees is really annoying if it's humid.
I also get really annoyed when it's colder than -10. So basically from -10F-80F is my level tolerance. Too bad in Minnesota I spend half the year either above or below that scale.
When it's cold I want it to be hot, but when it's hot I want to to be cold :S But my favorite season is Autumn (Fall) so my answer is when it starts to get cold. But if I had to choose between hot or cold. I would say cold.