Since the new 'rustic'-Update I have the same problem.
It's weird because the game doesn't seem to notice that I am wearing a hat... I can still click 'wear'. But whenever I want to change clothes the game crashes, too...
Did your problem vanish by now?
And if so, what did you do?