It's your game, of course! Do whatever you want! :D I've been playing Animal Crossing since I was five, ALWAYS time traveled, and nothing bad ever happened! I still TT now, it's funner for me because I don't get bored this way! xD The only bad thing I suppose is some of your villagers will move...